[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:26.318776 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:33701
I20260709 13:05:26.320506 14474 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:26.321573 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.338784 14483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.339259 14480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.338820 14481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.528756 14482 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:05:27.528872 14474 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:05:27.534368 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.534657 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.534876 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602327534853 us; error 0 us; skew 500 ppm
I20260709 13:05:27.535702 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.542268 14474 webserver.cc:533] Webserver started at http://127.14.34.190:39469/ using document root <none> and password file <none>
I20260709 13:05:27.543191 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.543468 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.543968 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.549916 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "c13c230b8d3a449c879ef5ea7985ec6c"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-nr1f"
I20260709 13:05:27.558354 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:27.563876 14489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.565141 14474 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:27.565526 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "c13c230b8d3a449c879ef5ea7985ec6c"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-nr1f"
I20260709 13:05:27.565891 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.647353 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.649006 14474 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:27.649534 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.721411 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:33701
I20260709 13:05:27.721500 14540 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:33701 every 8 connection(s)
I20260709 13:05:27.729452 14541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.752362 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: Bootstrap starting.
I20260709 13:05:27.758519 14541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.760443 14541 log.cc:826] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:27.765293 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: No bootstrap required, opened a new log
I20260709 13:05:27.785941 14541 raft_consensus.cc:359] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER }
I20260709 13:05:27.786543 14541 raft_consensus.cc:385] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.786880 14541 raft_consensus.cc:740] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13c230b8d3a449c879ef5ea7985ec6c, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.787883 14541 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER }
I20260709 13:05:27.788403 14541 raft_consensus.cc:399] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:27.788697 14541 raft_consensus.cc:493] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:27.789054 14541 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.793365 14541 raft_consensus.cc:515] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER }
I20260709 13:05:27.794147 14541 leader_election.cc:304] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c13c230b8d3a449c879ef5ea7985ec6c; no voters: 
I20260709 13:05:27.795948 14541 leader_election.cc:290] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:27.796347 14544 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.799247 14544 raft_consensus.cc:697] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 1 LEADER]: Becoming Leader. State: Replica: c13c230b8d3a449c879ef5ea7985ec6c, State: Running, Role: LEADER
I20260709 13:05:27.800235 14544 consensus_queue.cc:237] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER }
I20260709 13:05:27.801218 14541 sys_catalog.cc:565] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:27.813021 14546 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13c230b8d3a449c879ef5ea7985ec6c. Latest consensus state: current_term: 1 leader_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER } }
I20260709 13:05:27.813784 14546 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.814426 14545 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13c230b8d3a449c879ef5ea7985ec6c" member_type: VOTER } }
I20260709 13:05:27.815222 14545 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.817087 14553 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:27.828696 14553 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:27.843155 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:27.849848 14553 catalog_manager.cc:1383] Generated new cluster ID: d2049bb24f5a449bbd200994b1bba6a6
I20260709 13:05:27.850194 14553 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:27.891480 14553 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:27.893074 14553 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:27.912431 14553 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: Generated new TSK 0
I20260709 13:05:27.913520 14553 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:27.979154 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.989112 14563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.990404 14564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.995186 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:27.995669 14567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.996681 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.996927 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.997105 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602327997083 us; error 0 us; skew 500 ppm
I20260709 13:05:27.997686 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.002509 14474 webserver.cc:533] Webserver started at http://127.14.34.129:41749/ using document root <none> and password file <none>
I20260709 13:05:28.003249 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.003494 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.003798 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.005040 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "d1653b0c46de495f8e6503602465a7e1"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.011163 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:05:28.016002 14571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.016984 14474 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:05:28.017396 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "d1653b0c46de495f8e6503602465a7e1"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.017798 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.036269 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.038089 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.040910 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.046489 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.046828 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.047145 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.047427 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.143311 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:41777
I20260709 13:05:28.143347 14633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:41777 every 8 connection(s)
I20260709 13:05:28.152971 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.162758 14638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.166769 14639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.170969 14641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.174069 14474 server_base.cc:1061] running on GCE node
I20260709 13:05:28.175168 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.175475 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.175688 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602328175670 us; error 0 us; skew 500 ppm
I20260709 13:05:28.176535 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.178671 14634 heartbeater.cc:344] Connected to a master server at 127.14.34.190:33701
I20260709 13:05:28.179170 14634 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.180049 14474 webserver.cc:533] Webserver started at http://127.14.34.130:46749/ using document root <none> and password file <none>
I20260709 13:05:28.180296 14634 heartbeater.cc:507] Master 127.14.34.190:33701 requested a full tablet report, sending...
I20260709 13:05:28.180773 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.181061 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.181420 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.182998 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.183553 14506 ts_manager.cc:194] Registered new tserver with Master: d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777)
I20260709 13:05:28.185731 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41608
I20260709 13:05:28.190129 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:28.195413 14646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.196419 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:05:28.196777 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.197147 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.241010 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.242841 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.245474 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.249557 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.249861 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.250231 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.250456 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.344981 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:40981
I20260709 13:05:28.345069 14708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:40981 every 8 connection(s)
I20260709 13:05:28.350848 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.360780 14713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.360890 14712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.366900 14709 heartbeater.cc:344] Connected to a master server at 127.14.34.190:33701
I20260709 13:05:28.367463 14709 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.368317 14709 heartbeater.cc:507] Master 127.14.34.190:33701 requested a full tablet report, sending...
W20260709 13:05:28.369774 14715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.370556 14474 server_base.cc:1061] running on GCE node
I20260709 13:05:28.370893 14506 ts_manager.cc:194] Registered new tserver with Master: 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:28.371591 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.371863 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.372063 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602328372046 us; error 0 us; skew 500 ppm
I20260709 13:05:28.372473 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41616
I20260709 13:05:28.372813 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.375734 14474 webserver.cc:533] Webserver started at http://127.14.34.131:35265/ using document root <none> and password file <none>
I20260709 13:05:28.376338 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.376585 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.376895 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.378257 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.383931 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:28.388139 14720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.389039 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:28.389387 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-nr1f"
I20260709 13:05:28.389746 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.407408 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.408985 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.410897 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.413794 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.414076 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:28.414363 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.414573 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.500586 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:39121
I20260709 13:05:28.500669 14782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:39121 every 8 connection(s)
I20260709 13:05:28.518297 14783 heartbeater.cc:344] Connected to a master server at 127.14.34.190:33701
I20260709 13:05:28.518699 14783 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.519596 14783 heartbeater.cc:507] Master 127.14.34.190:33701 requested a full tablet report, sending...
I20260709 13:05:28.521641 14506 ts_manager.cc:194] Registered new tserver with Master: e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:28.522128 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013440298s
I20260709 13:05:28.523422 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41622
I20260709 13:05:28.573601 14506 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41636:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:28.577656 14506 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:28.686879 14674 tablet_service.cc:1511] Processing CreateTablet for tablet acb8d77bf18546a2a35d2caeffb8dc5a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.688562 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb8d77bf18546a2a35d2caeffb8dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.690186 14671 tablet_service.cc:1511] Processing CreateTablet for tablet edfddabb33704b9daba012559a567d1d (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.691820 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfddabb33704b9daba012559a567d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.693379 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 97b87101efa54e698e9b71249aa3a8c5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.695916 14673 tablet_service.cc:1511] Processing CreateTablet for tablet aa231ad4a4b7479ca9618b09e5517aa5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.698992 14599 tablet_service.cc:1511] Processing CreateTablet for tablet acb8d77bf18546a2a35d2caeffb8dc5a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.700592 14599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb8d77bf18546a2a35d2caeffb8dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.701782 14598 tablet_service.cc:1511] Processing CreateTablet for tablet aa231ad4a4b7479ca9618b09e5517aa5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.711956 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b87101efa54e698e9b71249aa3a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.712986 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa231ad4a4b7479ca9618b09e5517aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.710868 14597 tablet_service.cc:1511] Processing CreateTablet for tablet 97b87101efa54e698e9b71249aa3a8c5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.724479 14673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa231ad4a4b7479ca9618b09e5517aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.727952 14594 tablet_service.cc:1511] Processing CreateTablet for tablet 89231c84cc794134b8507202148392de (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.735589 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 02a437693ac34fee870e6658038ac1c4 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.735682 14748 tablet_service.cc:1511] Processing CreateTablet for tablet acb8d77bf18546a2a35d2caeffb8dc5a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.746563 14668 tablet_service.cc:1511] Processing CreateTablet for tablet fc097023892e42b5b8aa92dc86fd2e7a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.732717 14670 tablet_service.cc:1511] Processing CreateTablet for tablet 02a437693ac34fee870e6658038ac1c4 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.737592 14596 tablet_service.cc:1511] Processing CreateTablet for tablet edfddabb33704b9daba012559a567d1d (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.748310 14667 tablet_service.cc:1511] Processing CreateTablet for tablet e37746dbb196456cb2dd07d6f5d1821e (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.750576 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 89231c84cc794134b8507202148392de (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.740260 14593 tablet_service.cc:1511] Processing CreateTablet for tablet fc097023892e42b5b8aa92dc86fd2e7a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.751485 14597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b87101efa54e698e9b71249aa3a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.754714 14748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb8d77bf18546a2a35d2caeffb8dc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.750977 14592 tablet_service.cc:1511] Processing CreateTablet for tablet e37746dbb196456cb2dd07d6f5d1821e (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.761292 14801 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:28.749173 14747 tablet_service.cc:1511] Processing CreateTablet for tablet aa231ad4a4b7479ca9618b09e5517aa5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.762835 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc097023892e42b5b8aa92dc86fd2e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.766822 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa231ad4a4b7479ca9618b09e5517aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.767445 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc097023892e42b5b8aa92dc86fd2e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.757727 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 97b87101efa54e698e9b71249aa3a8c5 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.791544 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b87101efa54e698e9b71249aa3a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.759629 14591 tablet_service.cc:1511] Processing CreateTablet for tablet 13d26fc0ca314af3bc2b96702c117b77 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.795123 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a437693ac34fee870e6658038ac1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.785993 14745 tablet_service.cc:1511] Processing CreateTablet for tablet edfddabb33704b9daba012559a567d1d (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.796841 14744 tablet_service.cc:1511] Processing CreateTablet for tablet 02a437693ac34fee870e6658038ac1c4 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.810168 14742 tablet_service.cc:1511] Processing CreateTablet for tablet fc097023892e42b5b8aa92dc86fd2e7a (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.817462 14745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfddabb33704b9daba012559a567d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.813906 14741 tablet_service.cc:1511] Processing CreateTablet for tablet e37746dbb196456cb2dd07d6f5d1821e (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.811702 14740 tablet_service.cc:1511] Processing CreateTablet for tablet 13d26fc0ca314af3bc2b96702c117b77 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.821027 14674 tablet_service.cc:1511] Processing CreateTablet for tablet 13d26fc0ca314af3bc2b96702c117b77 (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.831266 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d26fc0ca314af3bc2b96702c117b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.823642 14591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d26fc0ca314af3bc2b96702c117b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.833359 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 89231c84cc794134b8507202148392de (DEFAULT_TABLE table=test-workload [id=faf881ab13b041a4bf6c4671ac999cf8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.840204 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a437693ac34fee870e6658038ac1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.849315 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a437693ac34fee870e6658038ac1c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:28.849934 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:28.852659 14592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37746dbb196456cb2dd07d6f5d1821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.852859 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89231c84cc794134b8507202148392de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.854249 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89231c84cc794134b8507202148392de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.857528 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d26fc0ca314af3bc2b96702c117b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.858250 14741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37746dbb196456cb2dd07d6f5d1821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.874439 14667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37746dbb196456cb2dd07d6f5d1821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.912601 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89231c84cc794134b8507202148392de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.943845 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfddabb33704b9daba012559a567d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.948515 14742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc097023892e42b5b8aa92dc86fd2e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.973143 14801 tablet_bootstrap.cc:654] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.980521 14802 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:28.987828 14802 tablet_bootstrap.cc:654] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.045004 14802 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.045653 14802 ts_tablet_manager.cc:1403] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.012s
I20260709 13:05:29.067138 14802 raft_consensus.cc:359] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.076056 14802 raft_consensus.cc:385] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.081220 14802 raft_consensus.cc:740] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.084501 14804 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.084669 14802 consensus_queue.cc:260] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.086551 14801 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.087039 14801 ts_tablet_manager.cc:1403] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.343s	user 0.014s	sys 0.020s
I20260709 13:05:29.092411 14801 raft_consensus.cc:359] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.097774 14801 raft_consensus.cc:385] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.098115 14801 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.098335 14783 heartbeater.cc:499] Master 127.14.34.190:33701 was elected leader, sending a full tablet report...
I20260709 13:05:29.101097 14801 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.110598 14802 ts_tablet_manager.cc:1434] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.007s
I20260709 13:05:29.115792 14802 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.115903 14804 tablet_bootstrap.cc:654] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.127629 14801 ts_tablet_manager.cc:1434] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 13:05:29.128568 14709 heartbeater.cc:499] Master 127.14.34.190:33701 was elected leader, sending a full tablet report...
I20260709 13:05:29.128901 14801 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.132655 14802 tablet_bootstrap.cc:654] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.135491 14801 tablet_bootstrap.cc:654] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.136068 14804 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.136626 14804 ts_tablet_manager.cc:1403] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 13:05:29.140738 14804 raft_consensus.cc:359] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.142278 14804 raft_consensus.cc:385] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.142740 14804 raft_consensus.cc:740] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.143877 14804 consensus_queue.cc:260] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.152546 14634 heartbeater.cc:499] Master 127.14.34.190:33701 was elected leader, sending a full tablet report...
I20260709 13:05:29.153422 14804 ts_tablet_manager.cc:1434] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:05:29.154745 14804 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
W20260709 13:05:29.161276 14635 tablet.cc:2406] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:29.163857 14804 tablet_bootstrap.cc:654] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.177707 14804 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.178229 14804 ts_tablet_manager.cc:1403] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:05:29.181197 14804 raft_consensus.cc:359] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.181916 14804 raft_consensus.cc:385] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.182226 14804 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.182425 14802 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.182927 14802 ts_tablet_manager.cc:1403] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.027s
I20260709 13:05:29.182986 14804 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.185673 14804 ts_tablet_manager.cc:1434] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:29.186128 14801 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.185878 14802 raft_consensus.cc:359] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.186586 14801 ts_tablet_manager.cc:1403] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.020s
I20260709 13:05:29.187117 14802 raft_consensus.cc:385] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.187433 14802 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.188601 14802 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.189711 14801 raft_consensus.cc:359] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.190475 14801 raft_consensus.cc:385] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.190752 14801 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.190973 14802 ts_tablet_manager.cc:1434] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:29.191885 14802 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.186655 14804 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.191469 14801 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.198701 14804 tablet_bootstrap.cc:654] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.201592 14801 ts_tablet_manager.cc:1434] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:05:29.202636 14801 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.205772 14802 tablet_bootstrap.cc:654] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.209077 14801 tablet_bootstrap.cc:654] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.216713 14804 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.217206 14804 ts_tablet_manager.cc:1403] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 13:05:29.220099 14804 raft_consensus.cc:359] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.220857 14804 raft_consensus.cc:385] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.221158 14804 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.221855 14804 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.226200 14801 tablet_bootstrap.cc:492] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.226717 14801 ts_tablet_manager.cc:1403] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:05:29.227572 14807 raft_consensus.cc:493] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.228037 14807 raft_consensus.cc:515] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.232098 14807 leader_election.cc:290] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.238534 14801 raft_consensus.cc:359] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.239259 14801 raft_consensus.cc:385] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.239559 14801 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.240263 14801 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.243674 14804 ts_tablet_manager.cc:1434] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:29.244925 14804 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.252177 14801 ts_tablet_manager.cc:1434] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:29.253821 14806 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.257316 14806 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.260874 14806 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.253427 14801 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.271023 14804 tablet_bootstrap.cc:654] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.272737 14802 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.273331 14802 ts_tablet_manager.cc:1403] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.030s
I20260709 13:05:29.274919 14801 tablet_bootstrap.cc:654] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.277236 14802 raft_consensus.cc:359] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.280047 14802 raft_consensus.cc:385] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.280529 14802 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.281622 14802 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.306671 14804 tablet_bootstrap.cc:492] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.307256 14804 ts_tablet_manager.cc:1403] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.016s
I20260709 13:05:29.308380 14802 ts_tablet_manager.cc:1434] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:05:29.307272 14801 tablet_bootstrap.cc:492] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.313802 14801 ts_tablet_manager.cc:1403] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.000s
I20260709 13:05:29.314535 14802 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.318442 14807 raft_consensus.cc:493] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.320319 14804 raft_consensus.cc:359] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.320874 14804 raft_consensus.cc:385] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.321128 14804 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.318933 14807 raft_consensus.cc:515] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.324436 14807 leader_election.cc:290] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.324246 14801 raft_consensus.cc:359] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.329025 14801 raft_consensus.cc:385] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.321761 14804 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.329344 14801 raft_consensus.cc:740] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.332821 14801 consensus_queue.cc:260] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.335474 14804 ts_tablet_manager.cc:1434] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:05:29.336866 14804 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.340337 14802 tablet_bootstrap.cc:654] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.346957 14801 ts_tablet_manager.cc:1434] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:05:29.351137 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.353142 14801 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.347361 14758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.355545 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.356225 14608 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 0.
I20260709 13:05:29.351279 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.362802 14647 leader_election.cc:304] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:29.363638 14807 raft_consensus.cc:2804] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:29.363678 14650 leader_election.cc:343] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.364274 14807 raft_consensus.cc:493] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.355187 14609 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 0.
I20260709 13:05:29.364622 14807 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.361198 14757 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 0.
I20260709 13:05:29.368674 14811 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.369022 14647 leader_election.cc:304] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.369170 14811 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.378584 14811 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.388484 14807 raft_consensus.cc:515] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.393348 14802 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.393287 14807 leader_election.cc:290] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.393939 14802 ts_tablet_manager.cc:1403] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.015s
I20260709 13:05:29.394904 14827 raft_consensus.cc:2804] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.395340 14827 raft_consensus.cc:493] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.395712 14827 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.398739 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:29.398942 14804 tablet_bootstrap.cc:654] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.399334 14757 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.397557 14802 raft_consensus.cc:359] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.405705 14802 raft_consensus.cc:385] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.406816 14802 raft_consensus.cc:740] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.410802 14802 consensus_queue.cc:260] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.420631 14757 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 1.
I20260709 13:05:29.425324 14650 leader_election.cc:304] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.426195 14807 raft_consensus.cc:2804] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.424747 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.428598 14684 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.433593 14724 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.434548 14806 raft_consensus.cc:2804] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.435302 14806 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.435640 14806 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.434546 14802 ts_tablet_manager.cc:1434] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.004s
I20260709 13:05:29.446651 14802 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.445133 14827 raft_consensus.cc:515] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.456827 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:29.447883 14806 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
W20260709 13:05:29.458354 14650 leader_election.cc:343] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.462316 14801 tablet_bootstrap.cc:654] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.465518 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.462643 14827 leader_election.cc:290] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.464860 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:29.466161 14609 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.466276 14684 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.470111 14807 raft_consensus.cc:697] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:29.470877 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.470994 14807 consensus_queue.cc:237] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.471496 14609 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.474340 14684 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.469828 14832 raft_consensus.cc:493] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.475521 14724 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.475703 14832 raft_consensus.cc:515] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.478008 14832 leader_election.cc:290] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.478585 14832 raft_consensus.cc:2804] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.479030 14832 raft_consensus.cc:697] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.479501 14609 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.479899 14832 consensus_queue.cc:237] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.481359 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.481928 14608 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.482456 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.483144 14607 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.484632 14721 leader_election.cc:304] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.487291 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.488416 14683 raft_consensus.cc:2393] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1653b0c46de495f8e6503602465a7e1 in current term 1: Already voted for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in this term.
I20260709 13:05:29.489092 14608 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 1.
I20260709 13:05:29.489418 14837 raft_consensus.cc:2804] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.465294 14806 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.489809 14837 raft_consensus.cc:493] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.491587 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.494019 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.493597 14647 leader_election.cc:304] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.494915 14827 raft_consensus.cc:2804] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.495550 14827 raft_consensus.cc:697] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:29.494279 14609 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.495797 14575 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.490170 14837 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.496395 14827 consensus_queue.cc:237] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.499733 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.500334 14684 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.501808 14811 raft_consensus.cc:2749] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.504309 14802 tablet_bootstrap.cc:654] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.508083 14609 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 1.
I20260709 13:05:29.516306 14837 raft_consensus.cc:515] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.513255 14504 catalog_manager.cc:5697] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.516615 14503 catalog_manager.cc:5697] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 1 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.518978 14837 leader_election.cc:290] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.521031 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.521746 14609 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.522112 14804 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.521026 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:29.522706 14684 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.522775 14804 ts_tablet_manager.cc:1403] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.003s
I20260709 13:05:29.531605 14609 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.533159 14721 leader_election.cc:304] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.535137 14837 raft_consensus.cc:2804] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.536221 14837 raft_consensus.cc:697] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.537864 14801 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.537294 14837 consensus_queue.cc:237] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.538463 14801 ts_tablet_manager.cc:1403] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.002s
I20260709 13:05:29.525876 14804 raft_consensus.cc:359] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.542361 14804 raft_consensus.cc:385] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.542716 14804 raft_consensus.cc:740] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.543481 14804 consensus_queue.cc:260] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.545313 14684 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.541525 14801 raft_consensus.cc:359] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.551663 14801 raft_consensus.cc:385] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.552039 14801 raft_consensus.cc:740] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.552827 14801 consensus_queue.cc:260] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.551357 14802 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.548995 14804 ts_tablet_manager.cc:1434] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:05:29.558578 14802 ts_tablet_manager.cc:1403] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.000s
I20260709 13:05:29.559307 14804 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.562335 14802 raft_consensus.cc:359] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.563331 14802 raft_consensus.cc:385] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.563727 14802 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.564673 14802 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.568070 14804 tablet_bootstrap.cc:654] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.568264 14801 ts_tablet_manager.cc:1434] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 13:05:29.569557 14801 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.576133 14802 ts_tablet_manager.cc:1434] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:05:29.577828 14832 raft_consensus.cc:493] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.578151 14802 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.578435 14832 raft_consensus.cc:515] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.581116 14832 leader_election.cc:290] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.581895 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.582218 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.582544 14609 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
W20260709 13:05:29.583643 14724 leader_election.cc:343] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.584218 14721 leader_election.cc:304] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:29.585413 14832 raft_consensus.cc:2804] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.585801 14832 raft_consensus.cc:493] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.586174 14804 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.586198 14832 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.586910 14804 ts_tablet_manager.cc:1403] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 13:05:29.589172 14801 tablet_bootstrap.cc:654] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.590042 14804 raft_consensus.cc:359] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.590768 14804 raft_consensus.cc:385] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.591114 14804 raft_consensus.cc:740] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.591876 14804 consensus_queue.cc:260] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.593729 14832 raft_consensus.cc:515] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.594619 14802 tablet_bootstrap.cc:654] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.597023 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.597590 14609 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.599974 14804 ts_tablet_manager.cc:1434] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:29.601135 14804 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.600967 14505 catalog_manager.cc:5697] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.602833 14832 leader_election.cc:290] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.604033 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
W20260709 13:05:29.616077 14724 leader_election.cc:343] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.614382 14827 raft_consensus.cc:493] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.619269 14609 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.620499 14721 leader_election.cc:304] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:29.619299 14827 raft_consensus.cc:515] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.622201 14804 tablet_bootstrap.cc:654] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.622653 14827 leader_election.cc:290] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.624836 14503 catalog_manager.cc:5697] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 1 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.626348 14832 raft_consensus.cc:2804] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.626838 14832 raft_consensus.cc:697] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.627558 14832 consensus_queue.cc:237] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.631623 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
W20260709 13:05:29.633200 14650 leader_election.cc:343] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.640874 14802 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.635989 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.641361 14802 ts_tablet_manager.cc:1403] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.010s
W20260709 13:05:29.642199 14647 leader_election.cc:343] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.642642 14647 leader_election.cc:304] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d; no voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.644184 14827 raft_consensus.cc:2749] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.644644 14802 raft_consensus.cc:359] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.646385 14802 raft_consensus.cc:385] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.646799 14802 raft_consensus.cc:740] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.647789 14802 consensus_queue.cc:260] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.651269 14802 ts_tablet_manager.cc:1434] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:05:29.651971 14802 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.654225 14801 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.654716 14801 ts_tablet_manager.cc:1403] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.013s
I20260709 13:05:29.657685 14801 raft_consensus.cc:359] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.658519 14802 tablet_bootstrap.cc:654] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.658443 14801 raft_consensus.cc:385] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.658906 14801 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.659749 14801 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.660948 14503 catalog_manager.cc:5697] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.665966 14804 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.666473 14804 ts_tablet_manager.cc:1403] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.007s
I20260709 13:05:29.669934 14832 raft_consensus.cc:493] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.669870 14804 raft_consensus.cc:359] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.670778 14804 raft_consensus.cc:385] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.670560 14832 raft_consensus.cc:515] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.671101 14804 raft_consensus.cc:740] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.671972 14804 consensus_queue.cc:260] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.672614 14832 leader_election.cc:290] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.674685 14804 ts_tablet_manager.cc:1434] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:29.675666 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.676275 14609 raft_consensus.cc:2468] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.678048 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.678340 14721 leader_election.cc:304] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.679157 14832 raft_consensus.cc:2804] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:29.679433 14724 leader_election.cc:343] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.679550 14832 raft_consensus.cc:493] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.680326 14832 raft_consensus.cc:3060] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.683826 14801 ts_tablet_manager.cc:1434] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:29.685130 14801 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.690213 14837 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.690856 14837 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.693038 14837 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.694190 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.694927 14684 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.696208 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.696559 14724 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.697351 14837 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:29.697537 14721 leader_election.cc:343] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.697728 14837 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.698122 14837 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.702461 14832 raft_consensus.cc:515] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.703250 14801 tablet_bootstrap.cc:654] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.705387 14837 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.709066 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
W20260709 13:05:29.710510 14721 leader_election.cc:343] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.712541 14802 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.714383 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:29.713052 14804 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.715201 14684 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.717622 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.718220 14609 raft_consensus.cc:3060] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.725024 14609 raft_consensus.cc:2468] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.714148 14837 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.726325 14721 leader_election.cc:304] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.714736 14802 ts_tablet_manager.cc:1403] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.016s
I20260709 13:05:29.727460 14837 raft_consensus.cc:2804] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.729769 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
W20260709 13:05:29.731849 14724 leader_election.cc:343] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.729152 14837 raft_consensus.cc:697] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.734781 14832 leader_election.cc:290] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.735474 14811 raft_consensus.cc:493] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.736065 14811 raft_consensus.cc:515] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.735677 14837 consensus_queue.cc:237] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.738471 14811 leader_election.cc:290] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.739981 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.740738 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
W20260709 13:05:29.741588 14575 leader_election.cc:343] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:29.742432 14575 leader_election.cc:343] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.746678 14575 leader_election.cc:304] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.748067 14811 raft_consensus.cc:2749] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.758912 14801 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.759474 14801 ts_tablet_manager.cc:1403] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.029s
I20260709 13:05:29.761657 14801 raft_consensus.cc:359] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.762311 14801 raft_consensus.cc:385] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.761562 14505 catalog_manager.cc:5697] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.762833 14801 raft_consensus.cc:740] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.764133 14802 raft_consensus.cc:359] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.767022 14684 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.770375 14801 consensus_queue.cc:260] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.771780 14724 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:29.768373 14804 tablet_bootstrap.cc:654] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.773790 14837 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.774410 14837 raft_consensus.cc:697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.775498 14837 consensus_queue.cc:237] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.777107 14802 raft_consensus.cc:385] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.777541 14802 raft_consensus.cc:740] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.778978 14802 consensus_queue.cc:260] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.781996 14801 ts_tablet_manager.cc:1434] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:29.782346 14802 ts_tablet_manager.cc:1434] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.005s
I20260709 13:05:29.783825 14802 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.787595 14801 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.787905 14804 tablet_bootstrap.cc:492] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.788381 14804 ts_tablet_manager.cc:1403] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.002s
I20260709 13:05:29.791379 14804 raft_consensus.cc:359] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.792281 14804 raft_consensus.cc:385] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.792541 14804 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.793269 14804 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.796133 14804 ts_tablet_manager.cc:1434] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:29.797106 14801 tablet_bootstrap.cc:654] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.797395 14804 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: Bootstrap starting.
I20260709 13:05:29.799707 14505 catalog_manager.cc:5697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.803862 14804 tablet_bootstrap.cc:654] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.814756 14804 tablet_bootstrap.cc:492] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: No bootstrap required, opened a new log
I20260709 13:05:29.815214 14804 ts_tablet_manager.cc:1403] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:05:29.817749 14804 raft_consensus.cc:359] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.818621 14804 raft_consensus.cc:385] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.818883 14804 raft_consensus.cc:740] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.819711 14804 consensus_queue.cc:260] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.824476 14827 raft_consensus.cc:493] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.825265 14804 ts_tablet_manager.cc:1434] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:29.824970 14827 raft_consensus.cc:515] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.828974 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.829634 14609 raft_consensus.cc:2468] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 0.
I20260709 13:05:29.833212 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.830900 14647 leader_election.cc:304] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:29.834846 14807 raft_consensus.cc:2804] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.835212 14807 raft_consensus.cc:493] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.835373 14650 leader_election.cc:343] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.835597 14807 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.827126 14827 leader_election.cc:290] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.842710 14802 tablet_bootstrap.cc:654] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.843458 14807 raft_consensus.cc:515] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.846410 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.847162 14609 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.847465 14801 tablet_bootstrap.cc:492] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.847952 14801 ts_tablet_manager.cc:1403] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.061s	user 0.030s	sys 0.025s
I20260709 13:05:29.850569 14801 raft_consensus.cc:359] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.851229 14801 raft_consensus.cc:385] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.851506 14801 raft_consensus.cc:740] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.852149 14801 consensus_queue.cc:260] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.853971 14801 ts_tablet_manager.cc:1434] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:29.860441 14609 raft_consensus.cc:2468] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 1.
I20260709 13:05:29.861513 14801 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Bootstrap starting.
I20260709 13:05:29.863430 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:29.862259 14807 leader_election.cc:290] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.863600 14647 leader_election.cc:304] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
W20260709 13:05:29.864904 14650 leader_election.cc:343] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.868978 14801 tablet_bootstrap.cc:654] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:29.872426 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:29.872987 14807 raft_consensus.cc:2804] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.874854 14807 raft_consensus.cc:697] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:29.874684 14802 tablet_bootstrap.cc:492] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.875974 14802 ts_tablet_manager.cc:1403] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.092s	user 0.026s	sys 0.003s
I20260709 13:05:29.875754 14807 consensus_queue.cc:237] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.876881 14801 tablet_bootstrap.cc:492] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: No bootstrap required, opened a new log
I20260709 13:05:29.877280 14801 ts_tablet_manager.cc:1403] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:05:29.878671 14802 raft_consensus.cc:359] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.879360 14802 raft_consensus.cc:385] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.879616 14802 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.879933 14801 raft_consensus.cc:359] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.880568 14801 raft_consensus.cc:385] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.880347 14802 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.880824 14801 raft_consensus.cc:740] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.881546 14801 consensus_queue.cc:260] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.883502 14801 ts_tablet_manager.cc:1434] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:29.885479 14802 ts_tablet_manager.cc:1434] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:29.890559 14802 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: Bootstrap starting.
I20260709 13:05:29.890436 14503 catalog_manager.cc:5697] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 1 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.897624 14802 tablet_bootstrap.cc:654] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.898238 14807 raft_consensus.cc:493] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.898862 14807 raft_consensus.cc:515] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.901856 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.902655 14609 raft_consensus.cc:2393] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in current term 1: Already voted for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in this term.
I20260709 13:05:29.904067 14807 leader_election.cc:290] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:29.905226 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d26fc0ca314af3bc2b96702c117b77" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:29.906782 14650 leader_election.cc:304] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d; no voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:29.907827 14807 raft_consensus.cc:3060] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.911533 14802 tablet_bootstrap.cc:492] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: No bootstrap required, opened a new log
I20260709 13:05:29.911935 14802 ts_tablet_manager.cc:1403] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.005s
I20260709 13:05:29.914067 14802 raft_consensus.cc:359] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.914556 14802 raft_consensus.cc:385] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.914570 14807 raft_consensus.cc:2749] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.914839 14802 raft_consensus.cc:740] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.915493 14802 consensus_queue.cc:260] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.917148 14802 ts_tablet_manager.cc:1434] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:29.924110 14807 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.942955 14757 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.952199 14837 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.953341 14807 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.961158 14837 raft_consensus.cc:493] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.961578 14837 raft_consensus.cc:515] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.963898 14837 leader_election.cc:290] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:29.965456 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:29.966106 14684 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.966675 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:29.967314 14724 leader_election.cc:304] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.968586 14832 raft_consensus.cc:2804] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.969064 14832 raft_consensus.cc:493] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.969473 14832 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.972180 14609 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 0.
I20260709 13:05:29.976572 14832 raft_consensus.cc:515] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.980403 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:29.980967 14609 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.981717 14837 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:29.987598 14609 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:29.989351 14721 leader_election.cc:304] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:29.990204 14837 raft_consensus.cc:2804] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.990670 14837 raft_consensus.cc:697] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:29.991456 14837 consensus_queue.cc:237] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:29.996394 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:29.997098 14683 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.006407 14835 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.016116 14683 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 1.
I20260709 13:05:30.017694 14832 leader_election.cc:290] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:30.019906 14837 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.032850 14503 catalog_manager.cc:5697] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 1 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.035033 14683 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.046288 14807 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.047821 14832 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.066782 14827 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.074532 14806 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.080087 14832 raft_consensus.cc:493] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.080577 14832 raft_consensus.cc:515] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.082635 14832 leader_election.cc:290] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:30.083300 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1653b0c46de495f8e6503602465a7e1" is_pre_election: true
I20260709 13:05:30.084118 14607 raft_consensus.cc:2393] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in current term 1: Already voted for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in this term.
I20260709 13:05:30.084174 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:30.085984 14724 leader_election.cc:304] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:30.090051 14832 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.098121 14832 raft_consensus.cc:2749] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.160425 14811 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.161000 14811 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.163213 14811 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.163995 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" is_pre_election: true
I20260709 13:05:30.164130 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" is_pre_election: true
I20260709 13:05:30.164837 14683 raft_consensus.cc:2393] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1653b0c46de495f8e6503602465a7e1 in current term 1: Already voted for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in this term.
I20260709 13:05:30.165737 14575 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1; no voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:30.166407 14811 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.172963 14811 raft_consensus.cc:2749] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.203568 14832 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.219393 14869 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.233022 14683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:41334
I20260709 13:05:30.233723 14683 raft_consensus.cc:606] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:30.248060 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:30.248560 14757 raft_consensus.cc:606] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:30.253626 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:30.254132 14757 raft_consensus.cc:606] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:30.258905 14683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:41334
I20260709 13:05:30.259394 14683 raft_consensus.cc:606] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:30.264429 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:30.264953 14757 raft_consensus.cc:606] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:30.271693 14869 consensus_queue.cc:1048] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.272936 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:30.273486 14757 raft_consensus.cc:606] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:30.279603 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:30.283746 14757 raft_consensus.cc:606] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:30.285405 14837 consensus_queue.cc:1048] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.352964 14827 raft_consensus.cc:993] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.353443 14807 raft_consensus.cc:1081] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.355057 14608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58074
I20260709 13:05:30.355648 14608 raft_consensus.cc:493] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.356029 14608 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.362394 14608 raft_consensus.cc:515] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.364445 14608 leader_election.cc:290] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.365284 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:30.365526 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.366016 14683 raft_consensus.cc:3055] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.366123 14757 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.366426 14683 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:30.367265 14683 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.368638 14683 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.373219 14757 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.373651 14683 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.374388 14575 leader_election.cc:304] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:30.375178 14811 raft_consensus.cc:2804] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.376647 14811 raft_consensus.cc:697] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:30.377388 14811 consensus_queue.cc:237] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.383971 14506 catalog_manager.cc:5697] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 1 to 2, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.412045 14807 consensus_queue.cc:1048] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.424062 14827 consensus_queue.cc:1048] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.473618 14837 consensus_queue.cc:1048] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.484328 14869 consensus_queue.cc:1048] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.494599 14835 raft_consensus.cc:993] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.495048 14835 raft_consensus.cc:1081] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.496927 14684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:05:30.497531 14684 raft_consensus.cc:493] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.497887 14684 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.504441 14684 raft_consensus.cc:515] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.510499 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:30.511070 14608 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.516263 14608 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.517198 14684 leader_election.cc:290] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.517339 14647 leader_election.cc:304] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:30.518213 14827 raft_consensus.cc:2804] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.518282 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc097023892e42b5b8aa92dc86fd2e7a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.519050 14827 raft_consensus.cc:697] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:30.519369 14757 raft_consensus.cc:3055] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.519707 14757 raft_consensus.cc:740] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:30.519953 14827 consensus_queue.cc:237] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.520510 14757 consensus_queue.cc:260] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.521698 14757 raft_consensus.cc:3060] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.528220 14504 catalog_manager.cc:5697] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 1 to 2, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 2 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.529493 14757 raft_consensus.cc:2468] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.559783 14869 raft_consensus.cc:993] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.560272 14837 raft_consensus.cc:1081] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.561738 14608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58084
I20260709 13:05:30.562327 14608 raft_consensus.cc:493] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.562690 14608 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.569216 14608 raft_consensus.cc:515] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.571344 14608 leader_election.cc:290] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.572175 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:30.572454 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.572846 14684 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.573045 14757 raft_consensus.cc:3055] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.573441 14757 raft_consensus.cc:740] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:30.574230 14757 consensus_queue.cc:260] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.575419 14757 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.578693 14684 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.580114 14575 leader_election.cc:304] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:30.580871 14869 raft_consensus.cc:993] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.580922 14811 raft_consensus.cc:2804] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.581413 14869 raft_consensus.cc:1081] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.581442 14811 raft_consensus.cc:697] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:30.581943 14757 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.582418 14811 consensus_queue.cc:237] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.584272 14608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58084
I20260709 13:05:30.584878 14608 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.585924 14608 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.590317 14504 catalog_manager.cc:5697] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 1 to 2, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.592113 14608 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.594110 14608 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.594821 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:30.595383 14684 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.596005 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.596613 14757 raft_consensus.cc:3055] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.597055 14757 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:30.597960 14757 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.599220 14757 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.604089 14684 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.605552 14807 raft_consensus.cc:993] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.606058 14807 raft_consensus.cc:1081] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:30.606004 14575 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:30.607071 14811 raft_consensus.cc:2804] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.607553 14811 raft_consensus.cc:697] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:30.607939 14608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58074
I20260709 13:05:30.608520 14608 raft_consensus.cc:493] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.608356 14811 consensus_queue.cc:237] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.608888 14608 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.609174 14757 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.615386 14608 raft_consensus.cc:515] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.617496 14608 leader_election.cc:290] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.618536 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:30.619146 14684 raft_consensus.cc:3055] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.619310 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.619546 14684 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:30.620003 14757 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.620484 14684 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.621695 14684 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.622172 14504 catalog_manager.cc:5697] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 1 to 2, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.627723 14835 raft_consensus.cc:993] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.628176 14684 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.628192 14837 raft_consensus.cc:1081] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.629617 14575 leader_election.cc:304] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:30.630196 14684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:05:30.630487 14811 raft_consensus.cc:2804] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.630885 14684 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.631142 14811 raft_consensus.cc:697] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:30.631357 14684 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.632043 14811 consensus_queue.cc:237] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.636418 14757 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 2.
I20260709 13:05:30.638371 14684 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.641891 14684 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.642081 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:30.642668 14608 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.645221 14835 raft_consensus.cc:993] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.645666 14835 raft_consensus.cc:1081] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:30.647567 14683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:05:30.647140 14504 catalog_manager.cc:5697] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 1 to 2, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.648123 14683 raft_consensus.cc:493] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.648520 14683 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.649274 14608 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.645545 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.650326 14647 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:30.650607 14757 raft_consensus.cc:3055] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.651108 14807 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.651077 14757 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:30.651669 14807 raft_consensus.cc:697] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:30.652164 14757 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.652477 14807 consensus_queue.cc:237] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.653551 14757 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.662318 14504 catalog_manager.cc:5697] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 1 to 2, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 2 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.663249 14757 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.663268 14683 raft_consensus.cc:515] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.666338 14683 leader_election.cc:290] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:30.668064 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:30.668710 14757 raft_consensus.cc:3055] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.668994 14757 raft_consensus.cc:740] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:30.669703 14757 consensus_queue.cc:260] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.670473 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:30.670929 14757 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.670994 14608 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.676251 14757 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.677287 14650 leader_election.cc:304] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:30.677938 14807 raft_consensus.cc:2804] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.678428 14807 raft_consensus.cc:697] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:30.678894 14608 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 2.
I20260709 13:05:30.679121 14807 consensus_queue.cc:237] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:30.688867 14504 catalog_manager.cc:5697] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 1 to 2, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 2 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.774892 14684 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.776142 14811 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.784614 14757 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.786161 14811 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.946252 14757 raft_consensus.cc:1275] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.947523 14807 consensus_queue.cc:1048] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.954769 14608 raft_consensus.cc:1275] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.956519 14807 consensus_queue.cc:1048] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.966617 14757 raft_consensus.cc:1275] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.968132 14811 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.980376 14684 raft_consensus.cc:1275] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.982728 14885 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.041749 14757 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.043030 14885 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.050235 14684 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.052716 14811 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.059566 14757 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.060724 14807 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.067700 14608 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.069294 14827 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.081089 14757 raft_consensus.cc:1275] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.082472 14827 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.090766 14608 raft_consensus.cc:1275] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.092434 14807 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.201478 14757 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.202739 14811 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.211226 14684 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.214529 14891 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:33.316202 14474 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:33.316974 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.332299 14683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:33.332764 14683 raft_consensus.cc:606] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Received request to transfer leadership to TS e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:33.342556 14608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
mode: GRACEFUL
new_leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:33098
I20260709 13:05:33.343063 14608 raft_consensus.cc:606] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Received request to transfer leadership to TS e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:33.344184 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:33.344609 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.597173 14811 raft_consensus.cc:993] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: : Instructing follower e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:33.597695 14898 raft_consensus.cc:1081] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Signalling peer e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:33.599344 14758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:50962
I20260709 13:05:33.599866 14758 raft_consensus.cc:493] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.600281 14758 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.605130 14758 raft_consensus.cc:515] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.606853 14758 leader_election.cc:290] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 3 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:33.607693 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:33.607892 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:33.608180 14608 raft_consensus.cc:3055] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.608448 14683 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.608485 14608 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:33.609241 14608 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.610198 14608 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.613875 14683 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 3.
I20260709 13:05:33.615006 14724 leader_election.cc:304] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:33.615533 14608 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 3.
I20260709 13:05:33.615681 14835 raft_consensus.cc:2804] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.617065 14835 raft_consensus.cc:697] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:33.617820 14835 consensus_queue.cc:237] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.626251 14506 catalog_manager.cc:5697] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 2 to 3, leader changed from d1653b0c46de495f8e6503602465a7e1 (127.14.34.129) to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 3 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.639228 14905 raft_consensus.cc:993] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:33.639673 14831 raft_consensus.cc:1081] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Signalling peer e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:33.641182 14757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:50954
I20260709 13:05:33.641712 14757 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.642092 14757 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.645795 14757 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.647135 14757 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 3 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:33.647990 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:33.648180 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:33.648530 14608 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.648674 14683 raft_consensus.cc:3055] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.649008 14683 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:33.649787 14683 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.650951 14683 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.654502 14608 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 3.
I20260709 13:05:33.655663 14721 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:33.656386 14835 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.656781 14835 raft_consensus.cc:697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:33.656867 14683 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 3.
I20260709 13:05:33.657581 14835 consensus_queue.cc:237] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:33.663968 14506 catalog_manager.cc:5697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 2 to 3, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 3 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.010737 14683 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.011796 14835 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.020757 14608 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.022496 14909 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.084192 14608 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.085284 14909 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.093130 14683 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.094990 14899 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.345332 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.363248 14608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:33114
I20260709 13:05:34.363749 14608 raft_consensus.cc:606] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:34.368553 14608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:33114
I20260709 13:05:34.369057 14608 raft_consensus.cc:606] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:34.373769 14608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:33114
I20260709 13:05:34.374305 14608 raft_consensus.cc:606] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:34.378988 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:34.379473 14757 raft_consensus.cc:606] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:34.384239 14757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
mode: GRACEFUL
new_leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:05:34.384706 14757 raft_consensus.cc:606] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Received request to transfer leadership to TS 02c98a9fd5ec4d25ace8ecc1718c9c9d
I20260709 13:05:34.460585 14898 raft_consensus.cc:993] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.461041 14898 raft_consensus.cc:1081] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.462586 14683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41326
I20260709 13:05:34.463160 14683 raft_consensus.cc:493] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.463482 14683 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.469179 14683 raft_consensus.cc:515] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.471031 14683 leader_election.cc:290] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:34.471764 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:34.472426 14608 raft_consensus.cc:3055] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.472738 14608 raft_consensus.cc:740] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:34.472739 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa231ad4a4b7479ca9618b09e5517aa5" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:34.473361 14757 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.473516 14608 consensus_queue.cc:260] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.474638 14608 raft_consensus.cc:3060] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.479240 14757 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.480163 14608 raft_consensus.cc:2468] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.480525 14650 leader_election.cc:304] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:34.481374 14831 raft_consensus.cc:2804] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.482422 14831 raft_consensus.cc:697] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:34.483320 14831 consensus_queue.cc:237] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.490842 14504 catalog_manager.cc:5697] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 2 to 3, leader changed from d1653b0c46de495f8e6503602465a7e1 (127.14.34.129) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 3 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.611711 14909 raft_consensus.cc:993] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.612097 14899 raft_consensus.cc:1081] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.613502 14683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edfddabb33704b9daba012559a567d1d"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:05:34.613966 14683 raft_consensus.cc:493] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.614358 14683 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.618829 14683 raft_consensus.cc:515] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.620528 14683 leader_election.cc:290] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 4 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:34.621279 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:34.621515 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfddabb33704b9daba012559a567d1d" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:34.621860 14608 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.621974 14757 raft_consensus.cc:3055] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:34.622385 14757 raft_consensus.cc:740] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:34.623153 14757 consensus_queue.cc:260] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.624356 14757 raft_consensus.cc:3060] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.626799 14608 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 4.
I20260709 13:05:34.627801 14647 leader_election.cc:304] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:34.628455 14831 raft_consensus.cc:2804] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:34.628674 14757 raft_consensus.cc:2468] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 4.
I20260709 13:05:34.628826 14831 raft_consensus.cc:697] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:34.629575 14831 consensus_queue.cc:237] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.634713 14504 catalog_manager.cc:5697] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 3 to 4, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 4 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.659327 14917 raft_consensus.cc:993] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.659839 14898 raft_consensus.cc:1081] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.661259 14683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41326
I20260709 13:05:34.661734 14683 raft_consensus.cc:493] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.662056 14683 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.666992 14909 raft_consensus.cc:993] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.667450 14909 raft_consensus.cc:1081] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.667775 14683 raft_consensus.cc:515] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.669303 14684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:05:34.669847 14684 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.670233 14684 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.670495 14683 leader_election.cc:290] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:34.671074 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:34.671095 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:34.671720 14757 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.671653 14609 raft_consensus.cc:3055] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.672147 14609 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:34.672937 14609 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.674065 14609 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.676059 14757 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.676782 14684 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.677217 14650 leader_election.cc:304] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:34.678009 14831 raft_consensus.cc:2804] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.678489 14831 raft_consensus.cc:697] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:34.679262 14831 consensus_queue.cc:237] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.680143 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:34.680411 14609 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.680670 14608 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.680480 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:34.681223 14757 raft_consensus.cc:3055] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:34.681577 14757 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:34.682093 14684 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 4 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:34.682698 14757 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.683856 14757 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.687738 14608 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 4.
I20260709 13:05:34.688776 14647 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, d1653b0c46de495f8e6503602465a7e1; no voters: 
I20260709 13:05:34.689631 14831 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:34.690099 14831 raft_consensus.cc:697] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:34.689415 14504 catalog_manager.cc:5697] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 2 to 3, leader changed from d1653b0c46de495f8e6503602465a7e1 (127.14.34.129) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 3 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.691144 14831 consensus_queue.cc:237] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.691619 14757 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 4.
I20260709 13:05:34.711400 14504 catalog_manager.cc:5697] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 3 to 4, leader changed from e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 4 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.755203 14917 raft_consensus.cc:993] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: : Instructing follower 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.755632 14898 raft_consensus.cc:1081] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Signalling peer 02c98a9fd5ec4d25ace8ecc1718c9c9d to start an election
I20260709 13:05:34.756984 14684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
 from {username='slave'} at 127.0.0.1:41326
I20260709 13:05:34.757524 14684 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.757834 14684 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.762497 14684 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.764067 14684 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:34.765023 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:34.765228 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:34.765563 14608 raft_consensus.cc:3055] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.765714 14757 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.765846 14608 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:34.766619 14608 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.767422 14608 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.769784 14757 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.770733 14650 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02c98a9fd5ec4d25ace8ecc1718c9c9d, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:34.771278 14608 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02c98a9fd5ec4d25ace8ecc1718c9c9d in term 3.
I20260709 13:05:34.771381 14831 raft_consensus.cc:2804] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.771827 14831 raft_consensus.cc:697] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Becoming Leader. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:34.772562 14831 consensus_queue.cc:237] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:34.780220 14504 catalog_manager.cc:5697] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d reported cstate change: term changed from 2 to 3, leader changed from d1653b0c46de495f8e6503602465a7e1 (127.14.34.129) to 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130). New cstate: current_term: 3 leader_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.944087 14608 raft_consensus.cc:1275] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.945426 14831 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.954075 14757 raft_consensus.cc:1275] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.956175 14918 consensus_queue.cc:1048] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.011163 14757 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.012641 14831 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.022246 14608 raft_consensus.cc:1275] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.023767 14831 consensus_queue.cc:1048] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.094544 14608 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.095749 14930 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.100896 14757 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.102610 14831 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:35.132827 14608 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.133973 14831 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.142696 14757 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.144186 14831 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.331158 14608 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.332355 14831 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.340890 14757 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Refusing update from remote peer 02c98a9fd5ec4d25ace8ecc1718c9c9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.342864 14831 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.397269 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.406396 14684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:37.407351 14684 raft_consensus.cc:606] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Received request to transfer leadership to TS e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:37.409864 14684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89231c84cc794134b8507202148392de"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:37.410468 14684 raft_consensus.cc:606] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Received request to transfer leadership to TS e88d2f5d42a44c7fa9cdcbac3a54b39b
I20260709 13:05:37.412751 14684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:37.413194 14684 raft_consensus.cc:606] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:37.415453 14684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:37.415894 14684 raft_consensus.cc:606] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:37.417946 14684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e"
dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
mode: GRACEFUL
new_leader_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:36768
I20260709 13:05:37.418404 14684 raft_consensus.cc:606] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Received request to transfer leadership to TS d1653b0c46de495f8e6503602465a7e1
I20260709 13:05:37.419374 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:37.419813 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.483026 14930 raft_consensus.cc:993] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.483613 14940 raft_consensus.cc:1081] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.485071 14609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58074
I20260709 13:05:37.485585 14609 raft_consensus.cc:493] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.485913 14609 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.491067 14609 raft_consensus.cc:515] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.493131 14609 leader_election.cc:290] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 4 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:37.494553 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:37.494623 14758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acb8d77bf18546a2a35d2caeffb8dc5a" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:37.495232 14684 raft_consensus.cc:3055] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.495327 14758 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.495513 14684 raft_consensus.cc:740] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:37.497207 14684 consensus_queue.cc:260] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.498664 14684 raft_consensus.cc:3060] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.503648 14758 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 4.
I20260709 13:05:37.505167 14575 leader_election.cc:304] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:37.505653 14684 raft_consensus.cc:2468] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 4.
I20260709 13:05:37.506902 14941 raft_consensus.cc:2804] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:37.507771 14941 raft_consensus.cc:697] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 4 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:37.508456 14941 consensus_queue.cc:237] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.515924 14504 catalog_manager.cc:5697] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 3 to 4, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.546898 14930 raft_consensus.cc:993] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:37.547340 14940 raft_consensus.cc:1081] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Signalling peer e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:37.548856 14758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89231c84cc794134b8507202148392de"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:50954
I20260709 13:05:37.549322 14758 raft_consensus.cc:493] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.549592 14758 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.554491 14758 raft_consensus.cc:515] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.556259 14758 leader_election.cc:290] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 2 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:37.557196 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:37.557339 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89231c84cc794134b8507202148392de" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:37.557794 14609 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.557921 14684 raft_consensus.cc:3055] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.558338 14684 raft_consensus.cc:740] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:37.559012 14684 consensus_queue.cc:260] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.559887 14684 raft_consensus.cc:3060] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.562470 14609 raft_consensus.cc:2468] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 2.
I20260709 13:05:37.563648 14721 leader_election.cc:304] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:37.564139 14684 raft_consensus.cc:2468] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 2.
I20260709 13:05:37.564406 14909 raft_consensus.cc:2804] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.565964 14909 raft_consensus.cc:697] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:37.566905 14909 consensus_queue.cc:237] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.574324 14504 catalog_manager.cc:5697] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 1 to 2, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 2 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.591356 14930 raft_consensus.cc:993] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.591774 14940 raft_consensus.cc:1081] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.593045 14609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58074
I20260709 13:05:37.593459 14609 raft_consensus.cc:493] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.593724 14609 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.598104 14609 raft_consensus.cc:515] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.599660 14609 leader_election.cc:290] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 3 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:37.600395 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:37.600698 14758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37746dbb196456cb2dd07d6f5d1821e" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:37.600903 14684 raft_consensus.cc:3055] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.601215 14758 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.601245 14684 raft_consensus.cc:740] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:37.602089 14684 consensus_queue.cc:260] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.603022 14684 raft_consensus.cc:3060] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.605994 14758 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 3.
I20260709 13:05:37.606912 14684 raft_consensus.cc:2468] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 3.
I20260709 13:05:37.607172 14575 leader_election.cc:304] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:37.607903 14941 raft_consensus.cc:2804] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.608337 14941 raft_consensus.cc:697] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 3 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:37.608966 14941 consensus_queue.cc:237] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.615624 14504 catalog_manager.cc:5697] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 2 to 3, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.657652 14930 raft_consensus.cc:993] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.658133 14940 raft_consensus.cc:1081] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Signalling peer d1653b0c46de495f8e6503602465a7e1 to start an election
I20260709 13:05:37.659704 14609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5"
dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
 from {username='slave'} at 127.0.0.1:58074
I20260709 13:05:37.660100 14609 raft_consensus.cc:493] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.660324 14609 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.664258 14609 raft_consensus.cc:515] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.665858 14609 leader_election.cc:290] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 4 election: Requested vote from peers 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981), e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131:39121)
I20260709 13:05:37.666687 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:37.666831 14758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b87101efa54e698e9b71249aa3a8c5" candidate_uuid: "d1653b0c46de495f8e6503602465a7e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
I20260709 13:05:37.667248 14684 raft_consensus.cc:3055] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.667299 14758 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.667650 14684 raft_consensus.cc:740] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:37.668437 14684 consensus_queue.cc:260] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.669512 14684 raft_consensus.cc:3060] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.674119 14758 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 4.
I20260709 13:05:37.675338 14575 leader_election.cc:304] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:37.675457 14684 raft_consensus.cc:2468] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1653b0c46de495f8e6503602465a7e1 in term 4.
I20260709 13:05:37.676036 14941 raft_consensus.cc:2804] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:37.676509 14941 raft_consensus.cc:697] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 4 LEADER]: Becoming Leader. State: Replica: d1653b0c46de495f8e6503602465a7e1, State: Running, Role: LEADER
I20260709 13:05:37.677286 14941 consensus_queue.cc:237] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.684322 14504 catalog_manager.cc:5697] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 reported cstate change: term changed from 3 to 4, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to d1653b0c46de495f8e6503602465a7e1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "d1653b0c46de495f8e6503602465a7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.825966 14930 raft_consensus.cc:993] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: : Instructing follower e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:37.826450 14940 raft_consensus.cc:1081] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Signalling peer e88d2f5d42a44c7fa9cdcbac3a54b39b to start an election
I20260709 13:05:37.827841 14758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4"
dest_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b"
 from {username='slave'} at 127.0.0.1:50954
I20260709 13:05:37.828322 14758 raft_consensus.cc:493] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.828627 14758 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.833002 14758 raft_consensus.cc:515] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.834578 14758 leader_election.cc:290] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 5 election: Requested vote from peers d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777), 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130:40981)
I20260709 13:05:37.835520 14684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d"
I20260709 13:05:37.835482 14609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a437693ac34fee870e6658038ac1c4" candidate_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d1653b0c46de495f8e6503602465a7e1"
I20260709 13:05:37.836177 14684 raft_consensus.cc:3055] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:37.836313 14609 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.836537 14684 raft_consensus.cc:740] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 02c98a9fd5ec4d25ace8ecc1718c9c9d, State: Running, Role: LEADER
I20260709 13:05:37.837276 14684 consensus_queue.cc:260] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.838302 14684 raft_consensus.cc:3060] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.841270 14609 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 5.
I20260709 13:05:37.842195 14721 leader_election.cc:304] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1653b0c46de495f8e6503602465a7e1, e88d2f5d42a44c7fa9cdcbac3a54b39b; no voters: 
I20260709 13:05:37.842569 14684 raft_consensus.cc:2468] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e88d2f5d42a44c7fa9cdcbac3a54b39b in term 5.
I20260709 13:05:37.843065 14909 raft_consensus.cc:2804] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.843601 14909 raft_consensus.cc:697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 5 LEADER]: Becoming Leader. State: Replica: e88d2f5d42a44c7fa9cdcbac3a54b39b, State: Running, Role: LEADER
I20260709 13:05:37.844360 14909 consensus_queue.cc:237] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } }
I20260709 13:05:37.851420 14504 catalog_manager.cc:5697] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b reported cstate change: term changed from 4 to 5, leader changed from 02c98a9fd5ec4d25ace8ecc1718c9c9d (127.14.34.130) to e88d2f5d42a44c7fa9cdcbac3a54b39b (127.14.34.131). New cstate: current_term: 5 leader_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.011277 14609 raft_consensus.cc:1275] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.012485 14909 consensus_queue.cc:1048] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.022800 14684 raft_consensus.cc:1275] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.024613 14948 consensus_queue.cc:1048] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.033665 14684 raft_consensus.cc:1275] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.034792 14941 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.043982 14758 raft_consensus.cc:1275] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:38.045756 14941 consensus_queue.cc:1048] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.094537 14684 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.095781 14942 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.105252 14758 raft_consensus.cc:1275] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.107363 14962 consensus_queue.cc:1048] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:38.107743 14758 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.109465 14962 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e88d2f5d42a44c7fa9cdcbac3a54b39b" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.119259 14684 raft_consensus.cc:1275] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Refusing update from remote peer d1653b0c46de495f8e6503602465a7e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.121268 14941 consensus_queue.cc:1048] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.311755 14609 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 5 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.313095 14948 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1653b0c46de495f8e6503602465a7e1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 41777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.322844 14684 raft_consensus.cc:1275] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 5 FOLLOWER]: Refusing update from remote peer e88d2f5d42a44c7fa9cdcbac3a54b39b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.324333 14948 consensus_queue.cc:1048] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02c98a9fd5ec4d25ace8ecc1718c9c9d" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 40981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.420615 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.426582 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
I20260709 13:05:38.457267 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.458076 14474 tablet_replica.cc:333] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.458797 14474 raft_consensus.cc:2243] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.459332 14474 raft_consensus.cc:2272] T 02a437693ac34fee870e6658038ac1c4 P d1653b0c46de495f8e6503602465a7e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.462805 14474 tablet_replica.cc:333] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.463344 14474 raft_consensus.cc:2243] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.463781 14474 raft_consensus.cc:2272] T 89231c84cc794134b8507202148392de P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.465934 14474 tablet_replica.cc:333] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.466581 14474 raft_consensus.cc:2243] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.467038 14474 raft_consensus.cc:2272] T fc097023892e42b5b8aa92dc86fd2e7a P d1653b0c46de495f8e6503602465a7e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.468613 14474 tablet_replica.cc:333] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.469100 14474 raft_consensus.cc:2243] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.469802 14474 raft_consensus.cc:2272] T e37746dbb196456cb2dd07d6f5d1821e P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.471757 14474 tablet_replica.cc:333] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.472239 14474 raft_consensus.cc:2243] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.472604 14474 raft_consensus.cc:2272] T 13d26fc0ca314af3bc2b96702c117b77 P d1653b0c46de495f8e6503602465a7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.474262 14474 tablet_replica.cc:333] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.474723 14474 raft_consensus.cc:2243] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.475131 14474 raft_consensus.cc:2272] T aa231ad4a4b7479ca9618b09e5517aa5 P d1653b0c46de495f8e6503602465a7e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.476794 14474 tablet_replica.cc:333] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.477254 14474 raft_consensus.cc:2243] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.477658 14474 raft_consensus.cc:2272] T edfddabb33704b9daba012559a567d1d P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.479276 14474 tablet_replica.cc:333] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.479725 14474 raft_consensus.cc:2243] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.480433 14474 raft_consensus.cc:2272] T 97b87101efa54e698e9b71249aa3a8c5 P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.482302 14474 tablet_replica.cc:333] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1: stopping tablet replica
I20260709 13:05:38.482738 14474 raft_consensus.cc:2243] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.483423 14474 raft_consensus.cc:2272] T acb8d77bf18546a2a35d2caeffb8dc5a P d1653b0c46de495f8e6503602465a7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.581871 14721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:41777: connect: Connection refused (error 111)
I20260709 13:05:38.583032 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
W20260709 13:05:38.585745 14721 consensus_peers.cc:597] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b -> Peer d1653b0c46de495f8e6503602465a7e1 (127.14.34.129:41777): Couldn't send request to peer d1653b0c46de495f8e6503602465a7e1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:41777: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.601560 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
I20260709 13:05:38.627566 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.628439 14474 tablet_replica.cc:333] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.629102 14474 raft_consensus.cc:2243] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.629586 14474 raft_consensus.cc:2272] T 89231c84cc794134b8507202148392de P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.632545 14474 tablet_replica.cc:333] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.633140 14474 raft_consensus.cc:2243] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.633594 14474 raft_consensus.cc:2272] T 02a437693ac34fee870e6658038ac1c4 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.636493 14474 tablet_replica.cc:333] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.637061 14474 raft_consensus.cc:2243] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.637512 14474 raft_consensus.cc:2272] T acb8d77bf18546a2a35d2caeffb8dc5a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.639724 14474 tablet_replica.cc:333] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.640270 14474 raft_consensus.cc:2243] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.640713 14474 raft_consensus.cc:2272] T 97b87101efa54e698e9b71249aa3a8c5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.643036 14474 tablet_replica.cc:333] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.643558 14474 raft_consensus.cc:2243] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.644006 14474 raft_consensus.cc:2272] T 13d26fc0ca314af3bc2b96702c117b77 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.645749 14474 tablet_replica.cc:333] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.646312 14474 raft_consensus.cc:2243] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.647205 14474 raft_consensus.cc:2272] T aa231ad4a4b7479ca9618b09e5517aa5 P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.648939 14474 tablet_replica.cc:333] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.649479 14474 raft_consensus.cc:2243] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.650321 14474 raft_consensus.cc:2272] T edfddabb33704b9daba012559a567d1d P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.652027 14474 tablet_replica.cc:333] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.652551 14474 raft_consensus.cc:2243] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.652999 14474 raft_consensus.cc:2272] T e37746dbb196456cb2dd07d6f5d1821e P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.655148 14474 tablet_replica.cc:333] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d: stopping tablet replica
I20260709 13:05:38.655591 14474 raft_consensus.cc:2243] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.656308 14474 raft_consensus.cc:2272] T fc097023892e42b5b8aa92dc86fd2e7a P 02c98a9fd5ec4d25ace8ecc1718c9c9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.683503 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
I20260709 13:05:38.700758 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:05:38.726092 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.726809 14474 tablet_replica.cc:333] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.727442 14474 raft_consensus.cc:2243] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.728140 14474 raft_consensus.cc:2272] T 89231c84cc794134b8507202148392de P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.730073 14474 tablet_replica.cc:333] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.730549 14474 raft_consensus.cc:2243] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.730947 14474 raft_consensus.cc:2272] T fc097023892e42b5b8aa92dc86fd2e7a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.732939 14474 tablet_replica.cc:333] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.733549 14474 raft_consensus.cc:2243] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.734069 14474 raft_consensus.cc:2272] T e37746dbb196456cb2dd07d6f5d1821e P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.735978 14474 tablet_replica.cc:333] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.736464 14474 raft_consensus.cc:2243] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.737156 14474 raft_consensus.cc:2272] T 13d26fc0ca314af3bc2b96702c117b77 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.738826 14474 tablet_replica.cc:333] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.739300 14474 raft_consensus.cc:2243] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.739756 14474 raft_consensus.cc:2272] T aa231ad4a4b7479ca9618b09e5517aa5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.741446 14474 tablet_replica.cc:333] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.741909 14474 raft_consensus.cc:2243] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.742364 14474 raft_consensus.cc:2272] T edfddabb33704b9daba012559a567d1d P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.743865 14474 tablet_replica.cc:333] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.744338 14474 raft_consensus.cc:2243] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.744726 14474 raft_consensus.cc:2272] T acb8d77bf18546a2a35d2caeffb8dc5a P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.746878 14474 tablet_replica.cc:333] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.747396 14474 raft_consensus.cc:2243] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.747822 14474 raft_consensus.cc:2272] T 97b87101efa54e698e9b71249aa3a8c5 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.749639 14474 tablet_replica.cc:333] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b: stopping tablet replica
I20260709 13:05:38.750183 14474 raft_consensus.cc:2243] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.750900 14474 raft_consensus.cc:2272] T 02a437693ac34fee870e6658038ac1c4 P e88d2f5d42a44c7fa9cdcbac3a54b39b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.778116 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:05:38.793673 14474 master.cc:562] Master@127.14.34.190:33701 shutting down...
I20260709 13:05:38.991890 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.992486 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.992837 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P c13c230b8d3a449c879ef5ea7985ec6c: stopping tablet replica
I20260709 13:05:39.012471 14474 master.cc:584] Master@127.14.34.190:33701 shutdown complete.
02c98a9fd5ec4d25ace8ecc1718c9c9d  4
d1653b0c46de495f8e6503602465a7e1  4
e88d2f5d42a44c7fa9cdcbac3a54b39b  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12741 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:39.057264 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:37231
I20260709 13:05:39.058621 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.064512 14971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.065394 14972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.067689 14974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.067850 14474 server_base.cc:1061] running on GCE node
I20260709 13:05:39.068853 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.069070 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.069234 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602339069216 us; error 0 us; skew 500 ppm
I20260709 13:05:39.069753 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.072799 14474 webserver.cc:533] Webserver started at http://127.14.34.190:34573/ using document root <none> and password file <none>
I20260709 13:05:39.073396 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.073606 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.073899 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.075148 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "101c1e7fb7554c70827cffba38314bb4"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.079743 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:39.083305 14979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.084127 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:39.084453 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "101c1e7fb7554c70827cffba38314bb4"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.084782 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.101648 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.102983 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.142153 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:37231
I20260709 13:05:39.142249 15030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:37231 every 8 connection(s)
I20260709 13:05:39.147421 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.156873 15031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4: Bootstrap starting.
I20260709 13:05:39.161834 15031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.166234 15031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4: No bootstrap required, opened a new log
I20260709 13:05:39.168306 15031 raft_consensus.cc:359] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER }
I20260709 13:05:39.168699 15031 raft_consensus.cc:385] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.168933 15031 raft_consensus.cc:740] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101c1e7fb7554c70827cffba38314bb4, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.169505 15031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER }
I20260709 13:05:39.169943 15031 raft_consensus.cc:399] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:39.170184 15031 raft_consensus.cc:493] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:39.170465 15031 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.174319 15031 raft_consensus.cc:515] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER }
I20260709 13:05:39.174834 15031 leader_election.cc:304] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101c1e7fb7554c70827cffba38314bb4; no voters: 
I20260709 13:05:39.175987 15031 leader_election.cc:290] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:39.176425 15034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.177757 15034 raft_consensus.cc:697] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 1 LEADER]: Becoming Leader. State: Replica: 101c1e7fb7554c70827cffba38314bb4, State: Running, Role: LEADER
I20260709 13:05:39.178462 15034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER }
I20260709 13:05:39.179126 15031 sys_catalog.cc:565] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:39.183679 15036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101c1e7fb7554c70827cffba38314bb4. Latest consensus state: current_term: 1 leader_uuid: "101c1e7fb7554c70827cffba38314bb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER } }
I20260709 13:05:39.184386 15036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.184894 15035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101c1e7fb7554c70827cffba38314bb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101c1e7fb7554c70827cffba38314bb4" member_type: VOTER } }
I20260709 13:05:39.185400 15035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:39.186393 15042 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:39.191701 15042 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:39.196153 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:39.200434 15042 catalog_manager.cc:1383] Generated new cluster ID: 58b83f53e4c84c4988549f38579ca00d
I20260709 13:05:39.200735 15042 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.218538 15042 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.219715 15042 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.232836 15042 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4: Generated new TSK 0
I20260709 13:05:39.233457 15042 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.262766 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.268625 15052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.269881 15053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.271960 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:39.272401 15055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.273296 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.273514 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.273689 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602339273672 us; error 0 us; skew 500 ppm
I20260709 13:05:39.274272 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.276474 14474 webserver.cc:533] Webserver started at http://127.14.34.129:43011/ using document root <none> and password file <none>
I20260709 13:05:39.276979 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.277191 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.277458 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.278533 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.283372 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:39.286502 15060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.287370 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:39.287609 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.287856 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.317058 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.318357 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.319814 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.322094 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.322278 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.322583 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.322746 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.362911 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:42083
I20260709 13:05:39.363008 15122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:42083 every 8 connection(s)
I20260709 13:05:39.367831 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.374847 15127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.376036 15128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.379520 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:39.379442 15130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.380988 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.381356 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.381544 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602339381510 us; error 0 us; skew 500 ppm
I20260709 13:05:39.382261 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.385005 15123 heartbeater.cc:344] Connected to a master server at 127.14.34.190:37231
I20260709 13:05:39.385236 14474 webserver.cc:533] Webserver started at http://127.14.34.130:35747/ using document root <none> and password file <none>
I20260709 13:05:39.385437 15123 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.385831 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.386157 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.386461 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.386387 15123 heartbeater.cc:507] Master 127.14.34.190:37231 requested a full tablet report, sending...
I20260709 13:05:39.387864 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.388748 14996 ts_manager.cc:194] Registered new tserver with Master: 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083)
I20260709 13:05:39.391252 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53310
I20260709 13:05:39.393813 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:39.397032 15135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.397758 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:39.398002 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.398322 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.436853 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.438122 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.439555 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.441834 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.442016 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.442343 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.442503 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.483248 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:33375
I20260709 13:05:39.483358 15197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:33375 every 8 connection(s)
I20260709 13:05:39.487828 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.494853 15201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.496560 15202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.497815 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:39.498414 15205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.499498 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.499754 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.499954 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602339499935 us; error 0 us; skew 500 ppm
I20260709 13:05:39.500597 15198 heartbeater.cc:344] Connected to a master server at 127.14.34.190:37231
I20260709 13:05:39.500682 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.501047 15198 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.501752 15198 heartbeater.cc:507] Master 127.14.34.190:37231 requested a full tablet report, sending...
I20260709 13:05:39.503616 14474 webserver.cc:533] Webserver started at http://127.14.34.131:41651/ using document root <none> and password file <none>
I20260709 13:05:39.503950 14996 ts_manager.cc:194] Registered new tserver with Master: e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:39.504271 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.504522 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.504823 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.505744 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53316
I20260709 13:05:39.506328 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "530d79347599444d95f49dd1e125b273"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.510838 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:39.514179 15209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.514935 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:39.515252 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "530d79347599444d95f49dd1e125b273"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-nr1f"
I20260709 13:05:39.515544 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.553383 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.554693 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.556157 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.558305 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.558537 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.558779 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.558961 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.600322 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:43307
I20260709 13:05:39.600435 15271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:43307 every 8 connection(s)
I20260709 13:05:39.613623 15272 heartbeater.cc:344] Connected to a master server at 127.14.34.190:37231
I20260709 13:05:39.613981 15272 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.614702 15272 heartbeater.cc:507] Master 127.14.34.190:37231 requested a full tablet report, sending...
I20260709 13:05:39.616534 14996 ts_manager.cc:194] Registered new tserver with Master: 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:39.616689 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01329472s
I20260709 13:05:39.618294 14996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53332
I20260709 13:05:39.643014 14996 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.645802 14996 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.732901 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 25027194bd1d4e42bb494900e361ce3f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.734422 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25027194bd1d4e42bb494900e361ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.736213 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 9c62faab0f084998a82c5441c10b121f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.737036 15232 tablet_service.cc:1511] Processing CreateTablet for tablet bae6dbdd4de647f1a81d8a81346c0ae8 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.737699 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c62faab0f084998a82c5441c10b121f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.738013 15088 tablet_service.cc:1511] Processing CreateTablet for tablet 25027194bd1d4e42bb494900e361ce3f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.738471 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6dbdd4de647f1a81d8a81346c0ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.739339 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25027194bd1d4e42bb494900e361ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.739915 15163 tablet_service.cc:1511] Processing CreateTablet for tablet 25027194bd1d4e42bb494900e361ce3f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.741148 15163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25027194bd1d4e42bb494900e361ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.742298 15087 tablet_service.cc:1511] Processing CreateTablet for tablet 6686e74a045e43d8bea9d8a5f9553961 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.743194 15233 tablet_service.cc:1511] Processing CreateTablet for tablet 77884e2df7b34bfeba3d57da6e666731 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.743602 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6686e74a045e43d8bea9d8a5f9553961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.743562 15162 tablet_service.cc:1511] Processing CreateTablet for tablet 6686e74a045e43d8bea9d8a5f9553961 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.744496 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77884e2df7b34bfeba3d57da6e666731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.745050 15162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6686e74a045e43d8bea9d8a5f9553961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.744933 15157 tablet_service.cc:1511] Processing CreateTablet for tablet 9c62faab0f084998a82c5441c10b121f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.746229 15157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c62faab0f084998a82c5441c10b121f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.747224 15160 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7096c46a08402abf10d44ddcb5416d (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.747323 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7096c46a08402abf10d44ddcb5416d (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.748564 15160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7096c46a08402abf10d44ddcb5416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.748660 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7096c46a08402abf10d44ddcb5416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.750785 15159 tablet_service.cc:1511] Processing CreateTablet for tablet 77884e2df7b34bfeba3d57da6e666731 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.751219 15235 tablet_service.cc:1511] Processing CreateTablet for tablet 61e5f7dc40d449518451f9b87d70da5b (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.752103 15159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77884e2df7b34bfeba3d57da6e666731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.752556 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e5f7dc40d449518451f9b87d70da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.755124 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 6686e74a045e43d8bea9d8a5f9553961 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.755214 15158 tablet_service.cc:1511] Processing CreateTablet for tablet bae6dbdd4de647f1a81d8a81346c0ae8 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.756481 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6686e74a045e43d8bea9d8a5f9553961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.756553 15158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6dbdd4de647f1a81d8a81346c0ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.759315 15161 tablet_service.cc:1511] Processing CreateTablet for tablet 61e5f7dc40d449518451f9b87d70da5b (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.760730 15161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e5f7dc40d449518451f9b87d70da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.761054 15085 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7096c46a08402abf10d44ddcb5416d (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.762421 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7096c46a08402abf10d44ddcb5416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.759320 15086 tablet_service.cc:1511] Processing CreateTablet for tablet 61e5f7dc40d449518451f9b87d70da5b (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.763552 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e5f7dc40d449518451f9b87d70da5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.771613 15084 tablet_service.cc:1511] Processing CreateTablet for tablet 77884e2df7b34bfeba3d57da6e666731 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.773016 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77884e2df7b34bfeba3d57da6e666731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.783661 15083 tablet_service.cc:1511] Processing CreateTablet for tablet bae6dbdd4de647f1a81d8a81346c0ae8 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.785081 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6dbdd4de647f1a81d8a81346c0ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.795652 15082 tablet_service.cc:1511] Processing CreateTablet for tablet 9c62faab0f084998a82c5441c10b121f (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.797020 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c62faab0f084998a82c5441c10b121f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.803741 15081 tablet_service.cc:1511] Processing CreateTablet for tablet 6ded7a08fc394d41a27069bfb0f4008c (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.805136 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ded7a08fc394d41a27069bfb0f4008c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.807263 15230 tablet_service.cc:1511] Processing CreateTablet for tablet 6ded7a08fc394d41a27069bfb0f4008c (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.808594 15230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ded7a08fc394d41a27069bfb0f4008c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.814606 15156 tablet_service.cc:1511] Processing CreateTablet for tablet 6ded7a08fc394d41a27069bfb0f4008c (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.816051 15156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ded7a08fc394d41a27069bfb0f4008c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.844400 15080 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc5de6e47441349ec0e7590f210f36 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.845816 15080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc5de6e47441349ec0e7590f210f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.846791 15155 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc5de6e47441349ec0e7590f210f36 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.848410 15155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc5de6e47441349ec0e7590f210f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.851903 15229 tablet_service.cc:1511] Processing CreateTablet for tablet 52bc5de6e47441349ec0e7590f210f36 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.853416 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52bc5de6e47441349ec0e7590f210f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.896623 15287 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:39.903644 15287 tablet_bootstrap.cc:654] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.911674 15287 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:39.912173 15287 ts_tablet_manager.cc:1403] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:05:39.914845 15287 raft_consensus.cc:359] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.915558 15287 raft_consensus.cc:385] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.915845 15287 raft_consensus.cc:740] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.915912 15085 tablet_service.cc:1511] Processing CreateTablet for tablet 5731f83159e24264af48ae4d428f6a75 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.917373 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5731f83159e24264af48ae4d428f6a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.918251 15290 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:39.918886 15287 consensus_queue.cc:260] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.920998 15288 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:39.929960 15287 ts_tablet_manager.cc:1434] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:05:39.931552 15290 tablet_bootstrap.cc:654] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.931304 15160 tablet_service.cc:1511] Processing CreateTablet for tablet 5731f83159e24264af48ae4d428f6a75 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.931450 15229 tablet_service.cc:1511] Processing CreateTablet for tablet 5731f83159e24264af48ae4d428f6a75 (DEFAULT_TABLE table=test-workload [id=f1a4b51f7de2478ca130e2e4ed584313]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.932597 15160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5731f83159e24264af48ae4d428f6a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.933151 15198 heartbeater.cc:499] Master 127.14.34.190:37231 was elected leader, sending a full tablet report...
I20260709 13:05:39.935526 15288 tablet_bootstrap.cc:654] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.938072 15287 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:39.932725 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5731f83159e24264af48ae4d428f6a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.954264 15290 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:39.954779 15290 ts_tablet_manager.cc:1403] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.008s
I20260709 13:05:39.954841 15287 tablet_bootstrap.cc:654] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.955085 15288 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:39.955622 15288 ts_tablet_manager.cc:1403] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.005s
I20260709 13:05:39.957617 15290 raft_consensus.cc:359] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.958381 15290 raft_consensus.cc:385] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.958693 15290 raft_consensus.cc:740] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.959442 15290 consensus_queue.cc:260] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.961408 15272 heartbeater.cc:499] Master 127.14.34.190:37231 was elected leader, sending a full tablet report...
I20260709 13:05:39.961079 15288 raft_consensus.cc:359] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.962103 15288 raft_consensus.cc:385] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.962508 15288 raft_consensus.cc:740] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.966646 15288 consensus_queue.cc:260] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.972328 15290 ts_tablet_manager.cc:1434] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:05:39.973765 15290 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:39.975636 15287 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:39.976147 15287 ts_tablet_manager.cc:1403] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.015s
I20260709 13:05:39.979090 15287 raft_consensus.cc:359] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.979823 15287 raft_consensus.cc:385] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.980175 15287 raft_consensus.cc:740] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.980994 15287 consensus_queue.cc:260] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.983103 15287 ts_tablet_manager.cc:1434] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.007s
I20260709 13:05:39.983644 15290 tablet_bootstrap.cc:654] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.983987 15287 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:39.990072 15291 raft_consensus.cc:493] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.990547 15287 tablet_bootstrap.cc:654] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.990598 15291 raft_consensus.cc:515] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:39.993432 15291 leader_election.cc:290] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.001784 15123 heartbeater.cc:499] Master 127.14.34.190:37231 was elected leader, sending a full tablet report...
I20260709 13:05:40.004869 15290 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.005633 15290 ts_tablet_manager.cc:1403] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 13:05:40.009686 15290 raft_consensus.cc:359] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.010522 15290 raft_consensus.cc:385] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.010864 15290 raft_consensus.cc:740] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.011881 15290 consensus_queue.cc:260] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.022074 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.023963 15290 ts_tablet_manager.cc:1434] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
W20260709 13:05:40.024323 15138 leader_election.cc:343] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.025137 15290 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.027849 15288 ts_tablet_manager.cc:1434] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.072s	user 0.016s	sys 0.021s
I20260709 13:05:40.032667 15288 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.033335 15290 tablet_bootstrap.cc:654] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.038137 15287 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.038616 15287 ts_tablet_manager.cc:1403] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.030s
I20260709 13:05:40.041108 15288 tablet_bootstrap.cc:654] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.041456 15287 raft_consensus.cc:359] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.042229 15287 raft_consensus.cc:385] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.042516 15287 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.043274 15287 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.045369 15287 ts_tablet_manager.cc:1434] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:40.046445 15287 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.049695 15290 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.050242 15290 ts_tablet_manager.cc:1403] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 13:05:40.051790 15287 tablet_bootstrap.cc:654] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.052363 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.053063 15098 raft_consensus.cc:2468] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.053488 15290 raft_consensus.cc:359] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.054337 15290 raft_consensus.cc:385] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.054447 15137 leader_election.cc:304] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 530d79347599444d95f49dd1e125b273
I20260709 13:05:40.054703 15290 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.055651 15291 raft_consensus.cc:2804] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.056025 15291 raft_consensus.cc:493] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.056588 15291 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.055953 15290 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.059672 15290 ts_tablet_manager.cc:1434] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:40.061161 15290 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.064091 15288 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.064672 15288 ts_tablet_manager.cc:1403] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 13:05:40.064390 15291 raft_consensus.cc:515] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.067381 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.067960 15098 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.068521 15290 tablet_bootstrap.cc:654] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.068106 15288 raft_consensus.cc:359] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.068943 15288 raft_consensus.cc:385] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.069293 15288 raft_consensus.cc:740] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.070405 15288 consensus_queue.cc:260] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.074752 15290 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.074817 15288 ts_tablet_manager.cc:1434] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:05:40.074986 15098 raft_consensus.cc:2468] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.075424 15290 ts_tablet_manager.cc:1403] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:05:40.076489 15137 leader_election.cc:304] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.079206 15290 raft_consensus.cc:359] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.079807 15288 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.080166 15290 raft_consensus.cc:385] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.080258 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.080680 15290 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
W20260709 13:05:40.081794 15138 leader_election.cc:343] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.081674 15290 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.082399 15291 leader_election.cc:290] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.082968 15291 raft_consensus.cc:2804] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.083395 15291 raft_consensus.cc:697] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:40.084203 15291 consensus_queue.cc:237] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.086815 15290 ts_tablet_manager.cc:1434] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:05:40.088773 15290 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.091629 15288 tablet_bootstrap.cc:654] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.094347 15287 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.094815 15287 ts_tablet_manager.cc:1403] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:05:40.097471 15287 raft_consensus.cc:359] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.098037 15287 raft_consensus.cc:385] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.101364 15288 tablet_bootstrap.cc:492] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.101806 15287 raft_consensus.cc:740] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.098075 15290 tablet_bootstrap.cc:654] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.102108 15288 ts_tablet_manager.cc:1403] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
I20260709 13:05:40.102757 15287 consensus_queue.cc:260] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.104317 14994 catalog_manager.cc:5697] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.105197 15288 raft_consensus.cc:359] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.106140 15288 raft_consensus.cc:385] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.106536 15288 raft_consensus.cc:740] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.106885 15287 ts_tablet_manager.cc:1434] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:05:40.107708 15288 consensus_queue.cc:260] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.109710 15287 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.116400 15287 tablet_bootstrap.cc:654] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.114153 15290 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.117774 15288 ts_tablet_manager.cc:1434] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:05:40.118162 15290 ts_tablet_manager.cc:1403] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.008s
I20260709 13:05:40.118971 15288 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.121165 15290 raft_consensus.cc:359] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.122062 15290 raft_consensus.cc:385] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.122367 15290 raft_consensus.cc:740] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.123373 15290 consensus_queue.cc:260] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.127669 15288 tablet_bootstrap.cc:654] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.127806 15287 tablet_bootstrap.cc:492] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.128351 15287 ts_tablet_manager.cc:1403] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:05:40.128991 15290 ts_tablet_manager.cc:1434] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:40.130143 15290 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.131371 15287 raft_consensus.cc:359] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.132315 15287 raft_consensus.cc:385] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.132689 15287 raft_consensus.cc:740] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.133777 15287 consensus_queue.cc:260] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.138222 15290 tablet_bootstrap.cc:654] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.138859 15287 ts_tablet_manager.cc:1434] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:05:40.139842 15287 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.148106 15287 tablet_bootstrap.cc:654] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.149873 15290 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.150485 15290 ts_tablet_manager.cc:1403] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:05:40.152650 15288 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.153228 15288 ts_tablet_manager.cc:1403] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.003s
I20260709 13:05:40.153695 15290 raft_consensus.cc:359] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.154546 15290 raft_consensus.cc:385] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.154873 15290 raft_consensus.cc:740] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.155931 15290 consensus_queue.cc:260] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.156946 15288 raft_consensus.cc:359] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.157637 15288 raft_consensus.cc:385] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.157891 15288 raft_consensus.cc:740] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.158757 15288 consensus_queue.cc:260] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.159498 15290 ts_tablet_manager.cc:1434] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:40.160547 15290 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.160904 15288 ts_tablet_manager.cc:1434] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:40.161862 15288 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.164283 15287 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.164827 15287 ts_tablet_manager.cc:1403] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:05:40.168138 15288 tablet_bootstrap.cc:654] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.167867 15290 tablet_bootstrap.cc:654] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.167838 15287 raft_consensus.cc:359] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.170472 15287 raft_consensus.cc:385] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.170856 15287 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.171821 15287 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.175410 15287 ts_tablet_manager.cc:1434] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:40.176369 15287 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.178145 15288 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.178674 15288 ts_tablet_manager.cc:1403] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 13:05:40.181892 15287 tablet_bootstrap.cc:654] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.182257 15290 tablet_bootstrap.cc:492] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.181754 15288 raft_consensus.cc:359] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.182705 15288 raft_consensus.cc:385] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.183180 15288 raft_consensus.cc:740] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.183979 15288 consensus_queue.cc:260] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.182771 15290 ts_tablet_manager.cc:1403] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:05:40.186676 15288 ts_tablet_manager.cc:1434] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:05:40.187275 15287 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.187733 15287 ts_tablet_manager.cc:1403] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:05:40.187829 15288 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
W20260709 13:05:40.190483 15044 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.190510 15295 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.190598 15287 raft_consensus.cc:359] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.191558 15287 raft_consensus.cc:385] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.191308 15295 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.191915 15287 raft_consensus.cc:740] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.191690 15290 raft_consensus.cc:359] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.192628 15290 raft_consensus.cc:385] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.192986 15290 raft_consensus.cc:740] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.192843 15287 consensus_queue.cc:260] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.193854 15290 consensus_queue.cc:260] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.195456 15288 tablet_bootstrap.cc:654] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.195531 15287 ts_tablet_manager.cc:1434] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:40.196897 15287 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.205397 15287 tablet_bootstrap.cc:654] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.210829 15290 ts_tablet_manager.cc:1434] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 13:05:40.211879 15290 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.214187 15287 tablet_bootstrap.cc:492] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.214649 15287 ts_tablet_manager.cc:1403] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:05:40.216213 15291 raft_consensus.cc:493] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.216711 15291 raft_consensus.cc:515] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.218825 15290 tablet_bootstrap.cc:654] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.218917 15291 leader_election.cc:290] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.221592 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.222204 15098 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.222489 15287 raft_consensus.cc:359] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.223120 15287 raft_consensus.cc:385] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.220510 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.223405 15287 raft_consensus.cc:740] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.223840 15247 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.224793 15137 leader_election.cc:304] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.225560 15291 raft_consensus.cc:2804] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.219930 15295 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.225934 15291 raft_consensus.cc:493] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.226344 15291 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.236189 15291 raft_consensus.cc:515] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.239837 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.240586 15098 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.224187 15287 consensus_queue.cc:260] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.256455 15287 ts_tablet_manager.cc:1434] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:05:40.257583 15287 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.257465 15296 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.257972 15296 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.260457 15296 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.249904 15098 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.263289 15137 leader_election.cc:304] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.264442 15303 raft_consensus.cc:2804] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.279366 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.280182 15247 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.289753 15247 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.295454 15288 tablet_bootstrap.cc:492] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.296010 15288 ts_tablet_manager.cc:1403] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.108s	user 0.046s	sys 0.057s
I20260709 13:05:40.296701 15295 raft_consensus.cc:493] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.297147 15295 raft_consensus.cc:515] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.299199 15295 leader_election.cc:290] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.299232 15288 raft_consensus.cc:359] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.299752 15291 leader_election.cc:290] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.300208 15288 raft_consensus.cc:385] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.300625 15288 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.301466 15288 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.302425 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.302623 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.303117 15097 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.303011 15303 raft_consensus.cc:697] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:40.304162 15303 consensus_queue.cc:237] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.306677 15288 ts_tablet_manager.cc:1434] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.010s
W20260709 13:05:40.308120 15212 leader_election.cc:343] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.306993 15211 leader_election.cc:304] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:40.307426 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.309134 15295 raft_consensus.cc:2804] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.309406 15172 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.309698 15295 raft_consensus.cc:493] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.310278 15295 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.307818 15288 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.307909 15287 tablet_bootstrap.cc:654] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.317075 15288 tablet_bootstrap.cc:654] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.320528 15290 tablet_bootstrap.cc:492] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.321111 15290 ts_tablet_manager.cc:1403] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.030s
I20260709 13:05:40.316870 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
W20260709 13:05:40.323279 15211 leader_election.cc:343] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.323916 15211 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 530d79347599444d95f49dd1e125b273; no voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:40.325009 15315 raft_consensus.cc:2749] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.331200 15315 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.331789 15315 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.333981 15323 raft_consensus.cc:493] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.334643 15323 raft_consensus.cc:515] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.336352 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.337124 15172 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.338389 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.338738 15212 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.339129 15247 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.340308 15315 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.340936 15328 raft_consensus.cc:2804] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.340713 15138 leader_election.cc:304] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.341737 15291 raft_consensus.cc:2804] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.342285 15291 raft_consensus.cc:493] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.342618 15291 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.343357 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.344194 15097 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.345702 15290 raft_consensus.cc:359] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.346330 15323 leader_election.cc:290] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307), 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083)
I20260709 13:05:40.352121 15290 raft_consensus.cc:385] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.353109 15290 raft_consensus.cc:740] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.355463 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.356253 15172 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 0.
I20260709 13:05:40.356307 14995 catalog_manager.cc:5697] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.349565 15291 raft_consensus.cc:515] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.358337 15063 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.347296 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.358544 15290 consensus_queue.cc:260] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.359546 15098 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.361373 15296 raft_consensus.cc:2804] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.361802 15328 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.362342 15328 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.362527 15097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.363168 15097 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.363242 15296 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.363642 15296 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.330510 15295 raft_consensus.cc:515] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.360148 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.366490 15247 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.368860 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.369416 15172 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.361435 15291 leader_election.cc:290] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Requested vote from peers 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307), 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083)
I20260709 13:05:40.371866 15328 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.373174 15247 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.374396 15138 leader_election.cc:304] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.374670 15328 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.375239 15291 raft_consensus.cc:2804] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.375692 15291 raft_consensus.cc:697] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:40.375821 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.376353 15173 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.376513 15291 consensus_queue.cc:237] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:40.381068 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.381254 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.381891 15098 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.385766 15172 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.386015 15097 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.389377 15287 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.386929 15295 leader_election.cc:290] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.387264 15212 leader_election.cc:304] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.389951 15287 ts_tablet_manager.cc:1403] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.011s
I20260709 13:05:40.390726 15295 raft_consensus.cc:2804] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.391203 15295 raft_consensus.cc:697] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:40.391997 15295 consensus_queue.cc:237] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.393575 15287 raft_consensus.cc:359] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.382663 15296 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.384757 15173 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.396042 15212 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.396807 15290 ts_tablet_manager.cc:1434] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 13:05:40.397030 15315 raft_consensus.cc:2804] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.397485 15315 raft_consensus.cc:697] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:40.398269 15315 consensus_queue.cc:237] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.394459 15287 raft_consensus.cc:385] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.402454 15290 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.402372 15287 raft_consensus.cc:740] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.403317 15287 consensus_queue.cc:260] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.406134 15288 tablet_bootstrap.cc:492] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.403692 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.406697 15288 ts_tablet_manager.cc:1403] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.060s
I20260709 13:05:40.408167 15328 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.408560 15096 raft_consensus.cc:2393] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 530d79347599444d95f49dd1e125b273 in current term 1: Already voted for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in this term.
I20260709 13:05:40.408697 15328 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.394430 15098 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.409662 15288 raft_consensus.cc:359] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.410368 15288 raft_consensus.cc:385] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.410710 15288 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.411566 15288 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.410769 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.412896 15173 raft_consensus.cc:2393] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in current term 1: Already voted for candidate 530d79347599444d95f49dd1e125b273 in this term.
I20260709 13:05:40.413719 15296 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.413889 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.414562 15096 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.415309 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.416033 15172 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.416767 15290 tablet_bootstrap.cc:654] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.406200 15287 ts_tablet_manager.cc:1434] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:40.417776 15211 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:40.418126 15287 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: Bootstrap starting.
I20260709 13:05:40.416458 15328 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.418876 15328 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.419229 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.419396 15328 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.419857 15328 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.425638 14996 catalog_manager.cc:5697] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.427093 15287 tablet_bootstrap.cc:654] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.431825 15288 ts_tablet_manager.cc:1434] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 13:05:40.431653 15328 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.433194 15288 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.435380 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.435977 15172 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.443233 15172 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.444448 15212 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.445536 15332 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.445773 15063 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98; no voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:40.446571 15332 raft_consensus.cc:697] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:40.447544 15332 consensus_queue.cc:237] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.448127 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.449270 15096 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.450809 15288 tablet_bootstrap.cc:654] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.448679 15331 raft_consensus.cc:2749] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.464098 15328 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.468461 15290 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.469283 15290 ts_tablet_manager.cc:1403] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.013s
I20260709 13:05:40.472929 15290 raft_consensus.cc:359] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.473459 15096 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.475221 15290 raft_consensus.cc:385] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.476114 15290 raft_consensus.cc:740] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.477610 15290 consensus_queue.cc:260] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.480302 15331 raft_consensus.cc:493] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.480911 15331 raft_consensus.cc:515] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.481664 15290 ts_tablet_manager.cc:1434] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:05:40.482875 15290 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: Bootstrap starting.
I20260709 13:05:40.489059 15331 leader_election.cc:290] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.489310 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.490046 15247 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 0.
I20260709 13:05:40.490581 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.491214 15172 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 0.
I20260709 13:05:40.491506 15290 tablet_bootstrap.cc:654] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.491384 15063 leader_election.cc:304] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:40.492825 15331 raft_consensus.cc:2804] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.493273 15331 raft_consensus.cc:493] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.493671 15331 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.494535 15287 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: No bootstrap required, opened a new log
I20260709 13:05:40.494858 15288 tablet_bootstrap.cc:492] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.494977 15287 ts_tablet_manager.cc:1403] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent bootstrapping tablet: real 0.077s	user 0.034s	sys 0.027s
I20260709 13:05:40.495317 15288 ts_tablet_manager.cc:1403] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.016s
I20260709 13:05:40.498049 15288 raft_consensus.cc:359] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.497864 15287 raft_consensus.cc:359] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.498867 15288 raft_consensus.cc:385] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.499074 15287 raft_consensus.cc:385] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.499297 15288 raft_consensus.cc:740] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.499563 15287 raft_consensus.cc:740] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.500370 15288 consensus_queue.cc:260] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.500654 15287 consensus_queue.cc:260] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.502853 15288 ts_tablet_manager.cc:1434] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:40.503778 15288 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.506484 15331 raft_consensus.cc:515] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.509481 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.509841 15288 tablet_bootstrap.cc:654] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.510116 15172 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.509673 15291 consensus_queue.cc:1048] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.519289 15172 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 1.
I20260709 13:05:40.520838 15063 leader_election.cc:304] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.521916 15296 raft_consensus.cc:2804] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.521431 15287 ts_tablet_manager.cc:1434] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:40.540566 14994 catalog_manager.cc:5697] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 0 to 1, leader changed from <none> to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.549242 15290 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: No bootstrap required, opened a new log
I20260709 13:05:40.550001 15290 ts_tablet_manager.cc:1403] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.014s
I20260709 13:05:40.559676 15332 raft_consensus.cc:493] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.560184 15332 raft_consensus.cc:515] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.561574 15247 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.562394 15332 leader_election.cc:290] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.562170 15290 raft_consensus.cc:359] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.563148 15290 raft_consensus.cc:385] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.563431 15290 raft_consensus.cc:740] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.564177 15290 consensus_queue.cc:260] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.565171 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.565864 15096 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.566125 14995 catalog_manager.cc:5697] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 0 to 1, leader changed from <none> to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.567339 15211 leader_election.cc:304] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:40.568423 15328 raft_consensus.cc:2804] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.567974 14995 catalog_manager.cc:5697] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 0 to 1, leader changed from <none> to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.568781 15328 raft_consensus.cc:493] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.569119 15328 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.570762 15290 ts_tablet_manager.cc:1434] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:40.571472 15303 consensus_queue.cc:1048] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.572571 15296 raft_consensus.cc:697] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:40.573895 15296 consensus_queue.cc:237] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.579562 15328 raft_consensus.cc:515] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.581387 15288 tablet_bootstrap.cc:492] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.581477 15331 leader_election.cc:290] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.582135 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.582609 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.585826 15247 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.586434 15172 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 0.
I20260709 13:05:40.582156 15288 ts_tablet_manager.cc:1403] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.079s	user 0.038s	sys 0.018s
I20260709 13:05:40.589687 15328 leader_election.cc:290] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.583961 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.585248 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.591954 15288 raft_consensus.cc:359] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.592448 15173 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.592895 15288 raft_consensus.cc:385] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.593282 15288 raft_consensus.cc:740] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.594132 15288 consensus_queue.cc:260] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.596869 15288 ts_tablet_manager.cc:1434] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:40.598124 15288 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: Bootstrap starting.
I20260709 13:05:40.592422 15098 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.607738 15288 tablet_bootstrap.cc:654] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.606810 14996 catalog_manager.cc:5697] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.609508 15247 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 1.
I20260709 13:05:40.608110 15173 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.613700 15098 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 1.
I20260709 13:05:40.613963 15212 leader_election.cc:304] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.614817 15328 raft_consensus.cc:2804] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.615283 15328 raft_consensus.cc:697] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:40.616149 15328 consensus_queue.cc:237] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.618227 15288 tablet_bootstrap.cc:492] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: No bootstrap required, opened a new log
I20260709 13:05:40.618263 15315 raft_consensus.cc:493] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e149d21a77d8422b8eab7e083f4f3c1b)
I20260709 13:05:40.618748 15288 ts_tablet_manager.cc:1403] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:05:40.618913 15315 raft_consensus.cc:515] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.621620 15288 raft_consensus.cc:359] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.622401 15288 raft_consensus.cc:385] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.622685 15288 raft_consensus.cc:740] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.623390 15288 consensus_queue.cc:260] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.624073 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.624864 15315 leader_election.cc:290] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:40.625717 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.625948 15288 ts_tablet_manager.cc:1434] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:40.627323 15212 leader_election.cc:304] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 530d79347599444d95f49dd1e125b273; no voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:40.628937 15328 raft_consensus.cc:2749] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:40.636173 14994 catalog_manager.cc:5697] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 0 to 1, leader changed from <none> to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.713450 15323 raft_consensus.cc:493] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.713909 15323 raft_consensus.cc:515] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.715648 15323 leader_election.cc:290] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.716583 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.716856 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.717381 15246 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.717381 15098 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.718645 15137 leader_election.cc:304] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.719311 15323 raft_consensus.cc:2804] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.719647 15323 raft_consensus.cc:493] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.719869 15323 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.724459 15323 raft_consensus.cc:515] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.726104 15323 leader_election.cc:290] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.726878 15098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.727470 15098 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.727491 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.728077 15246 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.731910 15098 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.732656 15246 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.732919 15137 leader_election.cc:304] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.733747 15323 raft_consensus.cc:2804] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.734249 15323 raft_consensus.cc:697] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:40.734993 15323 consensus_queue.cc:237] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.741504 14994 catalog_manager.cc:5697] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.750742 15323 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.761600 15323 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.831437 15328 consensus_queue.cc:1048] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.840940 15296 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.841537 15315 consensus_queue.cc:1048] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.842537 15323 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.843014 15323 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.845041 15323 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.846167 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" is_pre_election: true
I20260709 13:05:40.841470 15296 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.847877 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.848497 15246 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.849165 15296 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.850302 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" is_pre_election: true
I20260709 13:05:40.850247 15138 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:40.851006 15096 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 0.
I20260709 13:05:40.851007 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273" is_pre_election: true
I20260709 13:05:40.851998 15246 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 0.
I20260709 13:05:40.851099 15173 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 0.
I20260709 13:05:40.853129 15063 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:40.853138 15323 raft_consensus.cc:2804] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.853765 15323 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.854149 15323 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.854285 15296 raft_consensus.cc:2804] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.854712 15296 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.855058 15296 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.859171 15323 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.860018 15296 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.860834 15323 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.862260 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.862481 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:40.862836 15246 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.863235 15096 raft_consensus.cc:2393] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e149d21a77d8422b8eab7e083f4f3c1b in current term 1: Already voted for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in this term.
I20260709 13:05:40.865338 15296 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:40.865348 15315 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.866662 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:40.866745 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:40.867481 15172 raft_consensus.cc:2393] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in current term 1: Already voted for candidate e149d21a77d8422b8eab7e083f4f3c1b in this term.
I20260709 13:05:40.868738 15063 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98; no voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:40.869552 15296 raft_consensus.cc:2749] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.869928 15246 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 1.
I20260709 13:05:40.871181 15138 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:40.871943 15323 raft_consensus.cc:2804] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.872416 15323 raft_consensus.cc:697] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:40.873196 15323 consensus_queue.cc:237] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:40.878237 15295 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.886196 14996 catalog_manager.cc:5697] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.955716 15323 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.965400 15303 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.977454 15295 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.988174 15328 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.001374 15296 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.014575 15331 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.105258 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:41.105779 15173 raft_consensus.cc:606] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:41.119656 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:41.120177 15246 raft_consensus.cc:606] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:41.125504 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:41.126156 15173 raft_consensus.cc:606] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:41.130913 15328 consensus_queue.cc:1048] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.131585 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:41.132072 15246 raft_consensus.cc:606] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:41.137280 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:41.137842 15246 raft_consensus.cc:606] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:41.141842 15315 consensus_queue.cc:1048] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.159246 15096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60586
I20260709 13:05:41.159776 15096 raft_consensus.cc:606] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 LEADER]: Received request to transfer leadership to TS e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:41.169694 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:41.170269 15246 raft_consensus.cc:606] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Received request to transfer leadership to TS e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:41.174844 15173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:41.175369 15173 raft_consensus.cc:606] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Received request to transfer leadership to TS 530d79347599444d95f49dd1e125b273
I20260709 13:05:41.240943 15303 consensus_queue.cc:1048] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.247340 15359 raft_consensus.cc:993] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:41.247797 15323 raft_consensus.cc:1081] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Signalling peer 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:41.249478 15247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75"
dest_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:57188
I20260709 13:05:41.250891 15247 raft_consensus.cc:493] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.251272 15247 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.253531 15303 consensus_queue.cc:1048] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.258013 15247 raft_consensus.cc:515] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.263008 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:41.263638 15096 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.265035 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5731f83159e24264af48ae4d428f6a75" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.265645 15173 raft_consensus.cc:3055] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.266956 15247 leader_election.cc:290] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 2 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:41.265971 15173 raft_consensus.cc:740] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:41.268129 15173 consensus_queue.cc:260] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.269098 15173 raft_consensus.cc:3060] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.270457 15096 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 2.
I20260709 13:05:41.271736 15211 leader_election.cc:304] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:41.272541 15315 raft_consensus.cc:2804] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.273036 15315 raft_consensus.cc:697] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 2 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:41.273864 15315 consensus_queue.cc:237] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.274940 15173 raft_consensus.cc:2468] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 2.
I20260709 13:05:41.280543 14995 catalog_manager.cc:5697] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 1 to 2, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.346474 15332 raft_consensus.cc:993] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.346982 15315 raft_consensus.cc:1081] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.348626 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35604
I20260709 13:05:41.349215 15096 raft_consensus.cc:493] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.349620 15096 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.353174 15303 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.355772 15096 raft_consensus.cc:515] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.357982 15096 leader_election.cc:290] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.358744 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.359269 15173 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.359750 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6686e74a045e43d8bea9d8a5f9553961" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.360301 15247 raft_consensus.cc:3055] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.360621 15247 raft_consensus.cc:740] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:41.361418 15247 consensus_queue.cc:260] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.362560 15247 raft_consensus.cc:3060] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.365012 15359 raft_consensus.cc:993] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.365439 15359 raft_consensus.cc:1081] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.368957 15098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35594
I20260709 13:05:41.370756 15098 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.371208 15098 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.372917 15359 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.369484 15247 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.375133 15063 leader_election.cc:304] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:41.376782 15344 raft_consensus.cc:2804] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.377269 15344 raft_consensus.cc:697] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.378542 15303 raft_consensus.cc:993] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.378185 15344 consensus_queue.cc:237] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.379025 15323 raft_consensus.cc:1081] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.380065 15098 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.382156 15098 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.382822 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.383385 15172 raft_consensus.cc:3055] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.383690 15172 raft_consensus.cc:740] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:41.384564 15172 consensus_queue.cc:260] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.385464 15172 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.386325 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.387077 15246 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.389820 15098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35594
I20260709 13:05:41.390600 15098 raft_consensus.cc:493] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.390995 15098 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.392663 15172 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.393961 15246 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.393919 15063 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.394892 15344 raft_consensus.cc:2804] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.397332 15098 raft_consensus.cc:515] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:41.398751 15344 raft_consensus.cc:697] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.399587 15344 consensus_queue.cc:237] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.400094 15332 raft_consensus.cc:993] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.400521 15332 raft_consensus.cc:1081] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.402149 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35604
I20260709 13:05:41.402693 15096 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.403038 15096 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.403795 15173 raft_consensus.cc:2468] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.405808 15098 leader_election.cc:290] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:41.407563 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.408088 15173 raft_consensus.cc:3055] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.408351 15173 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:41.409034 15173 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:41.410140 15173 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.409914 15096 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.412632 15096 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.413813 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.413317 14995 catalog_manager.cc:5697] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.414389 15247 raft_consensus.cc:3055] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.414690 15247 raft_consensus.cc:740] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:41.414928 14995 catalog_manager.cc:5697] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.416016 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.416465 15172 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.416896 15173 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.415426 15247 consensus_queue.cc:260] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.417918 15063 leader_election.cc:304] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.418064 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.418630 15246 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.419005 15344 raft_consensus.cc:2804] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.419538 15344 raft_consensus.cc:697] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.420524 15344 consensus_queue.cc:237] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:41.423324 15172 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.424837 15063 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.417986 15247 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.425558 15246 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.426237 15344 raft_consensus.cc:2804] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.426957 15344 raft_consensus.cc:697] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.428167 15344 consensus_queue.cc:237] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.431499 15247 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.434614 14995 catalog_manager.cc:5697] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.435703 14995 catalog_manager.cc:5697] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.460214 15315 raft_consensus.cc:993] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.460724 15328 raft_consensus.cc:1081] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:41.462255 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35604
I20260709 13:05:41.462821 15096 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.463191 15096 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.467916 15096 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.469429 15096 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.470294 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:41.470644 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.470919 15173 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.471215 15247 raft_consensus.cc:3055] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.471565 15247 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:41.472481 15247 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.473647 15247 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.477697 15173 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.478650 15247 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:41.478789 15063 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.479614 15344 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.480003 15344 raft_consensus.cc:697] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.480790 15344 consensus_queue.cc:237] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.486979 14995 catalog_manager.cc:5697] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.534862 15315 raft_consensus.cc:993] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: : Instructing follower e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:41.535326 15328 raft_consensus.cc:1081] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Signalling peer e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:41.536677 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60654
I20260709 13:05:41.537307 15173 raft_consensus.cc:493] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.537655 15173 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.542128 15173 raft_consensus.cc:515] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.543705 15173 leader_election.cc:290] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 2 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.544824 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:41.544847 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52bc5de6e47441349ec0e7590f210f36" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.545358 15096 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.545562 15247 raft_consensus.cc:3055] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.545940 15247 raft_consensus.cc:740] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:41.546749 15247 consensus_queue.cc:260] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.547713 15247 raft_consensus.cc:3060] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.550297 15096 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 2.
I20260709 13:05:41.551368 15137 leader_election.cc:304] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.552238 15359 raft_consensus.cc:2804] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.552621 15359 raft_consensus.cc:697] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:41.553331 15247 raft_consensus.cc:2468] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 2.
I20260709 13:05:41.553376 15359 consensus_queue.cc:237] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.559600 14995 catalog_manager.cc:5697] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 1 to 2, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 2 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.563638 15341 raft_consensus.cc:993] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:41.564105 15344 raft_consensus.cc:1081] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 LEADER]: Signalling peer e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:41.565876 15173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60660
I20260709 13:05:41.566468 15173 raft_consensus.cc:493] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.566869 15173 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.571738 15173 raft_consensus.cc:515] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.573304 15173 leader_election.cc:290] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 2 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:41.574306 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:41.574504 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:41.574829 15096 raft_consensus.cc:3055] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.575095 15247 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.575167 15096 raft_consensus.cc:740] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:41.576000 15096 consensus_queue.cc:260] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.576895 15096 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.580415 15247 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 2.
I20260709 13:05:41.581650 15096 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 2.
I20260709 13:05:41.581668 15138 leader_election.cc:304] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:41.582583 15359 raft_consensus.cc:2804] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.582980 15359 raft_consensus.cc:697] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:41.583743 15359 consensus_queue.cc:237] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:41.590229 14995 catalog_manager.cc:5697] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 1 to 2, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 2 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.770807 15096 raft_consensus.cc:1275] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.772060 15328 consensus_queue.cc:1048] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.779542 15173 raft_consensus.cc:1275] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.781895 15295 consensus_queue.cc:1048] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.799209 15247 raft_consensus.cc:1275] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.800604 15344 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.809080 15173 raft_consensus.cc:1275] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.810454 15344 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.828649 15247 raft_consensus.cc:1275] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.828649 15173 raft_consensus.cc:1275] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.830240 15341 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.830961 15344 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.879633 15173 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.881304 15344 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.892668 15247 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.894102 15375 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.923827 15173 raft_consensus.cc:1275] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.925307 15375 consensus_queue.cc:1048] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.934788 15247 raft_consensus.cc:1275] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.936314 15344 consensus_queue.cc:1048] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.937211 15247 raft_consensus.cc:1275] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.938943 15359 consensus_queue.cc:1048] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.949703 15096 raft_consensus.cc:1275] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.952128 15359 consensus_queue.cc:1048] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.002252 15245 raft_consensus.cc:1275] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.003535 15359 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.011082 15096 raft_consensus.cc:1275] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.013377 15378 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.046469 15245 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.047874 15344 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.056900 15173 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.058382 15341 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.205562 14474 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:44.206301 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.222229 15096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:44.222729 15096 raft_consensus.cc:606] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Received request to transfer leadership to TS 530d79347599444d95f49dd1e125b273
I20260709 13:05:44.224841 15096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:44.225244 15096 raft_consensus.cc:606] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Received request to transfer leadership to TS 530d79347599444d95f49dd1e125b273
I20260709 13:05:44.226090 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:44.226543 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:44.521127 15385 raft_consensus.cc:993] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:44.521548 15331 raft_consensus.cc:1081] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Signalling peer 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:44.522919 15246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:57202
I20260709 13:05:44.523412 15246 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.523788 15246 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.529034 15246 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:44.531529 15246 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:44.532048 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:44.532588 15173 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.533464 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:44.534006 15096 raft_consensus.cc:3055] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.534330 15096 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:44.535056 15096 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:44.536216 15096 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.540300 15173 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:44.542176 15212 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:44.543275 15295 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.545500 15295 raft_consensus.cc:697] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:44.546598 15295 consensus_queue.cc:237] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:44.552708 15096 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:44.557394 14996 catalog_manager.cc:5697] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 2 to 3, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.577106 15385 raft_consensus.cc:993] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:44.577533 15331 raft_consensus.cc:1081] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Signalling peer 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:44.579232 15245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:57202
I20260709 13:05:44.579720 15245 raft_consensus.cc:493] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.580116 15245 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.585016 15245 raft_consensus.cc:515] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:44.586680 15245 leader_election.cc:290] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:44.587463 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:44.587862 15096 raft_consensus.cc:3055] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.587672 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:44.588116 15096 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:44.588248 15173 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.588837 15096 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:44.589938 15096 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.594300 15173 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:44.595454 15212 leader_election.cc:304] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:44.595803 15096 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:44.596143 15295 raft_consensus.cc:2804] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.596561 15295 raft_consensus.cc:697] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:44.597298 15295 consensus_queue.cc:237] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:44.604303 14996 catalog_manager.cc:5697] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 2 to 3, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.034170 15173 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.035707 15295 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.045718 15096 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.047487 15295 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.197227 15172 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.198419 15396 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.207075 15096 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.208877 15396 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.227365 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.238652 15245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:45.239099 15245 raft_consensus.cc:606] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:45.248997 15245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "530d79347599444d95f49dd1e125b273"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35644
I20260709 13:05:45.249512 15245 raft_consensus.cc:606] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:45.256034 15172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:45.256479 15172 raft_consensus.cc:606] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:45.261219 15172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:45.261791 15172 raft_consensus.cc:606] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:45.262892 15378 raft_consensus.cc:993] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.263376 15386 raft_consensus.cc:1081] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.264886 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35594
I20260709 13:05:45.265372 15096 raft_consensus.cc:493] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.265673 15096 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.267021 15172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
mode: GRACEFUL
new_leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:46754
I20260709 13:05:45.267537 15172 raft_consensus.cc:606] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Received request to transfer leadership to TS 03e4daa5dae1406fb5792cfbb5d2bf98
I20260709 13:05:45.270673 15096 raft_consensus.cc:515] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.272245 15096 leader_election.cc:290] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 3 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:45.273242 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:45.273530 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6dbdd4de647f1a81d8a81346c0ae8" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:45.273826 15245 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.274158 15172 raft_consensus.cc:3055] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:45.274478 15172 raft_consensus.cc:740] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:45.275283 15172 consensus_queue.cc:260] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.276463 15172 raft_consensus.cc:3060] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.280646 15245 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 3.
I20260709 13:05:45.282099 15063 leader_election.cc:304] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:45.282898 15331 raft_consensus.cc:2804] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:45.283179 15172 raft_consensus.cc:2468] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 3.
I20260709 13:05:45.284019 15331 raft_consensus.cc:697] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:45.284838 15331 consensus_queue.cc:237] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.291838 14994 catalog_manager.cc:5697] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 2 to 3, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.335248 15378 raft_consensus.cc:993] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.335696 15378 raft_consensus.cc:1081] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.337144 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35594
I20260709 13:05:45.337598 15096 raft_consensus.cc:493] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.337855 15096 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.341781 15096 raft_consensus.cc:515] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.343364 15096 leader_election.cc:290] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:45.344297 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:45.344463 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c62faab0f084998a82c5441c10b121f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:45.344972 15245 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.344899 15172 raft_consensus.cc:3055] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.345316 15172 raft_consensus.cc:740] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:45.346138 15172 consensus_queue.cc:260] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.347146 15172 raft_consensus.cc:3060] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.349629 15245 raft_consensus.cc:2468] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:45.350641 15063 leader_election.cc:304] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:45.351365 15331 raft_consensus.cc:2804] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.351910 15331 raft_consensus.cc:697] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:45.352792 15331 consensus_queue.cc:237] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.353351 15172 raft_consensus.cc:2468] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:45.360280 14994 catalog_manager.cc:5697] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.504716 15396 raft_consensus.cc:993] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.505213 15387 raft_consensus.cc:1081] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.507001 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35604
I20260709 13:05:45.507433 15096 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.507704 15096 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.511895 15096 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.513217 15096 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 4 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:45.514276 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:45.514375 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:45.514807 15173 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.514954 15245 raft_consensus.cc:3055] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.515353 15245 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:45.516131 15245 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.517306 15245 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.519855 15173 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 4.
I20260709 13:05:45.520704 15063 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:45.521358 15331 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.521870 15331 raft_consensus.cc:697] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:45.522680 15245 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 4.
I20260709 13:05:45.522688 15331 consensus_queue.cc:237] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.528264 14994 catalog_manager.cc:5697] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 3 to 4, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.679767 15386 raft_consensus.cc:993] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.680258 15378 raft_consensus.cc:1081] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.681668 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35594
I20260709 13:05:45.682183 15096 raft_consensus.cc:493] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.682525 15096 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.687263 15096 raft_consensus.cc:515] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.688803 15096 leader_election.cc:290] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Requested vote from peers e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:45.689817 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:45.690064 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:45.690429 15173 raft_consensus.cc:3055] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.690703 15245 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.690750 15173 raft_consensus.cc:740] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:45.691470 15173 consensus_queue.cc:260] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.692360 15173 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.695580 15245 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:45.696727 15063 leader_election.cc:304] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, 530d79347599444d95f49dd1e125b273; no voters: 
I20260709 13:05:45.696874 15173 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 2.
I20260709 13:05:45.697628 15331 raft_consensus.cc:2804] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.698218 15331 raft_consensus.cc:697] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:45.699043 15331 consensus_queue.cc:237] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:45.705543 14994 catalog_manager.cc:5697] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 1 to 2, leader changed from e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.744323 15245 raft_consensus.cc:1275] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.745584 15331 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.754175 15173 raft_consensus.cc:1275] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.755916 15331 consensus_queue.cc:1048] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.763577 15396 raft_consensus.cc:993] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: : Instructing follower 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.764169 15396 raft_consensus.cc:1081] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Signalling peer 03e4daa5dae1406fb5792cfbb5d2bf98 to start an election
I20260709 13:05:45.765621 15096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
 from {username='slave'} at 127.0.0.1:35604
I20260709 13:05:45.766099 15096 raft_consensus.cc:493] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.766395 15096 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.771108 15096 raft_consensus.cc:515] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:45.772692 15096 leader_election.cc:290] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 4 election: Requested vote from peers 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:45.773304 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:45.773567 15173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25027194bd1d4e42bb494900e361ce3f" candidate_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:45.773891 15245 raft_consensus.cc:3055] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.774101 15173 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.774248 15245 raft_consensus.cc:740] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:45.775056 15245 consensus_queue.cc:260] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:45.775941 15245 raft_consensus.cc:3060] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.778333 15173 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 4.
I20260709 13:05:45.779271 15063 leader_election.cc:304] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e4daa5dae1406fb5792cfbb5d2bf98, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:45.780036 15331 raft_consensus.cc:2804] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.780463 15331 raft_consensus.cc:697] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Becoming Leader. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:45.780838 15245 raft_consensus.cc:2468] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03e4daa5dae1406fb5792cfbb5d2bf98 in term 4.
I20260709 13:05:45.781093 15331 consensus_queue.cc:237] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } }
I20260709 13:05:45.787214 14996 catalog_manager.cc:5697] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 reported cstate change: term changed from 3 to 4, leader changed from 530d79347599444d95f49dd1e125b273 (127.14.34.131) to 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.820638 15245 raft_consensus.cc:1275] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.821852 15331 consensus_queue.cc:1048] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.831241 15173 raft_consensus.cc:1275] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.833137 15416 consensus_queue.cc:1048] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.991003 15173 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:45.992120 15403 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.000666 15245 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.002449 15416 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.087507 15245 raft_consensus.cc:1275] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.088820 15416 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.097592 15173 raft_consensus.cc:1275] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.098847 15403 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.177114 15245 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.178397 15403 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.188320 15173 raft_consensus.cc:1275] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Refusing update from remote peer 03e4daa5dae1406fb5792cfbb5d2bf98: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.191452 15403 consensus_queue.cc:1048] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.275089 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.283833 15098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:48.284665 15098 raft_consensus.cc:606] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Received request to transfer leadership to TS e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:48.287546 15098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:48.288101 15098 raft_consensus.cc:606] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Received request to transfer leadership to TS 530d79347599444d95f49dd1e125b273
I20260709 13:05:48.290855 15096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:48.291270 15096 raft_consensus.cc:606] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Received request to transfer leadership to TS 530d79347599444d95f49dd1e125b273
I20260709 13:05:48.293355 15096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731"
dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
mode: GRACEFUL
new_leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60588
I20260709 13:05:48.293776 15096 raft_consensus.cc:606] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Received request to transfer leadership to TS e149d21a77d8422b8eab7e083f4f3c1b
I20260709 13:05:48.295667 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:48.296133 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.361836 15423 raft_consensus.cc:993] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:48.362371 15423 raft_consensus.cc:1081] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Signalling peer 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:48.363926 15245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b"
dest_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:57202
I20260709 13:05:48.364392 15245 raft_consensus.cc:493] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.364702 15245 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.370401 15245 raft_consensus.cc:515] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.372014 15245 leader_election.cc:290] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:48.373163 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:48.373006 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e5f7dc40d449518451f9b87d70da5b" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:48.373795 15172 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.373827 15096 raft_consensus.cc:3055] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.374240 15096 raft_consensus.cc:740] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:48.374984 15096 consensus_queue.cc:260] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.376089 15096 raft_consensus.cc:3060] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.379665 15416 raft_consensus.cc:993] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:48.380158 15423 raft_consensus.cc:1081] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Signalling peer 530d79347599444d95f49dd1e125b273 to start an election
I20260709 13:05:48.380534 15172 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:48.381821 15212 leader_election.cc:304] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:48.381861 15245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c"
dest_uuid: "530d79347599444d95f49dd1e125b273"
 from {username='slave'} at 127.0.0.1:57202
I20260709 13:05:48.382256 15096 raft_consensus.cc:2468] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:48.382560 15245 raft_consensus.cc:493] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.382807 15424 raft_consensus.cc:2804] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.382964 15245 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.383968 15424 raft_consensus.cc:697] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:48.384879 15424 consensus_queue.cc:237] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.388396 15245 raft_consensus.cc:515] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.391332 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:48.391503 15172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ded7a08fc394d41a27069bfb0f4008c" candidate_uuid: "530d79347599444d95f49dd1e125b273" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
I20260709 13:05:48.391867 15096 raft_consensus.cc:3055] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.392019 15172 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.392191 15096 raft_consensus.cc:740] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:48.393018 15096 consensus_queue.cc:260] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.393191 14996 catalog_manager.cc:5697] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 2 to 3, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.394018 15096 raft_consensus.cc:3060] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.396657 15245 leader_election.cc:290] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375)
I20260709 13:05:48.399330 15172 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:48.400512 15212 leader_election.cc:304] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:48.400879 15096 raft_consensus.cc:2468] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 530d79347599444d95f49dd1e125b273 in term 3.
I20260709 13:05:48.401461 15424 raft_consensus.cc:2804] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.402222 15424 raft_consensus.cc:697] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Becoming Leader. State: Replica: 530d79347599444d95f49dd1e125b273, State: Running, Role: LEADER
I20260709 13:05:48.403257 15424 consensus_queue.cc:237] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.413472 14996 catalog_manager.cc:5697] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 reported cstate change: term changed from 2 to 3, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to 530d79347599444d95f49dd1e125b273 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "530d79347599444d95f49dd1e125b273" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.668093 15416 raft_consensus.cc:993] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:48.668584 15423 raft_consensus.cc:1081] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Signalling peer e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:48.670146 15172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60660
I20260709 13:05:48.670714 15172 raft_consensus.cc:493] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.671010 15172 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.675647 15172 raft_consensus.cc:515] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.677556 15172 leader_election.cc:290] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 5 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:48.678589 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:48.678807 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7096c46a08402abf10d44ddcb5416d" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:48.679472 15245 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.679456 15096 raft_consensus.cc:3055] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.680037 15096 raft_consensus.cc:740] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:48.680958 15096 consensus_queue.cc:260] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.682075 15096 raft_consensus.cc:3060] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.686751 15245 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 5.
I20260709 13:05:48.687695 15246 raft_consensus.cc:1240] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 5 FOLLOWER]: Rejecting Update request from peer 03e4daa5dae1406fb5792cfbb5d2bf98 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.688342 15138 leader_election.cc:304] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:48.689217 15096 raft_consensus.cc:2468] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 5.
I20260709 13:05:48.689728 15378 raft_consensus.cc:2804] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.694305 15378 raft_consensus.cc:697] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 5 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:48.695209 15378 consensus_queue.cc:237] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.703261 14996 catalog_manager.cc:5697] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 4 to 5, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 5 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.809934 15416 raft_consensus.cc:993] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: : Instructing follower e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:48.810415 15423 raft_consensus.cc:1081] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Signalling peer e149d21a77d8422b8eab7e083f4f3c1b to start an election
I20260709 13:05:48.811805 15172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731"
dest_uuid: "e149d21a77d8422b8eab7e083f4f3c1b"
 from {username='slave'} at 127.0.0.1:60660
I20260709 13:05:48.812250 15172 raft_consensus.cc:493] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.812508 15172 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.816880 15172 raft_consensus.cc:515] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.818455 15172 leader_election.cc:290] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 3 election: Requested vote from peers 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083), 530d79347599444d95f49dd1e125b273 (127.14.34.131:43307)
I20260709 13:05:48.819260 15096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98"
I20260709 13:05:48.819567 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77884e2df7b34bfeba3d57da6e666731" candidate_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "530d79347599444d95f49dd1e125b273"
I20260709 13:05:48.819871 15096 raft_consensus.cc:3055] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.820079 15246 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.820189 15096 raft_consensus.cc:740] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03e4daa5dae1406fb5792cfbb5d2bf98, State: Running, Role: LEADER
I20260709 13:05:48.821036 15096 consensus_queue.cc:260] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.821579 15172 raft_consensus.cc:1275] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.822299 15096 raft_consensus.cc:3060] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.822943 15424 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.827277 15246 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 3.
I20260709 13:05:48.828469 15138 leader_election.cc:304] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 530d79347599444d95f49dd1e125b273, e149d21a77d8422b8eab7e083f4f3c1b; no voters: 
I20260709 13:05:48.831346 15378 raft_consensus.cc:2804] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.831768 15096 raft_consensus.cc:2468] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e149d21a77d8422b8eab7e083f4f3c1b in term 3.
I20260709 13:05:48.832175 15378 raft_consensus.cc:697] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 LEADER]: Becoming Leader. State: Replica: e149d21a77d8422b8eab7e083f4f3c1b, State: Running, Role: LEADER
I20260709 13:05:48.833467 15378 consensus_queue.cc:237] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } }
I20260709 13:05:48.841807 15096 raft_consensus.cc:1275] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.844650 15424 consensus_queue.cc:1048] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.845760 14996 catalog_manager.cc:5697] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b reported cstate change: term changed from 2 to 3, leader changed from 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129) to e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130). New cstate: current_term: 3 leader_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.890988 15172 raft_consensus.cc:1275] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.892174 15424 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e149d21a77d8422b8eab7e083f4f3c1b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.900813 15096 raft_consensus.cc:1275] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Refusing update from remote peer 530d79347599444d95f49dd1e125b273: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.902383 15424 consensus_queue.cc:1048] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.184257 15246 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 5 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.186249 15432 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:49.195519 15096 raft_consensus.cc:1275] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 5 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:49.196808 15432 consensus_queue.cc:1048] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.297027 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.304404 15096 raft_consensus.cc:1275] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.304553 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
I20260709 13:05:49.306455 15432 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e4daa5dae1406fb5792cfbb5d2bf98" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:49.310370 15137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:49.316004 15137 consensus_peers.cc:597] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b -> Peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Couldn't send request to peer 03e4daa5dae1406fb5792cfbb5d2bf98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.316789 15137 consensus_peers.cc:597] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b -> Peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Couldn't send request to peer 03e4daa5dae1406fb5792cfbb5d2bf98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.332600 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.333312 14474 tablet_replica.cc:333] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.333993 14474 raft_consensus.cc:2243] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.334589 14474 raft_consensus.cc:2272] T 5731f83159e24264af48ae4d428f6a75 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.336853 14474 tablet_replica.cc:333] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.337356 14474 raft_consensus.cc:2243] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.337754 14474 raft_consensus.cc:2272] T 61e5f7dc40d449518451f9b87d70da5b P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.340091 14474 tablet_replica.cc:333] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.340648 14474 raft_consensus.cc:2243] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.341074 14474 raft_consensus.cc:2272] T 52bc5de6e47441349ec0e7590f210f36 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.342725 14474 tablet_replica.cc:333] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.343261 14474 raft_consensus.cc:2243] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.344013 14474 raft_consensus.cc:2272] T 25027194bd1d4e42bb494900e361ce3f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.345608 14474 tablet_replica.cc:333] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.346187 14474 raft_consensus.cc:2243] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.346581 14474 raft_consensus.cc:2272] T 6ded7a08fc394d41a27069bfb0f4008c P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.349225 14474 tablet_replica.cc:333] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.349927 14474 raft_consensus.cc:2243] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.350787 14474 raft_consensus.cc:2272] T 6686e74a045e43d8bea9d8a5f9553961 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.352564 14474 tablet_replica.cc:333] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.353060 14474 raft_consensus.cc:2243] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.353451 14474 raft_consensus.cc:2272] T 3c7096c46a08402abf10d44ddcb5416d P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.355609 14474 tablet_replica.cc:333] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.356096 14474 raft_consensus.cc:2243] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.356812 14474 raft_consensus.cc:2272] T 9c62faab0f084998a82c5441c10b121f P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.358801 14474 tablet_replica.cc:333] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.359407 14474 raft_consensus.cc:2243] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.359851 14474 raft_consensus.cc:2272] T 77884e2df7b34bfeba3d57da6e666731 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.361802 14474 tablet_replica.cc:333] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98: stopping tablet replica
I20260709 13:05:49.362267 14474 raft_consensus.cc:2243] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.362993 14474 raft_consensus.cc:2272] T bae6dbdd4de647f1a81d8a81346c0ae8 P 03e4daa5dae1406fb5792cfbb5d2bf98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.390780 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
I20260709 13:05:49.411628 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
I20260709 13:05:49.422814 15246 raft_consensus.cc:1275] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Refusing update from remote peer e149d21a77d8422b8eab7e083f4f3c1b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.428685 15444 consensus_queue.cc:1048] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "530d79347599444d95f49dd1e125b273" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:49.435171 15211 consensus_peers.cc:597] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 -> Peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Couldn't send request to peer 03e4daa5dae1406fb5792cfbb5d2bf98. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:42083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.450294 15211 consensus_peers.cc:597] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 -> Peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Couldn't send request to peer 03e4daa5dae1406fb5792cfbb5d2bf98. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:42083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.450764 15211 consensus_peers.cc:597] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 -> Peer 03e4daa5dae1406fb5792cfbb5d2bf98 (127.14.34.129:42083): Couldn't send request to peer 03e4daa5dae1406fb5792cfbb5d2bf98. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:42083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.453877 15212 consensus_peers.cc:597] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 -> Peer e149d21a77d8422b8eab7e083f4f3c1b (127.14.34.130:33375): Couldn't send request to peer e149d21a77d8422b8eab7e083f4f3c1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.457029 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.457839 14474 tablet_replica.cc:333] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.458828 14474 raft_consensus.cc:2243] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.459371 14474 raft_consensus.cc:2272] T 5731f83159e24264af48ae4d428f6a75 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.461128 14474 tablet_replica.cc:333] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.461632 14474 raft_consensus.cc:2243] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.462134 14474 raft_consensus.cc:2272] T 61e5f7dc40d449518451f9b87d70da5b P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.464040 14474 tablet_replica.cc:333] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.464551 14474 raft_consensus.cc:2243] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.464937 14474 raft_consensus.cc:2272] T 6686e74a045e43d8bea9d8a5f9553961 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.466655 14474 tablet_replica.cc:333] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.467362 14474 raft_consensus.cc:2243] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.468160 14474 raft_consensus.cc:2272] T 52bc5de6e47441349ec0e7590f210f36 P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.469676 14474 tablet_replica.cc:333] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.470175 14474 raft_consensus.cc:2243] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.470578 14474 raft_consensus.cc:2272] T 25027194bd1d4e42bb494900e361ce3f P e149d21a77d8422b8eab7e083f4f3c1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.472126 14474 tablet_replica.cc:333] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.472631 14474 raft_consensus.cc:2243] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.472983 14474 raft_consensus.cc:2272] T 6ded7a08fc394d41a27069bfb0f4008c P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.475489 14474 tablet_replica.cc:333] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.475912 14474 raft_consensus.cc:2243] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.476294 14474 raft_consensus.cc:2272] T bae6dbdd4de647f1a81d8a81346c0ae8 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.477826 14474 tablet_replica.cc:333] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.478422 14474 raft_consensus.cc:2243] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.479064 14474 raft_consensus.cc:2272] T 3c7096c46a08402abf10d44ddcb5416d P e149d21a77d8422b8eab7e083f4f3c1b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.480926 14474 tablet_replica.cc:333] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.481339 14474 raft_consensus.cc:2243] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.482077 14474 raft_consensus.cc:2272] T 77884e2df7b34bfeba3d57da6e666731 P e149d21a77d8422b8eab7e083f4f3c1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.483934 14474 tablet_replica.cc:333] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b: stopping tablet replica
I20260709 13:05:49.484302 14474 raft_consensus.cc:2243] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.484651 14474 raft_consensus.cc:2272] T 9c62faab0f084998a82c5441c10b121f P e149d21a77d8422b8eab7e083f4f3c1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.503825 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
I20260709 13:05:49.521920 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:05:49.543076 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.543694 14474 tablet_replica.cc:333] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.544292 14474 raft_consensus.cc:2243] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.545126 14474 raft_consensus.cc:2272] T 5731f83159e24264af48ae4d428f6a75 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.547009 14474 tablet_replica.cc:333] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.547526 14474 raft_consensus.cc:2243] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.548247 14474 raft_consensus.cc:2272] T 6ded7a08fc394d41a27069bfb0f4008c P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.550215 14474 tablet_replica.cc:333] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.550706 14474 raft_consensus.cc:2243] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.551407 14474 raft_consensus.cc:2272] T 61e5f7dc40d449518451f9b87d70da5b P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.553287 14474 tablet_replica.cc:333] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.553820 14474 raft_consensus.cc:2243] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.554245 14474 raft_consensus.cc:2272] T 9c62faab0f084998a82c5441c10b121f P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.555841 14474 tablet_replica.cc:333] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.556331 14474 raft_consensus.cc:2243] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.556743 14474 raft_consensus.cc:2272] T 77884e2df7b34bfeba3d57da6e666731 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.559178 14474 tablet_replica.cc:333] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.559703 14474 raft_consensus.cc:2243] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.560132 14474 raft_consensus.cc:2272] T 3c7096c46a08402abf10d44ddcb5416d P 530d79347599444d95f49dd1e125b273 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.562379 14474 tablet_replica.cc:333] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.562878 14474 raft_consensus.cc:2243] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.563304 14474 raft_consensus.cc:2272] T bae6dbdd4de647f1a81d8a81346c0ae8 P 530d79347599444d95f49dd1e125b273 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.564929 14474 tablet_replica.cc:333] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.565397 14474 raft_consensus.cc:2243] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.565821 14474 raft_consensus.cc:2272] T 52bc5de6e47441349ec0e7590f210f36 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.567404 14474 tablet_replica.cc:333] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.567860 14474 raft_consensus.cc:2243] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.568243 14474 raft_consensus.cc:2272] T 25027194bd1d4e42bb494900e361ce3f P 530d79347599444d95f49dd1e125b273 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.569779 14474 tablet_replica.cc:333] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273: stopping tablet replica
I20260709 13:05:49.570254 14474 raft_consensus.cc:2243] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.570644 14474 raft_consensus.cc:2272] T 6686e74a045e43d8bea9d8a5f9553961 P 530d79347599444d95f49dd1e125b273 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.597534 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:05:49.615926 14474 master.cc:562] Master@127.14.34.190:37231 shutting down...
I20260709 13:05:49.635675 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.636317 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.636690 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 101c1e7fb7554c70827cffba38314bb4: stopping tablet replica
I20260709 13:05:49.657361 14474 master.cc:584] Master@127.14.34.190:37231 shutdown complete.
03e4daa5dae1406fb5792cfbb5d2bf98  5
530d79347599444d95f49dd1e125b273  1
e149d21a77d8422b8eab7e083f4f3c1b  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10641 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:49.697795 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:46799
I20260709 13:05:49.698953 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.704882 15453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.704885 15454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.706314 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:49.706336 15456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.707654 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.707885 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.708055 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602349708038 us; error 0 us; skew 500 ppm
I20260709 13:05:49.708592 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.711577 14474 webserver.cc:533] Webserver started at http://127.14.34.190:40869/ using document root <none> and password file <none>
I20260709 13:05:49.712073 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.712276 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.712555 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.713675 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "bcd214cd726347aba20c77156a32ce97"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:49.718344 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:49.721575 15461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.722509 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:49.722746 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "bcd214cd726347aba20c77156a32ce97"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:49.722990 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.732940 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.734228 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.772841 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:46799
I20260709 13:05:49.772948 15512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:46799 every 8 connection(s)
I20260709 13:05:49.777213 15513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:49.786530 15513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Bootstrap starting.
I20260709 13:05:49.791075 15513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:49.795428 15513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: No bootstrap required, opened a new log
I20260709 13:05:49.797547 15513 raft_consensus.cc:359] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER }
I20260709 13:05:49.797930 15513 raft_consensus.cc:385] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:49.798259 15513 raft_consensus.cc:740] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd214cd726347aba20c77156a32ce97, State: Initialized, Role: FOLLOWER
I20260709 13:05:49.798838 15513 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER }
I20260709 13:05:49.799312 15513 raft_consensus.cc:399] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:49.799541 15513 raft_consensus.cc:493] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:49.799816 15513 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.803916 15513 raft_consensus.cc:515] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER }
I20260709 13:05:49.804471 15513 leader_election.cc:304] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcd214cd726347aba20c77156a32ce97; no voters: 
I20260709 13:05:49.805696 15513 leader_election.cc:290] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:49.806007 15516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.807442 15516 raft_consensus.cc:697] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 1 LEADER]: Becoming Leader. State: Replica: bcd214cd726347aba20c77156a32ce97, State: Running, Role: LEADER
I20260709 13:05:49.808117 15516 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER }
I20260709 13:05:49.808777 15513 sys_catalog.cc:565] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:49.813213 15518 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcd214cd726347aba20c77156a32ce97. Latest consensus state: current_term: 1 leader_uuid: "bcd214cd726347aba20c77156a32ce97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER } }
I20260709 13:05:49.813947 15518 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:49.815982 15524 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:49.815946 15517 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcd214cd726347aba20c77156a32ce97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcd214cd726347aba20c77156a32ce97" member_type: VOTER } }
I20260709 13:05:49.816877 15517 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:49.822501 15524 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:49.824102 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:49.831110 15524 catalog_manager.cc:1383] Generated new cluster ID: 99e5f9db52a14c9998456fab6ad322bb
I20260709 13:05:49.831452 15524 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:49.848984 15524 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:49.850308 15524 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:49.862685 15524 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Generated new TSK 0
I20260709 13:05:49.863355 15524 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:49.890432 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.896458 15534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.897375 15535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.899997 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:49.899955 15537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.901144 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.901407 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.901598 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602349901582 us; error 0 us; skew 500 ppm
I20260709 13:05:49.902228 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.904578 14474 webserver.cc:533] Webserver started at http://127.14.34.129:35487/ using document root <none> and password file <none>
I20260709 13:05:49.905072 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:49.905280 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:49.905560 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:49.906672 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "8995ef9978c446769377fc0e9a0cb9c1"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:49.911423 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:49.914752 15542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.915535 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:49.915838 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "8995ef9978c446769377fc0e9a0cb9c1"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:49.916134 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:49.929350 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:49.930744 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:49.932265 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:49.934681 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:49.934926 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.935173 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:49.935353 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:49.975239 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:45045
I20260709 13:05:49.975340 15604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:45045 every 8 connection(s)
I20260709 13:05:49.980103 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:49.988770 15609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:49.990801 15610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.994076 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:49.993974 15612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:49.995458 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:49.995687 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:49.995877 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602349995856 us; error 0 us; skew 500 ppm
I20260709 13:05:49.996614 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:49.998471 15605 heartbeater.cc:344] Connected to a master server at 127.14.34.190:46799
I20260709 13:05:49.998803 15605 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:49.999511 15605 heartbeater.cc:507] Master 127.14.34.190:46799 requested a full tablet report, sending...
I20260709 13:05:49.999571 14474 webserver.cc:533] Webserver started at http://127.14.34.130:35575/ using document root <none> and password file <none>
I20260709 13:05:50.000147 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.000347 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.000654 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.001909 15478 ts_manager.cc:194] Registered new tserver with Master: 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:05:50.002240 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "680390d3f0884c91bf1f22ba914b438a"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:50.004426 15478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48508
I20260709 13:05:50.007752 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:50.011168 15617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.012115 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:50.012483 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "680390d3f0884c91bf1f22ba914b438a"
format_stamp: "Formatted at 2026-07-09 13:05:49 on dist-test-slave-nr1f"
I20260709 13:05:50.012769 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.047581 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.048797 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.050338 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.052575 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.052754 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.053056 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.053198 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.093086 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:44871
I20260709 13:05:50.093189 15679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:44871 every 8 connection(s)
I20260709 13:05:50.097919 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:50.105786 15683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:50.106575 15684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.109925 15680 heartbeater.cc:344] Connected to a master server at 127.14.34.190:46799
I20260709 13:05:50.110374 15680 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.111045 14474 server_base.cc:1061] running on GCE node
W20260709 13:05:50.111160 15686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:50.111303 15680 heartbeater.cc:507] Master 127.14.34.190:46799 requested a full tablet report, sending...
I20260709 13:05:50.112447 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:50.112690 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:50.112926 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602350112904 us; error 0 us; skew 500 ppm
I20260709 13:05:50.113612 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:50.113884 15478 ts_manager.cc:194] Registered new tserver with Master: 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:50.115458 15478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48518
I20260709 13:05:50.116793 14474 webserver.cc:533] Webserver started at http://127.14.34.131:42717/ using document root <none> and password file <none>
I20260709 13:05:50.117357 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:50.117586 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:50.117921 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:50.119302 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-nr1f"
I20260709 13:05:50.124189 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:05:50.127787 15691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.128577 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:50.128922 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
format_stamp: "Formatted at 2026-07-09 13:05:50 on dist-test-slave-nr1f"
I20260709 13:05:50.129240 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:50.153119 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:50.154481 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:50.156040 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:50.158448 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:50.158694 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.158964 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:50.159159 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:50.202382 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:34333
I20260709 13:05:50.202484 15753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:34333 every 8 connection(s)
I20260709 13:05:50.217109 15754 heartbeater.cc:344] Connected to a master server at 127.14.34.190:46799
I20260709 13:05:50.217522 15754 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:50.218415 15754 heartbeater.cc:507] Master 127.14.34.190:46799 requested a full tablet report, sending...
I20260709 13:05:50.220476 15478 ts_manager.cc:194] Registered new tserver with Master: 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:50.220611 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014808867s
I20260709 13:05:50.221930 15478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48528
I20260709 13:05:50.247268 15478 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48530:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:50.253289 15478 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:50.463084 15719 tablet_service.cc:1511] Processing CreateTablet for tablet 2b55db060b644f01bd9ec436b864e377 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.463971 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 2b55db060b644f01bd9ec436b864e377 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.464648 15719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b55db060b644f01bd9ec436b864e377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.465256 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b55db060b644f01bd9ec436b864e377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.467157 15718 tablet_service.cc:1511] Processing CreateTablet for tablet 9a81a07de3df43208a6b3b6331e8c158 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.468529 15718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a81a07de3df43208a6b3b6331e8c158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.468632 15717 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.469977 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1ff912bd4f07a795a7bfccb8a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.473224 15568 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.476145 15716 tablet_service.cc:1511] Processing CreateTablet for tablet 69ec834a3b71420c9f09248e41809358 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.477563 15716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ec834a3b71420c9f09248e41809358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.477279 15567 tablet_service.cc:1511] Processing CreateTablet for tablet 69ec834a3b71420c9f09248e41809358 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.463088 15569 tablet_service.cc:1511] Processing CreateTablet for tablet 9a81a07de3df43208a6b3b6331e8c158 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.482252 15565 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.483222 15715 tablet_service.cc:1511] Processing CreateTablet for tablet 88df0ea72a7846ebb2982ffb2d948734 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.484588 15715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88df0ea72a7846ebb2982ffb2d948734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.484459 15564 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5d462c9e4427f934553b90818efd6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.486212 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1ff912bd4f07a795a7bfccb8a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.487098 15714 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.488456 15714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaafafa2c8f482d8b66bb15c3b1b088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.491082 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5d462c9e4427f934553b90818efd6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.492139 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a81a07de3df43208a6b3b6331e8c158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.492446 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5d462c9e4427f934553b90818efd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.495013 15712 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6936bd27314fcb82914d68a6cae45e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.495695 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1128bef1224facb3c1a31e94fb0379 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.496356 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6936bd27314fcb82914d68a6cae45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.496948 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1128bef1224facb3c1a31e94fb0379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.476166 15566 tablet_service.cc:1511] Processing CreateTablet for tablet 88df0ea72a7846ebb2982ffb2d948734 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.501012 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5d462c9e4427f934553b90818efd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.503443 15567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ec834a3b71420c9f09248e41809358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.505671 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88df0ea72a7846ebb2982ffb2d948734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.506312 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaafafa2c8f482d8b66bb15c3b1b088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.507310 15563 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6936bd27314fcb82914d68a6cae45e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.508661 15563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6936bd27314fcb82914d68a6cae45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.508478 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1128bef1224facb3c1a31e94fb0379 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.509742 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1128bef1224facb3c1a31e94fb0379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.515198 15561 tablet_service.cc:1511] Processing CreateTablet for tablet 5de522f1a56b4d09aebf0748d415d7d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.516537 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de522f1a56b4d09aebf0748d415d7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.519095 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 5de522f1a56b4d09aebf0748d415d7d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.520618 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de522f1a56b4d09aebf0748d415d7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.559454 15643 tablet_service.cc:1511] Processing CreateTablet for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:50.560302 15641 tablet_service.cc:1511] Processing CreateTablet for tablet 88df0ea72a7846ebb2982ffb2d948734 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:50.561128 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1ff912bd4f07a795a7bfccb8a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.562688 15640 tablet_service.cc:1511] Processing CreateTablet for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:50.563040 15719 tablet_service.cc:1511] Processing CreateTablet for tablet 4f560ec7039940e59212368b2f12385e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.563359 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 69ec834a3b71420c9f09248e41809358 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:50.565448 15644 tablet_service.cc:1511] Processing CreateTablet for tablet 9a81a07de3df43208a6b3b6331e8c158 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:50.565631 15639 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5d462c9e4427f934553b90818efd6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:50.566593 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88df0ea72a7846ebb2982ffb2d948734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.567378 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 2b55db060b644f01bd9ec436b864e377 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:50.568899 15638 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6936bd27314fcb82914d68a6cae45e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:50.570580 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1128bef1224facb3c1a31e94fb0379 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:50.572748 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 5de522f1a56b4d09aebf0748d415d7d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:50.577488 15711 tablet_service.cc:1511] Processing CreateTablet for tablet a425ca03b12f47b49b434d40007e90b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.586328 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ec834a3b71420c9f09248e41809358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.589735 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de522f1a56b4d09aebf0748d415d7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.586330 15717 tablet_service.cc:1511] Processing CreateTablet for tablet 83d7922f778044c7b5600f9d4024c1b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.593477 15719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f560ec7039940e59212368b2f12385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.611867 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d7922f778044c7b5600f9d4024c1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.621371 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 554babfb4498479a98f58801621b0dac (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.626674 15769 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:50.632380 15568 tablet_service.cc:1511] Processing CreateTablet for tablet a425ca03b12f47b49b434d40007e90b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.633823 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a425ca03b12f47b49b434d40007e90b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.620177 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a425ca03b12f47b49b434d40007e90b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.638167 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaafafa2c8f482d8b66bb15c3b1b088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.642449 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b55db060b644f01bd9ec436b864e377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.605679 15566 tablet_service.cc:1511] Processing CreateTablet for tablet 4f560ec7039940e59212368b2f12385e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.643570 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a81a07de3df43208a6b3b6331e8c158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.643994 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f560ec7039940e59212368b2f12385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.637631 15569 tablet_service.cc:1511] Processing CreateTablet for tablet 83d7922f778044c7b5600f9d4024c1b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.652585 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d7922f778044c7b5600f9d4024c1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.652807 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1128bef1224facb3c1a31e94fb0379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.653605 15564 tablet_service.cc:1511] Processing CreateTablet for tablet 554babfb4498479a98f58801621b0dac (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.654564 15638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6936bd27314fcb82914d68a6cae45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.654907 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554babfb4498479a98f58801621b0dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.657549 15712 tablet_service.cc:1511] Processing CreateTablet for tablet 070f910fe7cf4a4ca2ca43b63d4d997f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.658377 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5d462c9e4427f934553b90818efd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.676680 15563 tablet_service.cc:1511] Processing CreateTablet for tablet 070f910fe7cf4a4ca2ca43b63d4d997f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.686393 15563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070f910fe7cf4a4ca2ca43b63d4d997f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.687278 15718 tablet_service.cc:1511] Processing CreateTablet for tablet 92dd48cf0c9c49d98f7da6f98ac56241 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.689033 15565 tablet_service.cc:1511] Processing CreateTablet for tablet 92dd48cf0c9c49d98f7da6f98ac56241 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.708593 15714 tablet_service.cc:1511] Processing CreateTablet for tablet 9027c3c93a9b4774bba818a406e5e36b (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.721127 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554babfb4498479a98f58801621b0dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.721657 15770 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:50.722402 15714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9027c3c93a9b4774bba818a406e5e36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.728034 15769 tablet_bootstrap.cc:654] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.732131 15564 tablet_service.cc:1511] Processing CreateTablet for tablet a7a0379477ed4600a60cd9fde8f2867a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.734158 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92dd48cf0c9c49d98f7da6f98ac56241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.751628 15644 tablet_service.cc:1511] Processing CreateTablet for tablet a425ca03b12f47b49b434d40007e90b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:50.753003 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a425ca03b12f47b49b434d40007e90b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.755395 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0379477ed4600a60cd9fde8f2867a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.755015 15641 tablet_service.cc:1511] Processing CreateTablet for tablet 4f560ec7039940e59212368b2f12385e (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:50.756402 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f560ec7039940e59212368b2f12385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.756930 15718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92dd48cf0c9c49d98f7da6f98ac56241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.757648 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070f910fe7cf4a4ca2ca43b63d4d997f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.759649 15770 tablet_bootstrap.cc:654] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.766470 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 83d7922f778044c7b5600f9d4024c1b5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:50.768342 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d7922f778044c7b5600f9d4024c1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.771158 15771 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:50.742487 15561 tablet_service.cc:1511] Processing CreateTablet for tablet 9027c3c93a9b4774bba818a406e5e36b (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.775422 15639 tablet_service.cc:1511] Processing CreateTablet for tablet 554babfb4498479a98f58801621b0dac (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:50.827080 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9027c3c93a9b4774bba818a406e5e36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.827208 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554babfb4498479a98f58801621b0dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.827662 15564 tablet_service.cc:1511] Processing CreateTablet for tablet f9377274f9c9482a924840f15b616a13 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.828902 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377274f9c9482a924840f15b616a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.832042 15638 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2176261a314ecdb0b1c0ff764de958 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.833381 15638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2176261a314ecdb0b1c0ff764de958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.791079 15769 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:50.791456 15640 tablet_service.cc:1511] Processing CreateTablet for tablet 070f910fe7cf4a4ca2ca43b63d4d997f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:50.792426 15711 tablet_service.cc:1511] Processing CreateTablet for tablet a7a0379477ed4600a60cd9fde8f2867a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.792881 15717 tablet_service.cc:1511] Processing CreateTablet for tablet 836934bdc16146549eca0b7b8b6f3bbe (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.834893 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070f910fe7cf4a4ca2ca43b63d4d997f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.803413 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 92dd48cf0c9c49d98f7da6f98ac56241 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:50.805017 15643 tablet_service.cc:1511] Processing CreateTablet for tablet 9027c3c93a9b4774bba818a406e5e36b (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:50.836410 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9027c3c93a9b4774bba818a406e5e36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.807631 15566 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2176261a314ecdb0b1c0ff764de958 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.809275 15568 tablet_service.cc:1511] Processing CreateTablet for tablet ab663998de28482d8438f0c594104dd5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.810772 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2176261a314ecdb0b1c0ff764de958 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:50.812170 15642 tablet_service.cc:1511] Processing CreateTablet for tablet a7a0379477ed4600a60cd9fde8f2867a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:50.814788 15710 tablet_service.cc:1511] Processing CreateTablet for tablet ab663998de28482d8438f0c594104dd5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.842900 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab663998de28482d8438f0c594104dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.816964 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 233f2755fc484e7fb202702622c7b652 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.834893 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0379477ed4600a60cd9fde8f2867a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.843891 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f2755fc484e7fb202702622c7b652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.844252 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836934bdc16146549eca0b7b8b6f3bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.844537 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2176261a314ecdb0b1c0ff764de958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.845062 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab663998de28482d8438f0c594104dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.847894 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2176261a314ecdb0b1c0ff764de958. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:50.820739 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:50.823058 15716 tablet_service.cc:1511] Processing CreateTablet for tablet 233f2755fc484e7fb202702622c7b652 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.853075 15771 tablet_bootstrap.cc:654] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.853264 15716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f2755fc484e7fb202702622c7b652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.858662 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92dd48cf0c9c49d98f7da6f98ac56241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.823202 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 836934bdc16146549eca0b7b8b6f3bbe (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.825393 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 836934bdc16146549eca0b7b8b6f3bbe (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:50.863474 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836934bdc16146549eca0b7b8b6f3bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.864696 15769 ts_tablet_manager.cc:1403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.238s	user 0.018s	sys 0.012s
I20260709 13:05:50.867712 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0379477ed4600a60cd9fde8f2867a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.870389 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836934bdc16146549eca0b7b8b6f3bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.883381 15770 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:50.883908 15770 ts_tablet_manager.cc:1403] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.015s
I20260709 13:05:50.884773 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 233f2755fc484e7fb202702622c7b652 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:50.893641 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f2755fc484e7fb202702622c7b652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.888098 15770 raft_consensus.cc:359] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:50.894107 15770 raft_consensus.cc:385] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.893882 15644 tablet_service.cc:1511] Processing CreateTablet for tablet f9377274f9c9482a924840f15b616a13 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.862605 15641 tablet_service.cc:1511] Processing CreateTablet for tablet ab663998de28482d8438f0c594104dd5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:50.894479 15770 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.896092 15770 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:50.890059 15769 raft_consensus.cc:359] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:50.897560 15769 raft_consensus.cc:385] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:50.897962 15769 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:50.898931 15769 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:50.902319 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab663998de28482d8438f0c594104dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.905669 15714 tablet_service.cc:1511] Processing CreateTablet for tablet f9377274f9c9482a924840f15b616a13 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:50.906545 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377274f9c9482a924840f15b616a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.910760 15714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377274f9c9482a924840f15b616a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.912257 15770 ts_tablet_manager.cc:1434] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 13:05:50.912982 15605 heartbeater.cc:499] Master 127.14.34.190:46799 was elected leader, sending a full tablet report...
I20260709 13:05:50.912777 15561 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3913ed9e5b4674a9091483756deadf (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.914088 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3913ed9e5b4674a9091483756deadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.925045 15770 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:50.939917 15770 tablet_bootstrap.cc:654] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:50.951557 15639 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3913ed9e5b4674a9091483756deadf (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.957619 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3913ed9e5b4674a9091483756deadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.976215 15717 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3913ed9e5b4674a9091483756deadf (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:50.977707 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3913ed9e5b4674a9091483756deadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.985868 15565 tablet_service.cc:1511] Processing CreateTablet for tablet f73e75e796664f8198da4aa0a96ea07a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:50.987977 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73e75e796664f8198da4aa0a96ea07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.988373 15640 tablet_service.cc:1511] Processing CreateTablet for tablet f73e75e796664f8198da4aa0a96ea07a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:50.989696 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73e75e796664f8198da4aa0a96ea07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.017364 15769 ts_tablet_manager.cc:1434] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.152s	user 0.031s	sys 0.015s
I20260709 13:05:51.022609 15754 heartbeater.cc:499] Master 127.14.34.190:46799 was elected leader, sending a full tablet report...
I20260709 13:05:51.023046 15776 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.023677 15776 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.024006 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:51.025483 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57eafeb5dcb749c7be00fa4c5e0eae26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.026780 15769 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:51.028620 15710 tablet_service.cc:1511] Processing CreateTablet for tablet f73e75e796664f8198da4aa0a96ea07a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:51.039086 15771 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:51.039815 15771 ts_tablet_manager.cc:1403] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.269s	user 0.037s	sys 0.026s
I20260709 13:05:51.045025 15769 tablet_bootstrap.cc:654] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.056623 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73e75e796664f8198da4aa0a96ea07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.065316 15776 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:51.089622 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:51.091526 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57eafeb5dcb749c7be00fa4c5e0eae26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.056981 15771 raft_consensus.cc:359] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.108011 15771 raft_consensus.cc:385] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.110071 15771 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.111896 15644 tablet_service.cc:1511] Processing CreateTablet for tablet 78b5c231d4c74287b7bcdae567611bea (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.113343 15771 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.115366 15561 tablet_service.cc:1511] Processing CreateTablet for tablet 78b5c231d4c74287b7bcdae567611bea (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.116971 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b5c231d4c74287b7bcdae567611bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.115383 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b5c231d4c74287b7bcdae567611bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.118251 15680 heartbeater.cc:499] Master 127.14.34.190:46799 was elected leader, sending a full tablet report...
I20260709 13:05:51.119539 15770 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:51.120102 15770 ts_tablet_manager.cc:1403] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.195s	user 0.028s	sys 0.050s
I20260709 13:05:51.123499 15770 raft_consensus.cc:359] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.124346 15770 raft_consensus.cc:385] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.124722 15770 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.124521 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 6043256b63964d729edc1a480d265404 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.124823 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 6043256b63964d729edc1a480d265404 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.126295 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6043256b63964d729edc1a480d265404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.126425 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6043256b63964d729edc1a480d265404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.126641 15769 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:51.127255 15769 ts_tablet_manager.cc:1403] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.031s
I20260709 13:05:51.131739 15770 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.134577 15770 ts_tablet_manager.cc:1434] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:05:51.135658 15770 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:51.130555 15769 raft_consensus.cc:359] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:51.138301 15769 raft_consensus.cc:385] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.138690 15769 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.147557 15770 tablet_bootstrap.cc:654] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.147269 15769 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:51.164124 15769 ts_tablet_manager.cc:1434] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:05:51.150142 15716 tablet_service.cc:1511] Processing CreateTablet for tablet 78b5c231d4c74287b7bcdae567611bea (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:51.150334 15714 tablet_service.cc:1511] Processing CreateTablet for tablet 6043256b63964d729edc1a480d265404 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:51.150988 15717 tablet_service.cc:1511] Processing CreateTablet for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:51.155517 15640 tablet_service.cc:1511] Processing CreateTablet for tablet 57649fad66734a1786f0f9c09f4fa317 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:51.167254 15716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b5c231d4c74287b7bcdae567611bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.168916 15771 ts_tablet_manager.cc:1434] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.129s	user 0.012s	sys 0.002s
I20260709 13:05:51.170483 15714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6043256b63964d729edc1a480d265404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.172370 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57649fad66734a1786f0f9c09f4fa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.174728 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57eafeb5dcb749c7be00fa4c5e0eae26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.175438 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 57649fad66734a1786f0f9c09f4fa317 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:51.177172 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57649fad66734a1786f0f9c09f4fa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.181452 15637 tablet_service.cc:1511] Processing CreateTablet for tablet da1e42035c3d46ac90631305fec02672 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.183221 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1e42035c3d46ac90631305fec02672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.182901 15711 tablet_service.cc:1511] Processing CreateTablet for tablet da1e42035c3d46ac90631305fec02672 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.187134 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1e42035c3d46ac90631305fec02672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.192411 15769 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:51.198967 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 57649fad66734a1786f0f9c09f4fa317 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:51.200296 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57649fad66734a1786f0f9c09f4fa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.209717 15783 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.210278 15783 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.195569 15771 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:51.232223 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:51.219208 15783 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.245186 15717 tablet_service.cc:1511] Processing CreateTablet for tablet 361bd26d633f474ba34078d9cf76f22f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.246616 15717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361bd26d633f474ba34078d9cf76f22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.247480 15771 tablet_bootstrap.cc:654] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.254289 15561 tablet_service.cc:1511] Processing CreateTablet for tablet da1e42035c3d46ac90631305fec02672 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:51.255725 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1e42035c3d46ac90631305fec02672. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.260108 15692 leader_election.cc:343] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.259872 15565 tablet_service.cc:1511] Processing CreateTablet for tablet 93645f909b36412c9d021e6d4cb8f9d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.260811 15644 tablet_service.cc:1511] Processing CreateTablet for tablet 361bd26d633f474ba34078d9cf76f22f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.261199 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93645f909b36412c9d021e6d4cb8f9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.270156 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361bd26d633f474ba34078d9cf76f22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.270385 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 93645f909b36412c9d021e6d4cb8f9d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.271692 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93645f909b36412c9d021e6d4cb8f9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.275069 15562 tablet_service.cc:1511] Processing CreateTablet for tablet c036f4b115e847feb37d916989af7159 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.277596 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036f4b115e847feb37d916989af7159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.277539 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 93645f909b36412c9d021e6d4cb8f9d5 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:51.279022 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93645f909b36412c9d021e6d4cb8f9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.277966 15774 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.282279 15774 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.300978 15639 tablet_service.cc:1511] Processing CreateTablet for tablet c036f4b115e847feb37d916989af7159 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.304226 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036f4b115e847feb37d916989af7159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.303953 15566 tablet_service.cc:1511] Processing CreateTablet for tablet 8652a740787d4ef6a541ee7ee4b5a7c0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.305604 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652a740787d4ef6a541ee7ee4b5a7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.306221 15774 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.307016 15716 tablet_service.cc:1511] Processing CreateTablet for tablet c036f4b115e847feb37d916989af7159 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:51.308696 15716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036f4b115e847feb37d916989af7159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.313582 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 8652a740787d4ef6a541ee7ee4b5a7c0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.314949 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652a740787d4ef6a541ee7ee4b5a7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.314867 15568 tablet_service.cc:1511] Processing CreateTablet for tablet 692cb3906e474706ae13f98e2b050415 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.316192 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692cb3906e474706ae13f98e2b050415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.325546 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 8652a740787d4ef6a541ee7ee4b5a7c0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:51.325879 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 361bd26d633f474ba34078d9cf76f22f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:51.326924 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8652a740787d4ef6a541ee7ee4b5a7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.327227 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361bd26d633f474ba34078d9cf76f22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.332851 15643 tablet_service.cc:1511] Processing CreateTablet for tablet 692cb3906e474706ae13f98e2b050415 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.334214 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692cb3906e474706ae13f98e2b050415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.341116 15769 tablet_bootstrap.cc:654] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.350840 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:51.351576 15580 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:51.352979 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:51.353853 15783 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.354212 15783 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.354532 15783 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.361060 15783 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.368709 15712 tablet_service.cc:1511] Processing CreateTablet for tablet 692cb3906e474706ae13f98e2b050415 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:51.370498 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692cb3906e474706ae13f98e2b050415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.373836 15776 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.374333 15776 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:51.377635 15776 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:51.381172 15771 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:51.381664 15771 ts_tablet_manager.cc:1403] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.212s	user 0.015s	sys 0.002s
I20260709 13:05:51.382520 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:51.384219 15692 leader_election.cc:343] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.387279 15770 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:51.387768 15770 ts_tablet_manager.cc:1403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.252s	user 0.028s	sys 0.007s
I20260709 13:05:51.393164 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:51.394697 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:51.396178 15693 leader_election.cc:343] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.396719 15693 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:51.398833 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:51.399410 15580 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.400344 15776 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:51.401201 15693 leader_election.cc:343] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.401713 15693 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:51.403003 15776 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.405875 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:51.406627 15580 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:51.407819 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:51.408875 15784 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:51.415721 15783 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.419154 15564 tablet_service.cc:1511] Processing CreateTablet for tablet f3f2e1d93d5244bb997f6e208e9bbc20 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.420476 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f2e1d93d5244bb997f6e208e9bbc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.422962 15718 tablet_service.cc:1511] Processing CreateTablet for tablet f3f2e1d93d5244bb997f6e208e9bbc20 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.424348 15718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f2e1d93d5244bb997f6e208e9bbc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.432076 15770 raft_consensus.cc:359] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.432878 15770 raft_consensus.cc:385] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.433276 15770 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.437041 15784 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:51.438805 15784 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.445628 15714 tablet_service.cc:1511] Processing CreateTablet for tablet dfa9aad2b798480db18c5b0e3bac6a57 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.446355 15769 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:51.446945 15769 ts_tablet_manager.cc:1403] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.281s	user 0.007s	sys 0.011s
I20260709 13:05:51.447057 15714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa9aad2b798480db18c5b0e3bac6a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.458429 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:51.462574 15771 raft_consensus.cc:359] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.463339 15771 raft_consensus.cc:385] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.463615 15771 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.464257 15771 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.466969 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7baa38cef34b39ab9d39592b319ba3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:51.468225 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7baa38cef34b39ab9d39592b319ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.468075 15569 tablet_service.cc:1511] Processing CreateTablet for tablet 8291273c09814d929a78b8c6da15ad25 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.469671 15566 tablet_service.cc:1511] Processing CreateTablet for tablet 6a514609784146e8a8b6917d543f83e7 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.474380 15771 ts_tablet_manager.cc:1434] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.004s
I20260709 13:05:51.475024 15563 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7baa38cef34b39ab9d39592b319ba3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:51.487061 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd8c2b67a6b46399004625b89edc3ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:51.489522 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd8c2b67a6b46399004625b89edc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.492413 15568 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd8c2b67a6b46399004625b89edc3ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:51.493669 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd8c2b67a6b46399004625b89edc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.480180 15561 tablet_service.cc:1511] Processing CreateTablet for tablet dfa9aad2b798480db18c5b0e3bac6a57 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.480947 15769 raft_consensus.cc:359] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.494853 15769 raft_consensus.cc:385] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.495167 15769 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
W20260709 13:05:51.483006 15619 leader_election.cc:343] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.481894 15567 tablet_service.cc:1511] Processing CreateTablet for tablet 40c2674fd9d04c0fb406ca8f6eef4025 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.484813 15719 tablet_service.cc:1511] Processing CreateTablet for tablet 8291273c09814d929a78b8c6da15ad25 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.495618 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 7e251fb313da4e75911104bd3aedca42 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:51.496160 15769 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.486428 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 6a514609784146e8a8b6917d543f83e7 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.496711 15719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291273c09814d929a78b8c6da15ad25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.497574 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a514609784146e8a8b6917d543f83e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.498123 15567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c2674fd9d04c0fb406ca8f6eef4025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.498663 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a514609784146e8a8b6917d543f83e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.485082 15715 tablet_service.cc:1511] Processing CreateTablet for tablet 40c2674fd9d04c0fb406ca8f6eef4025 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.499739 15715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c2674fd9d04c0fb406ca8f6eef4025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.502319 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa9aad2b798480db18c5b0e3bac6a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.502919 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e251fb313da4e75911104bd3aedca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.503494 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291273c09814d929a78b8c6da15ad25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.507261 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9faf7687b644b6871b03c7adb9f3e3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.508554 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9faf7687b644b6871b03c7adb9f3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.510125 15563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7baa38cef34b39ab9d39592b319ba3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.514703 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 63710us
I20260709 13:05:51.522289 15769 ts_tablet_manager.cc:1434] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.004s
I20260709 13:05:51.522699 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 6a514609784146e8a8b6917d543f83e7 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:51.523495 15769 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:51.524212 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a514609784146e8a8b6917d543f83e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.526983 15771 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:51.534790 15640 tablet_service.cc:1511] Processing CreateTablet for tablet f3f2e1d93d5244bb997f6e208e9bbc20 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:51.535305 15771 tablet_bootstrap.cc:654] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.539892 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:51.536052 15477 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:51.546455 15544 leader_election.cc:343] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.547137 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 7e251fb313da4e75911104bd3aedca42 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:51.550772 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e251fb313da4e75911104bd3aedca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.552330 15639 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7baa38cef34b39ab9d39592b319ba3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:51.552613 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 8291273c09814d929a78b8c6da15ad25 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:51.554585 15644 tablet_service.cc:1511] Processing CreateTablet for tablet 40c2674fd9d04c0fb406ca8f6eef4025 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:51.554886 15641 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd8c2b67a6b46399004625b89edc3ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:05:51.556635 15619 leader_election.cc:343] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.556758 15638 tablet_service.cc:1511] Processing CreateTablet for tablet 7e251fb313da4e75911104bd3aedca42 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:51.561776 15565 tablet_service.cc:1511] Processing CreateTablet for tablet 2b413aeb892643a1af655defc3b03c4d (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.569151 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b413aeb892643a1af655defc3b03c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.572105 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 2b413aeb892643a1af655defc3b03c4d (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.562412 15718 tablet_service.cc:1511] Processing CreateTablet for tablet 2b413aeb892643a1af655defc3b03c4d (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:51.565850 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291273c09814d929a78b8c6da15ad25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.577221 15638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e251fb313da4e75911104bd3aedca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.579669 15563 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9faf7687b644b6871b03c7adb9f3e3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.580993 15563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9faf7687b644b6871b03c7adb9f3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.581154 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 363fa81d735347758e73efea5dc3fae6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.582386 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c2674fd9d04c0fb406ca8f6eef4025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.582787 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363fa81d735347758e73efea5dc3fae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.456354 15770 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.591537 15712 tablet_service.cc:1511] Processing CreateTablet for tablet 363fa81d735347758e73efea5dc3fae6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.594476 15564 tablet_service.cc:1511] Processing CreateTablet for tablet 0eba092a851143659b8e87e62bb71b1c (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.599810 15636 tablet_service.cc:1511] Processing CreateTablet for tablet dfa9aad2b798480db18c5b0e3bac6a57 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:51.602293 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f2e1d93d5244bb997f6e208e9bbc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.603106 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7baa38cef34b39ab9d39592b319ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.606374 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b413aeb892643a1af655defc3b03c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.607088 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd8c2b67a6b46399004625b89edc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.607679 15565 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.611922 15770 ts_tablet_manager.cc:1434] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.224s	user 0.007s	sys 0.002s
I20260709 13:05:51.614830 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa9aad2b798480db18c5b0e3bac6a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.615890 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:51.617142 15544 leader_election.cc:343] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.617565 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:51.620195 15774 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.624948 15713 tablet_service.cc:1511] Processing CreateTablet for tablet 0eba092a851143659b8e87e62bb71b1c (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.626852 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eba092a851143659b8e87e62bb71b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.630458 15770 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:51.638877 15643 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9faf7687b644b6871b03c7adb9f3e3 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:51.640787 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.641335 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9faf7687b644b6871b03c7adb9f3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.645120 15645 tablet_service.cc:1511] Processing CreateTablet for tablet 363fa81d735347758e73efea5dc3fae6 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:51.636191 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363fa81d735347758e73efea5dc3fae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.635237 15769 tablet_bootstrap.cc:654] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.639900 15719 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.655259 15719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.639837 15567 tablet_service.cc:1511] Processing CreateTablet for tablet dd80b5819c634a02a3dd8e2d112db507 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.658865 15639 tablet_service.cc:1511] Processing CreateTablet for tablet 0eba092a851143659b8e87e62bb71b1c (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:51.659291 15567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80b5819c634a02a3dd8e2d112db507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.659595 15771 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:51.660075 15771 ts_tablet_manager.cc:1403] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.004s
I20260709 13:05:51.662344 15718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b413aeb892643a1af655defc3b03c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.660099 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eba092a851143659b8e87e62bb71b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.680943 15711 tablet_service.cc:1511] Processing CreateTablet for tablet dd80b5819c634a02a3dd8e2d112db507 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.683614 15784 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.684150 15784 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.687320 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:51.688884 15618 leader_election.cc:343] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.686229 15564 tablet_service.cc:1511] Processing CreateTablet for tablet e25768ee42b44e978e9d8764ecd10199 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.680894 15771 raft_consensus.cc:359] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.695340 15771 raft_consensus.cc:385] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.695683 15771 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.690356 15784 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.696395 15771 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.697705 15715 tablet_service.cc:1511] Processing CreateTablet for tablet e25768ee42b44e978e9d8764ecd10199 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.698683 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:51.699868 15771 ts_tablet_manager.cc:1434] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:05:51.703830 15564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25768ee42b44e978e9d8764ecd10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.704305 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eba092a851143659b8e87e62bb71b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.706283 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80b5819c634a02a3dd8e2d112db507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.708333 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:51.709131 15715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25768ee42b44e978e9d8764ecd10199. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.712447 15619 leader_election.cc:343] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.713114 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:51.716578 15784 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.717522 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363fa81d735347758e73efea5dc3fae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.719810 15771 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:51.714267 15769 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:51.721961 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.721182 15769 ts_tablet_manager.cc:1403] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.198s	user 0.024s	sys 0.009s
W20260709 13:05:51.758693 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46296.6us
I20260709 13:05:51.765194 15769 raft_consensus.cc:359] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.766103 15769 raft_consensus.cc:385] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:51.766897 15769 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:51.771354 15769 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.794486 15769 ts_tablet_manager.cc:1434] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:05:51.799080 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3d9415f6fb48709a2c4782cbf5ed31 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.800472 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3d9415f6fb48709a2c4782cbf5ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.802490 15770 tablet_bootstrap.cc:654] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.802726 15771 tablet_bootstrap.cc:654] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.806187 15568 tablet_service.cc:1511] Processing CreateTablet for tablet 8d98a5c01953408b8ad3eb550494fbf2 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.807507 15769 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:51.812100 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d98a5c01953408b8ad3eb550494fbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.766178 15569 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3d9415f6fb48709a2c4782cbf5ed31 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.828482 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 8d98a5c01953408b8ad3eb550494fbf2 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.830152 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3d9415f6fb48709a2c4782cbf5ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.830312 15570 tablet_service.cc:1511] Processing CreateTablet for tablet 78adb81d1456468f8ad75e99085c54ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.832041 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d98a5c01953408b8ad3eb550494fbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.831517 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78adb81d1456468f8ad75e99085c54ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.837456 15710 tablet_service.cc:1511] Processing CreateTablet for tablet 78adb81d1456468f8ad75e99085c54ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.846136 15710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78adb81d1456468f8ad75e99085c54ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.848266 15774 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.848760 15774 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.850908 15774 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.853183 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:51.864212 15711 tablet_service.cc:1511] Processing CreateTablet for tablet 796cbc2fdf89418ea0827815b500d50a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:51.865229 15711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cbc2fdf89418ea0827815b500d50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.857621 15776 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.866168 15776 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.868199 15776 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:51.867553 15639 tablet_service.cc:1511] Processing CreateTablet for tablet dd80b5819c634a02a3dd8e2d112db507 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:51.858274 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:51.875006 15544 leader_election.cc:343] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.908473 15729 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:51.912010 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:51.912793 15774 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:51.913157 15774 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.913471 15774 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:51.916424 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:51.918377 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:51.930308 15619 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:51.931049 15693 leader_election.cc:343] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.931908 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:51.932272 15636 tablet_service.cc:1511] Processing CreateTablet for tablet 4b3d9415f6fb48709a2c4782cbf5ed31 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:51.934130 15562 tablet_service.cc:1511] Processing CreateTablet for tablet 796cbc2fdf89418ea0827815b500d50a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:51.935480 15562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cbc2fdf89418ea0827815b500d50a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:51.933697 15692 leader_election.cc:343] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.936196 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:51.934074 15561 tablet_service.cc:1511] Processing CreateTablet for tablet a96efb5d87b14ca19297799c72e797f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:51.937429 15776 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:51.941462 15644 tablet_service.cc:1511] Processing CreateTablet for tablet e25768ee42b44e978e9d8764ecd10199 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:51.942664 15712 tablet_service.cc:1511] Processing CreateTablet for tablet a96efb5d87b14ca19297799c72e797f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:51.943972 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96efb5d87b14ca19297799c72e797f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.943928 15567 tablet_service.cc:1511] Processing CreateTablet for tablet 89f37c80078841efa574af907a802c86 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:51.943681 15637 tablet_service.cc:1511] Processing CreateTablet for tablet 78adb81d1456468f8ad75e99085c54ba (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:51.945839 15642 tablet_service.cc:1511] Processing CreateTablet for tablet 796cbc2fdf89418ea0827815b500d50a (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:51.948537 15638 tablet_service.cc:1511] Processing CreateTablet for tablet a96efb5d87b14ca19297799c72e797f0 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:51.955277 15567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f37c80078841efa574af907a802c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.963723 15718 tablet_service.cc:1511] Processing CreateTablet for tablet 89f37c80078841efa574af907a802c86 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:51.964823 15569 tablet_service.cc:1511] Processing CreateTablet for tablet b42acde8d7184571acdbe8d34af2df1f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:51.965699 15769 tablet_bootstrap.cc:654] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:51.966122 15561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96efb5d87b14ca19297799c72e797f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.936215 15641 tablet_service.cc:1511] Processing CreateTablet for tablet 8d98a5c01953408b8ad3eb550494fbf2 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:51.938371 15639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80b5819c634a02a3dd8e2d112db507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.969660 15637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78adb81d1456468f8ad75e99085c54ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.965247 15718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f37c80078841efa574af907a802c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.964180 15640 tablet_service.cc:1511] Processing CreateTablet for tablet 89f37c80078841efa574af907a802c86 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:51.950014 15774 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:51.977741 15566 tablet_service.cc:1511] Processing CreateTablet for tablet c7551fe74b4949e1b7ca08793d185c8f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:51.978374 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42acde8d7184571acdbe8d34af2df1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.978199 15713 tablet_service.cc:1511] Processing CreateTablet for tablet b42acde8d7184571acdbe8d34af2df1f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:51.979225 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7551fe74b4949e1b7ca08793d185c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.979481 15713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42acde8d7184571acdbe8d34af2df1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.978199 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25768ee42b44e978e9d8764ecd10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.977797 15774 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:51.985188 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:51.987195 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:05:51.991626 15544 leader_election.cc:343] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:51.991626 15729 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:51.992322 15565 tablet_service.cc:1511] Processing CreateTablet for tablet b1059a62c94747b0b296ee50ba126991 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:51.993661 15565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1059a62c94747b0b296ee50ba126991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:51.994988 15771 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:51.995471 15771 ts_tablet_manager.cc:1403] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.276s	user 0.037s	sys 0.021s
I20260709 13:05:52.000978 15729 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:52.002393 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:51.995502 15770 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.003720 15770 ts_tablet_manager.cc:1403] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.373s	user 0.011s	sys 0.004s
I20260709 13:05:52.006651 15770 raft_consensus.cc:359] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.007416 15770 raft_consensus.cc:385] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.007707 15770 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.008452 15774 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.009418 15770 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.010186 15712 tablet_service.cc:1511] Processing CreateTablet for tablet c7551fe74b4949e1b7ca08793d185c8f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:52.014552 15715 tablet_service.cc:1511] Processing CreateTablet for tablet b1059a62c94747b0b296ee50ba126991 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:52.018851 15715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1059a62c94747b0b296ee50ba126991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.019702 15771 raft_consensus.cc:359] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.020634 15771 raft_consensus.cc:385] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.020990 15771 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.021895 15771 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.024791 15771 ts_tablet_manager.cc:1434] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:52.027056 15771 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.030119 15636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b3d9415f6fb48709a2c4782cbf5ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.030783 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796cbc2fdf89418ea0827815b500d50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.034574 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d98a5c01953408b8ad3eb550494fbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.039469 15784 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.045439 15784 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.047570 15784 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.049098 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.049731 15580 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:52.049589 15643 tablet_service.cc:1511] Processing CreateTablet for tablet b42acde8d7184571acdbe8d34af2df1f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:52.050240 15638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96efb5d87b14ca19297799c72e797f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.050942 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42acde8d7184571acdbe8d34af2df1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.051009 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.052054 15640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f37c80078841efa574af907a802c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.052997 15645 tablet_service.cc:1511] Processing CreateTablet for tablet c7551fe74b4949e1b7ca08793d185c8f (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:52.058223 15784 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.058643 15784 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.058996 15784 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.087044 15784 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.058254 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7551fe74b4949e1b7ca08793d185c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.091239 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.095096 15729 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:52.089963 15774 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:52.098999 15774 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.102460 15712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7551fe74b4949e1b7ca08793d185c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.132834 15477 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.154634 15644 tablet_service.cc:1511] Processing CreateTablet for tablet b1059a62c94747b0b296ee50ba126991 (DEFAULT_TABLE table=test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:52.155450 15808 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.156086 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1059a62c94747b0b296ee50ba126991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.155968 15808 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.157802 15808 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.158593 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.158890 15784 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:52.160697 15618 leader_election.cc:343] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.161509 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:52.162066 15580 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.163481 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.165545 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:52.166126 15729 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.166836 15769 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.167299 15769 ts_tablet_manager.cc:1403] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.360s	user 0.015s	sys 0.019s
I20260709 13:05:52.168938 15580 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:52.170203 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.171092 15784 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.171594 15784 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:52.172736 15729 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:52.172401 15784 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:52.174443 15619 leader_election.cc:343] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.174829 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:52.175477 15808 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.181892 15809 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.190390 15770 ts_tablet_manager.cc:1434] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.186s	user 0.026s	sys 0.019s
I20260709 13:05:52.191504 15770 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.202780 15770 tablet_bootstrap.cc:654] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.204890 15771 tablet_bootstrap.cc:654] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.196333 15769 raft_consensus.cc:359] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.209170 15769 raft_consensus.cc:385] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.209607 15769 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.237890 15476 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.242517 15769 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.244819 15769 ts_tablet_manager.cc:1434] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.002s
I20260709 13:05:52.252081 15769 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.259197 15770 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.259793 15770 ts_tablet_manager.cc:1403] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.021s
I20260709 13:05:52.262452 15769 tablet_bootstrap.cc:654] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.262746 15770 raft_consensus.cc:359] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.263525 15770 raft_consensus.cc:385] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.263857 15770 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.263935 15771 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.264674 15771 ts_tablet_manager.cc:1403] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.239s	user 0.015s	sys 0.019s
I20260709 13:05:52.264742 15770 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.275643 15776 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.276175 15776 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.279583 15770 ts_tablet_manager.cc:1434] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:05:52.280903 15770 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.281652 15806 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.282003 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.282718 15580 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.282384 15806 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.284144 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.289861 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.290187 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.291531 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:52.291893 15544 leader_election.cc:343] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.292385 15655 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:52.292683 15806 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.294417 15771 raft_consensus.cc:359] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.295068 15771 raft_consensus.cc:385] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.295342 15771 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.296006 15771 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.297819 15771 ts_tablet_manager.cc:1434] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.000s
W20260709 13:05:52.300248 15693 leader_election.cc:343] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.287694 15776 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.302070 15776 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.302448 15776 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.302774 15776 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.303737 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:52.303958 15769 tablet_bootstrap.cc:492] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.304041 15771 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.304515 15769 ts_tablet_manager.cc:1403] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.015s
I20260709 13:05:52.306208 15806 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.306670 15806 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.309608 15806 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.307540 15769 raft_consensus.cc:359] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.311411 15769 raft_consensus.cc:385] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.311846 15769 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.312723 15769 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.315362 15769 ts_tablet_manager.cc:1434] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:05:52.316360 15769 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.309688 15776 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.321852 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:52.322794 15579 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.323333 15806 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.323832 15769 tablet_bootstrap.cc:654] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.324327 15809 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.324817 15809 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.325556 15771 tablet_bootstrap.cc:654] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.327096 15809 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.328999 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.330072 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.330302 15770 tablet_bootstrap.cc:654] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.331318 15579 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
W20260709 13:05:52.331679 15618 leader_election.cc:343] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:52.332602 15619 leader_election.cc:343] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.332543 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.333153 15619 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:52.334518 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:52.335191 15655 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.334406 15776 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.336050 15776 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.336437 15776 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:52.337066 15776 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.339020 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:52.335306 15809 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:52.342546 15693 leader_election.cc:343] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.352522 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:52.353428 15729 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.358189 15806 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.363477 15655 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:52.365187 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.366546 15806 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.368140 15806 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:52.369247 15806 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.372526 15770 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.373027 15770 ts_tablet_manager.cc:1403] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.005s
I20260709 13:05:52.375244 15729 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:52.375830 15770 raft_consensus.cc:359] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.376569 15770 raft_consensus.cc:385] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.376847 15770 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.377688 15770 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.380445 15770 ts_tablet_manager.cc:1434] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:52.381160 15769 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.381506 15770 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.381697 15769 ts_tablet_manager.cc:1403] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.027s
I20260709 13:05:52.384624 15769 raft_consensus.cc:359] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.385403 15769 raft_consensus.cc:385] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.385749 15769 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.386579 15769 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.388293 15771 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.388720 15771 ts_tablet_manager.cc:1403] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.017s
I20260709 13:05:52.389099 15769 ts_tablet_manager.cc:1434] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:52.390200 15769 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.391335 15771 raft_consensus.cc:359] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.392076 15771 raft_consensus.cc:385] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.392428 15771 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.393353 15771 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.395527 15770 tablet_bootstrap.cc:654] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.389329 15475 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.397256 15769 tablet_bootstrap.cc:654] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.406597 15771 ts_tablet_manager.cc:1434] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:05:52.407004 15477 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.418270 15771 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.433352 15771 tablet_bootstrap.cc:654] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.434991 15776 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.435506 15776 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.438061 15776 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.438665 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.439364 15579 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.440091 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.440887 15655 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.442102 15693 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:52.442934 15776 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.443140 15770 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.443337 15776 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.443745 15770 ts_tablet_manager.cc:1403] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.062s	user 0.032s	sys 0.018s
I20260709 13:05:52.443717 15776 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.444695 15769 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.445089 15769 ts_tablet_manager.cc:1403] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.023s
I20260709 13:05:52.446964 15769 raft_consensus.cc:359] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.447458 15769 raft_consensus.cc:385] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.447036 15770 raft_consensus.cc:359] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.447685 15769 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.447906 15770 raft_consensus.cc:385] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.448292 15770 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.448369 15769 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.449226 15770 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.450186 15769 ts_tablet_manager.cc:1434] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:52.451328 15769 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.451797 15770 ts_tablet_manager.cc:1434] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:52.452833 15770 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.453727 15776 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.457088 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:52.457830 15769 tablet_bootstrap.cc:654] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.457731 15655 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.459149 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:52.459457 15770 tablet_bootstrap.cc:654] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.459743 15579 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.467183 15579 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:52.468120 15771 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.468377 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.468809 15771 ts_tablet_manager.cc:1403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.003s
I20260709 13:05:52.469448 15818 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.472776 15771 raft_consensus.cc:359] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.475237 15655 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:52.458194 15776 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.473770 15771 raft_consensus.cc:385] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.478536 15771 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.480322 15806 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.479538 15771 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.480822 15806 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.482685 15771 ts_tablet_manager.cc:1434] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:05:52.482946 15806 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.485014 15818 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:52.485491 15771 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.485873 15818 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.487879 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.489936 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.490558 15655 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:52.491113 15769 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.491562 15769 ts_tablet_manager.cc:1403] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.001s
W20260709 13:05:52.491514 15544 leader_election.cc:343] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.493067 15771 tablet_bootstrap.cc:654] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.494836 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:52.495137 15769 raft_consensus.cc:359] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.495820 15769 raft_consensus.cc:385] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.495952 15806 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.496119 15769 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.496424 15806 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.496598 15770 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.496827 15806 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.497148 15770 ts_tablet_manager.cc:1403] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.015s
I20260709 13:05:52.496881 15769 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.498937 15769 ts_tablet_manager.cc:1434] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:05:52.499792 15769 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.500052 15770 raft_consensus.cc:359] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.500728 15770 raft_consensus.cc:385] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.501049 15770 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.501835 15770 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.506870 15769 tablet_bootstrap.cc:654] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.508818 15770 ts_tablet_manager.cc:1434] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:52.509930 15770 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.511478 15806 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.514226 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:52.513839 15475 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:52.514779 15655 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.523823 15806 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.525040 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:52.524392 15806 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.525662 15655 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
W20260709 13:05:52.527330 15544 leader_election.cc:343] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.528239 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:52.534956 15806 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.535743 15806 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:52.536839 15806 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.538928 15770 tablet_bootstrap.cc:654] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.544706 15771 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.545264 15771 ts_tablet_manager.cc:1403] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.010s
I20260709 13:05:52.549460 15769 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.549113 15771 raft_consensus.cc:359] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.549983 15769 ts_tablet_manager.cc:1403] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.017s
I20260709 13:05:52.550103 15771 raft_consensus.cc:385] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.550423 15771 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.552012 15770 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.552563 15769 raft_consensus.cc:359] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.553188 15769 raft_consensus.cc:385] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.553435 15769 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.553923 15770 ts_tablet_manager.cc:1403] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.002s
I20260709 13:05:52.554090 15769 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.555980 15769 ts_tablet_manager.cc:1434] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:52.556409 15770 raft_consensus.cc:359] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.556843 15769 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.557018 15770 raft_consensus.cc:385] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.557287 15770 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.557957 15770 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.558306 15655 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.560133 15770 ts_tablet_manager.cc:1434] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:52.563784 15770 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.564524 15769 tablet_bootstrap.cc:654] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.565349 15476 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.569599 15770 tablet_bootstrap.cc:654] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.576859 15769 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.577332 15770 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.577394 15769 ts_tablet_manager.cc:1403] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 13:05:52.577844 15770 ts_tablet_manager.cc:1403] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:05:52.551481 15771 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.580670 15769 raft_consensus.cc:359] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.581404 15769 raft_consensus.cc:385] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.581744 15769 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.582392 15771 ts_tablet_manager.cc:1434] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:05:52.582576 15769 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.583302 15771 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.585088 15769 ts_tablet_manager.cc:1434] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:05:52.586010 15769 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.588428 15771 tablet_bootstrap.cc:654] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.580410 15770 raft_consensus.cc:359] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.590215 15770 raft_consensus.cc:385] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.590509 15770 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.591516 15769 tablet_bootstrap.cc:654] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.591185 15770 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.593138 15770 ts_tablet_manager.cc:1434] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.003s
I20260709 13:05:52.594307 15770 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.599893 15770 tablet_bootstrap.cc:654] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.616844 15806 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.618762 15770 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.619279 15770 ts_tablet_manager.cc:1403] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.009s
I20260709 13:05:52.620501 15771 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.620985 15771 ts_tablet_manager.cc:1403] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 13:05:52.621057 15769 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.621630 15769 ts_tablet_manager.cc:1403] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 13:05:52.623209 15770 raft_consensus.cc:359] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.623399 15771 raft_consensus.cc:359] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.623917 15770 raft_consensus.cc:385] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.623965 15771 raft_consensus.cc:385] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.624327 15771 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.624281 15770 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.625238 15770 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.625499 15769 raft_consensus.cc:359] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.627286 15769 raft_consensus.cc:385] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.627588 15769 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.627955 15770 ts_tablet_manager.cc:1434] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:52.625245 15771 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.628316 15769 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.629819 15771 ts_tablet_manager.cc:1434] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:52.630678 15769 ts_tablet_manager.cc:1434] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:52.631181 15770 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.632863 15818 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.633337 15818 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.634753 15771 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.635471 15818 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.636397 15769 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.637100 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.637974 15654 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:52.638901 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.641217 15771 tablet_bootstrap.cc:654] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.641106 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:52.643028 15769 tablet_bootstrap.cc:654] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.644840 15770 tablet_bootstrap.cc:654] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.646970 15818 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.659369 15818 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:52.660609 15771 tablet_bootstrap.cc:492] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.661123 15771 ts_tablet_manager.cc:1403] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.010s
I20260709 13:05:52.662498 15769 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.662957 15769 ts_tablet_manager.cc:1403] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:05:52.663440 15771 raft_consensus.cc:359] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.663982 15771 raft_consensus.cc:385] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.664198 15771 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.664791 15771 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.665519 15769 raft_consensus.cc:359] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.666198 15769 raft_consensus.cc:385] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.666486 15769 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.667845 15770 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.667446 15769 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.668413 15770 ts_tablet_manager.cc:1403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:05:52.669831 15769 ts_tablet_manager.cc:1434] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:52.671173 15769 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.671296 15770 raft_consensus.cc:359] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.672101 15770 raft_consensus.cc:385] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.672439 15770 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.673103 15770 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.675420 15770 ts_tablet_manager.cc:1434] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:52.676364 15770 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.677961 15769 tablet_bootstrap.cc:654] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.678689 15771 ts_tablet_manager.cc:1434] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:05:52.682425 15770 tablet_bootstrap.cc:654] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.690953 15771 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.695324 15770 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.695952 15770 ts_tablet_manager.cc:1403] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:05:52.698541 15771 tablet_bootstrap.cc:654] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.699045 15770 raft_consensus.cc:359] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.699862 15770 raft_consensus.cc:385] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.700186 15770 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.701084 15770 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.703182 15770 ts_tablet_manager.cc:1434] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:52.703999 15769 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.704483 15769 ts_tablet_manager.cc:1403] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 13:05:52.704651 15770 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.705757 15771 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.706321 15771 ts_tablet_manager.cc:1403] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:05:52.707137 15769 raft_consensus.cc:359] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.707849 15769 raft_consensus.cc:385] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.708117 15769 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.708770 15769 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.709522 15771 raft_consensus.cc:359] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.710305 15771 raft_consensus.cc:385] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.710713 15771 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.711086 15769 ts_tablet_manager.cc:1434] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:52.711803 15770 tablet_bootstrap.cc:654] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.711651 15771 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.712210 15769 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.718238 15769 tablet_bootstrap.cc:654] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.718366 15806 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.718832 15806 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.723836 15770 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.723547 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.721004 15806 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.724318 15770 ts_tablet_manager.cc:1403] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:05:52.724224 15771 ts_tablet_manager.cc:1434] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:05:52.725751 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.726339 15728 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
W20260709 13:05:52.727293 15544 leader_election.cc:343] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:52.728034 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:52.729106 15806 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.725745 15771 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.729485 15806 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.729830 15806 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.732309 15770 raft_consensus.cc:359] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.733045 15770 raft_consensus.cc:385] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.733326 15770 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.734000 15770 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.736379 15770 ts_tablet_manager.cc:1434] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:05:52.736908 15771 tablet_bootstrap.cc:654] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.737457 15770 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:52.741250 15806 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.742203 15809 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.742714 15809 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.744135 15770 tablet_bootstrap.cc:654] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.744624 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:52.744861 15809 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.745358 15728 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.747154 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.747835 15579 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:52.749611 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.751874 15784 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.751762 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.752399 15784 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.752777 15784 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.752725 15729 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:52.756047 15818 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.759752 15769 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:52.760486 15784 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.763434 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:52.764017 15580 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.766549 15807 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:52.771278 15728 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:52.771422 15580 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:52.772509 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.773646 15809 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.774268 15809 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:52.775316 15809 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.772509 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:52.782513 15808 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.783288 15807 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.783769 15807 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:52.784597 15807 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.792055 15774 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.792740 15774 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.760488 15769 ts_tablet_manager.cc:1403] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.007s
I20260709 13:05:52.795352 15774 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.796064 15774 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.796669 15774 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.798797 15808 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:52.804781 15774 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.806752 15784 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.806972 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:52.807579 15729 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.797484 15769 raft_consensus.cc:359] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.814476 15769 raft_consensus.cc:385] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.814850 15769 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.815812 15769 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.818508 15771 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:52.819000 15771 ts_tablet_manager.cc:1403] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.028s
I20260709 13:05:52.821681 15771 raft_consensus.cc:359] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.822355 15771 raft_consensus.cc:385] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.822604 15771 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.823215 15771 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } }
I20260709 13:05:52.825155 15771 ts_tablet_manager.cc:1434] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:52.825996 15771 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:52.829208 15828 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.832963 15769 ts_tablet_manager.cc:1434] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:05:52.834214 15769 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:52.829696 15828 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.836330 15654 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.842654 15828 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.846948 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.848330 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.845963 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.849823 15578 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.850003 15693 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:52.852411 15828 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.852914 15828 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.853322 15828 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.845954 15806 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.873970 15818 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.874693 15818 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.878819 15818 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:52.878758 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:52.880015 15653 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.880141 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.880923 15578 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:52.881795 15693 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:52.889739 15828 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.884754 15818 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:52.942631 15769 tablet_bootstrap.cc:654] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.947348 15861 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.947479 15784 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.948028 15784 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.947894 15861 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.950556 15861 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.952373 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.952545 15784 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:52.953495 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:52.954361 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.916574 15818 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.959013 15770 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:52.959671 15770 ts_tablet_manager.cc:1403] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.018s
I20260709 13:05:52.943558 15776 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.960151 15818 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.958699 15727 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:52.984293 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:52.966660 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:05:52.989840 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:52.962529 15776 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.000676 15770 raft_consensus.cc:359] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:52.990556 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:52.995118 15580 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.001868 15770 raft_consensus.cc:385] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.005064 15770 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.007462 15770 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.009497 15859 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.087685 15771 tablet_bootstrap.cc:654] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.085321 15828 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.065917 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.017863 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.058166 15770 ts_tablet_manager.cc:1434] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 13:05:53.094897 15807 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.035259 15579 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:53.109831 15655 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:53.116333 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.116997 15653 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:53.040132 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:53.055650 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.118361 15654 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.130141 15727 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:05:53.062927 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 94095.8us
W20260709 13:05:53.124696 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 117201us
I20260709 13:05:53.055629 15776 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.080744 15864 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
I20260709 13:05:53.128717 15859 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.137576 15859 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.137993 15859 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.137888 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.141924 15770 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:53.143760 15653 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.109833 15807 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.149618 15867 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.150262 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.150553 15727 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.150370 15867 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.157440 15806 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.157980 15806 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.176331 15769 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:53.176738 15769 ts_tablet_manager.cc:1403] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.343s	user 0.018s	sys 0.023s
I20260709 13:05:53.172413 15776 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.176019 15818 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.186163 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:53.186273 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.187060 15579 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:53.187773 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.188545 15728 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:05:53.188470 15544 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.190984 15868 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.179164 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.191450 15868 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.182401 15867 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.201543 15769 raft_consensus.cc:359] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.203001 15769 raft_consensus.cc:385] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.203296 15769 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.203845 15769 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.205744 15809 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:53.209496 15868 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.206538 15807 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.219915 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:53.238165 15769 ts_tablet_manager.cc:1434] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:05:53.239724 15769 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:53.250347 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.251588 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.252794 15867 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.253260 15867 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.253664 15867 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.190303 15776 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.288688 15870 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:53.266762 15818 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.304461 15868 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:05:53.343235 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.345347 15776 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.343153 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.346400 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.347159 15771 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:53.346947 15859 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.347607 15771 ts_tablet_manager.cc:1403] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.522s	user 0.032s	sys 0.048s
W20260709 13:05:53.347316 15729 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.001s
I20260709 13:05:53.332456 15806 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.309092 15726 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:53.354346 15770 tablet_bootstrap.cc:654] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.340680 15580 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:53.349323 15729 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:53.357399 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.357406 15871 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.352876 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.361979 15871 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.357470 15872 raft_consensus.cc:2764] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:53.364254 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.378322 15871 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.365403 15477 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.373664 15769 tablet_bootstrap.cc:654] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.352872 15869 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.172s
I20260709 13:05:53.354285 15867 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.379364 15808 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:53.385110 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.391948 15692 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.393225 15864 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.393710 15864 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:53.394635 15864 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.406394 15771 raft_consensus.cc:359] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.409076 15771 raft_consensus.cc:385] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.409502 15771 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.387775 15653 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:53.419133 15771 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.434823 15873 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.435467 15873 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.435920 15873 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.436057 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:53.441995 15771 ts_tablet_manager.cc:1434] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.094s	user 0.011s	sys 0.000s
I20260709 13:05:53.444171 15771 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:53.437723 15859 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:53.437472 15692 leader_election.cc:343] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.451716 15654 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:53.451515 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.450395 15580 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:53.453886 15544 leader_election.cc:343] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.468495 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:53.471758 15726 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.472389 15867 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.481590 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:53.482326 15575 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.488003 15770 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:53.488163 15871 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.488633 15770 ts_tablet_manager.cc:1403] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.347s	user 0.018s	sys 0.005s
I20260709 13:05:53.490309 15578 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:53.490919 15693 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.494669 15871 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.496304 15867 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.496676 15864 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:05:53.537945 15693 leader_election.cc:343] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.538888 15693 leader_election.cc:343] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.539276 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.539073 15770 raft_consensus.cc:359] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.539950 15770 raft_consensus.cc:385] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.540297 15770 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.541390 15864 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.541107 15770 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.543962 15770 ts_tablet_manager.cc:1434] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:05:53.545123 15770 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
W20260709 13:05:53.546240 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50159.8us
I20260709 13:05:53.547473 15580 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:53.564144 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:53.544394 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45884.3us
I20260709 13:05:53.562556 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:53.565006 15859 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.565371 15727 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:05:53.565021 15771 tablet_bootstrap.cc:654] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:53.569518 15885 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:05:53.572211 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.572860 15654 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.573499 15575 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:53.575726 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.576352 15726 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
W20260709 13:05:53.578118 15544 leader_election.cc:343] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.578490 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.578855 15859 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:53.584149 15870 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.584713 15769 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:53.585177 15769 ts_tablet_manager.cc:1403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.346s	user 0.009s	sys 0.009s
I20260709 13:05:53.574412 15873 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.582351 15648 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.590904 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.593811 15478 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:05:53.598374 15478 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.596231 15864 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.599970 15864 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:53.600778 15864 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.601145 15873 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.602393 15579 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:05:53.596385 15544 leader_election.cc:343] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.605706 15693 leader_election.cc:343] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.607263 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:53.608983 15654 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:53.612989 15769 raft_consensus.cc:359] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.613771 15769 raft_consensus.cc:385] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.613883 15648 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:53.614140 15769 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.614820 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.617700 15867 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.615242 15769 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.630676 15870 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.631814 15774 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:53.606309 15859 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.638677 15769 ts_tablet_manager.cc:1434] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.005s
I20260709 13:05:53.641845 15769 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:53.629415 15873 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.648903 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:53.649933 15693 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.650256 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.651597 15648 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:05:53.654148 15866 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.654207 15774 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.656337 15866 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:53.656661 15774 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.657166 15866 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.664743 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:53.740875 15770 tablet_bootstrap.cc:654] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.745945 15769 tablet_bootstrap.cc:654] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.750155 15774 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.752730 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.754623 15544 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:53.755951 15867 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:53.756316 15544 leader_election.cc:343] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.757110 15544 leader_election.cc:343] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.757787 15818 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.758306 15818 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.760968 15818 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:53.763423 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:53.763695 15807 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.777011 15771 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:53.777806 15771 ts_tablet_manager.cc:1403] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.334s	user 0.030s	sys 0.029s
I20260709 13:05:53.781231 15771 raft_consensus.cc:359] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.782178 15771 raft_consensus.cc:385] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.782496 15771 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.783453 15771 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.786721 15771 ts_tablet_manager.cc:1434] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:53.787798 15771 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:53.787925 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:53.790441 15873 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.791360 15873 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:53.792533 15873 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.795799 15771 tablet_bootstrap.cc:654] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.796310 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.802184 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.805964 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:53.808396 15693 leader_election.cc:343] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.811621 15692 leader_election.cc:343] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.812106 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.813081 15818 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:53.815407 15544 leader_election.cc:343] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.816066 15544 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:53.817085 15774 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.823695 15808 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.824218 15808 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.830402 15808 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.830180 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.831411 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:53.831984 15618 leader_election.cc:343] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:53.834379 15619 leader_election.cc:343] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.836683 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.837786 15808 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.841214 15769 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:53.841789 15769 ts_tablet_manager.cc:1403] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.005s
I20260709 13:05:53.844151 15770 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:53.844579 15770 ts_tablet_manager.cc:1403] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.300s	user 0.025s	sys 0.022s
I20260709 13:05:53.846124 15769 raft_consensus.cc:359] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.846851 15769 raft_consensus.cc:385] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.847175 15769 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.847114 15770 raft_consensus.cc:359] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.847831 15770 raft_consensus.cc:385] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.848104 15770 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.848161 15769 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.848773 15770 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.850485 15769 ts_tablet_manager.cc:1434] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:53.850615 15770 ts_tablet_manager.cc:1434] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:53.851440 15769 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:53.852831 15771 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:53.853827 15771 ts_tablet_manager.cc:1403] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.027s
I20260709 13:05:53.855288 15478 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.856403 15771 raft_consensus.cc:359] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.857089 15771 raft_consensus.cc:385] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.856874 15478 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.857371 15771 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.851440 15770 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:53.858103 15771 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.860558 15771 ts_tablet_manager.cc:1434] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:53.861562 15771 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:53.858744 15769 tablet_bootstrap.cc:654] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.867198 15866 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.868397 15771 tablet_bootstrap.cc:654] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.875267 15477 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.885123 15770 tablet_bootstrap.cc:654] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.890483 15808 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.891112 15808 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.894618 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:53.895865 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.896725 15726 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:53.897886 15619 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:53.898715 15770 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:53.898715 15902 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.899127 15808 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.905480 15902 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.889309 15476 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.911228 15770 ts_tablet_manager.cc:1403] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.008s
I20260709 13:05:53.914389 15770 raft_consensus.cc:359] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.915047 15770 raft_consensus.cc:385] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.915326 15770 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.916116 15770 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.918710 15770 ts_tablet_manager.cc:1434] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:53.919732 15770 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:53.926486 15770 tablet_bootstrap.cc:654] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.935016 15771 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:53.935475 15771 ts_tablet_manager.cc:1403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.074s	user 0.036s	sys 0.035s
I20260709 13:05:53.936172 15769 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:53.936691 15769 ts_tablet_manager.cc:1403] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.009s
I20260709 13:05:53.938083 15771 raft_consensus.cc:359] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.938769 15771 raft_consensus.cc:385] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.939023 15771 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.939397 15769 raft_consensus.cc:359] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.939605 15771 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.940168 15769 raft_consensus.cc:385] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.940508 15769 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.941603 15771 ts_tablet_manager.cc:1434] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:53.941265 15769 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.942544 15771 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:53.943607 15769 ts_tablet_manager.cc:1434] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:53.944635 15769 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:53.949054 15771 tablet_bootstrap.cc:654] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.955791 15864 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:53.973223 15771 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:53.973877 15771 ts_tablet_manager.cc:1403] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.020s
I20260709 13:05:53.977784 15771 raft_consensus.cc:359] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.978556 15771 raft_consensus.cc:385] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.978852 15771 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.979499 15774 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.980116 15774 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.982331 15774 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:53.982509 15770 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:53.983081 15770 ts_tablet_manager.cc:1403] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.011s
I20260709 13:05:53.979534 15771 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.984894 15771 ts_tablet_manager.cc:1434] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:53.984516 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:53.985478 15726 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:53.985879 15771 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:53.985773 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:53.986056 15770 raft_consensus.cc:359] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.986867 15770 raft_consensus.cc:385] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.986907 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:53.987244 15770 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.988013 15770 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:53.988363 15544 leader_election.cc:343] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.989073 15870 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.989452 15870 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.989815 15870 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.992143 15771 tablet_bootstrap.cc:654] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.997741 15870 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:53.998729 15769 tablet_bootstrap.cc:654] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.000348 15770 ts_tablet_manager.cc:1434] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:05:54.002753 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:05:54.005388 15544 leader_election.cc:343] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.003803 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.006191 15726 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:54.008533 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:54.012075 15726 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.012840 15870 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.013353 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:54.015465 15774 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.015982 15774 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.016012 15902 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.016616 15902 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.016884 15774 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.017717 15769 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.018285 15769 ts_tablet_manager.cc:1403] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.007s
I20260709 13:05:54.019004 15902 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.019703 15873 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.020157 15873 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.020635 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.021294 15576 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:54.021423 15769 raft_consensus.cc:359] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.022212 15873 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.022356 15769 raft_consensus.cc:385] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.022801 15769 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.022689 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.023682 15902 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.023957 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.024199 15902 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.023653 15769 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.024544 15770 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.024621 15902 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.026458 15769 ts_tablet_manager.cc:1434] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:54.028839 15771 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.029326 15771 ts_tablet_manager.cc:1403] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.007s
I20260709 13:05:54.029820 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.030521 15651 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.024662 15729 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:54.031767 15770 tablet_bootstrap.cc:654] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.032677 15769 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.035064 15902 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.033171 15544 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.034178 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.036334 15728 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.038254 15873 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.038192 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:54.038715 15873 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.038918 15576 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.039100 15873 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.046897 15576 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:54.047484 15864 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.053454 15478 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.032006 15771 raft_consensus.cc:359] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.059266 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.059679 15771 raft_consensus.cc:385] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.060029 15771 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.060918 15771 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.049113 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.054585 15902 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.063752 15771 ts_tablet_manager.cc:1434] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:54.055771 15769 tablet_bootstrap.cc:654] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.065860 15771 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.061849 15859 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.066493 15859 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:54.067340 15770 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.071213 15770 ts_tablet_manager.cc:1403] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.011s
I20260709 13:05:54.071137 15902 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.072966 15771 tablet_bootstrap.cc:654] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.071861 15902 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.073757 15770 raft_consensus.cc:359] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.074388 15770 raft_consensus.cc:385] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.074682 15770 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.075500 15770 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.075838 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.078048 15770 ts_tablet_manager.cc:1434] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:54.078889 15770 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.079922 15771 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.080350 15771 ts_tablet_manager.cc:1403] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:05:54.080520 15864 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.048918 15873 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.067349 15859 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.084021 15902 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.085363 15873 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.086575 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.092867 15728 raft_consensus.cc:2393] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:54.087314 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.095969 15729 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.096326 15769 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.096807 15769 ts_tablet_manager.cc:1403] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.006s
I20260709 13:05:54.067947 15726 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.099336 15769 raft_consensus.cc:359] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.099486 15619 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:54.099880 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.100713 15808 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.082906 15771 raft_consensus.cc:359] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.102210 15771 raft_consensus.cc:385] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.102481 15771 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.103071 15771 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.104601 15771 ts_tablet_manager.cc:1434] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:05:54.105368 15771 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.100669 15651 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.110528 15770 tablet_bootstrap.cc:654] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.112833 15729 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.114725 15726 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:54.115202 15544 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.115350 15651 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.116062 15769 raft_consensus.cc:385] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.116154 15774 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.116402 15769 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.116711 15774 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.117581 15774 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.117527 15769 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.120340 15771 tablet_bootstrap.cc:654] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.120481 15769 ts_tablet_manager.cc:1434] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:05:54.121644 15769 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.129971 15902 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.112870 15808 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.136597 15864 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:54.170523 15902 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.179656 15769 tablet_bootstrap.cc:654] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.185921 15864 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.186656 15864 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.190443 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.193339 15864 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:05:54.194577 15692 leader_election.cc:343] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.204545 15864 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.200519 15478 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.218860 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.225592 15476 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.211455 15864 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:54.225780 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50899.6us
I20260709 13:05:54.237118 15776 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.238198 15770 tablet_bootstrap.cc:492] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.238709 15770 ts_tablet_manager.cc:1403] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.160s	user 0.025s	sys 0.022s
W20260709 13:05:54.233325 15693 leader_election.cc:343] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.239296 15693 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:54.241402 15770 raft_consensus.cc:359] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.242273 15776 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.243800 15770 raft_consensus.cc:385] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.244427 15770 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.245251 15770 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.266610 15770 ts_tablet_manager.cc:1434] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:54.267419 15770 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.278683 15864 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:54.290050 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.294535 15574 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:54.296268 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.297242 15776 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.298146 15776 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.298525 15776 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.298926 15807 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.302539 15769 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.303011 15769 ts_tablet_manager.cc:1403] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.029s
I20260709 13:05:54.292327 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.309780 15769 raft_consensus.cc:359] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.310565 15769 raft_consensus.cc:385] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.310829 15769 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.311611 15653 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:54.311621 15769 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.313678 15769 ts_tablet_manager.cc:1434] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:05:54.316385 15776 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.320267 15771 tablet_bootstrap.cc:492] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.320730 15771 ts_tablet_manager.cc:1403] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.216s	user 0.029s	sys 0.033s
I20260709 13:05:54.324136 15770 tablet_bootstrap.cc:654] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.325793 15776 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:54.327411 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.327992 15653 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.327761 15771 raft_consensus.cc:359] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.328490 15771 raft_consensus.cc:385] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.328766 15771 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.329406 15771 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.331429 15771 ts_tablet_manager.cc:1434] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:54.332274 15771 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.333364 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:54.333940 15575 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.336537 15869 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.337826 15771 tablet_bootstrap.cc:654] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.343135 15770 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.343626 15770 ts_tablet_manager.cc:1403] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.006s
I20260709 13:05:54.314670 15769 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.345510 15770 raft_consensus.cc:359] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.349557 15869 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.350129 15653 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:54.350056 15869 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.345988 15770 raft_consensus.cc:385] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.352414 15869 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.352792 15770 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.353562 15770 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.355782 15770 ts_tablet_manager.cc:1434] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:05:54.355952 15693 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:54.356648 15770 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.357475 15867 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.357964 15867 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:54.358786 15867 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.360159 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.360756 15729 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.362073 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.362819 15869 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.362859 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.363268 15869 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.363617 15869 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.363549 15648 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.370365 15869 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.372252 15869 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.373028 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.373620 15654 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.375579 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.376157 15729 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.376583 15869 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.377027 15869 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.379019 15869 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.380338 15770 tablet_bootstrap.cc:654] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.381354 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.383028 15575 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:54.381942 15654 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.383798 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.384608 15726 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.386209 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:54.390587 15544 leader_election.cc:343] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.391492 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.386787 15771 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.392614 15771 ts_tablet_manager.cc:1403] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.001s
I20260709 13:05:54.393179 15870 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.393577 15870 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.393911 15870 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.395483 15771 raft_consensus.cc:359] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.396152 15771 raft_consensus.cc:385] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.396420 15771 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.400878 15870 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.402213 15869 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.389446 15770 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.402668 15729 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.403043 15770 ts_tablet_manager.cc:1403] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.001s
I20260709 13:05:54.389642 15769 tablet_bootstrap.cc:654] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.403498 15869 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.404700 15869 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.397570 15771 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.407974 15771 ts_tablet_manager.cc:1434] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:54.408943 15771 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.406018 15870 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.407981 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.410722 15476 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:54.412744 15544 leader_election.cc:343] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.408989 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.414206 15729 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.418203 15771 tablet_bootstrap.cc:654] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.427677 15771 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.428140 15771 ts_tablet_manager.cc:1403] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:05:54.430661 15771 raft_consensus.cc:359] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.430802 15770 raft_consensus.cc:359] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.431490 15771 raft_consensus.cc:385] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.431725 15770 raft_consensus.cc:385] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.431810 15771 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.432399 15770 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.432807 15771 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.435016 15771 ts_tablet_manager.cc:1434] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:54.434669 15476 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.436429 15771 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.438745 15729 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.440127 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:54.441324 15869 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.441560 15769 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.441799 15869 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.442142 15769 ts_tablet_manager.cc:1403] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.000s
I20260709 13:05:54.443012 15771 tablet_bootstrap.cc:654] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.442708 15869 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.443735 15770 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.445678 15870 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.446671 15870 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.447331 15770 ts_tablet_manager.cc:1434] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:05:54.448288 15770 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.449307 15870 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.451453 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.451823 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.452168 15651 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.452664 15729 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.453728 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.455089 15870 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.455874 15870 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.456259 15870 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.445695 15769 raft_consensus.cc:359] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.461046 15769 raft_consensus.cc:385] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.461380 15769 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.462137 15769 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.455274 15770 tablet_bootstrap.cc:654] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.463500 15870 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.469849 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.470525 15651 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.469947 15476 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.477424 15651 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.477804 15769 ts_tablet_manager.cc:1434] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:05:54.478643 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.480322 15870 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.480836 15870 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.481290 15870 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.481786 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.482127 15870 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.482609 15729 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.483737 15769 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.494076 15769 tablet_bootstrap.cc:654] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.495230 15771 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.495715 15771 ts_tablet_manager.cc:1403] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.059s	user 0.037s	sys 0.019s
I20260709 13:05:54.498888 15771 raft_consensus.cc:359] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.499550 15771 raft_consensus.cc:385] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.499830 15771 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.500556 15771 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.504858 15729 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.509071 15771 ts_tablet_manager.cc:1434] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:54.509729 15770 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.510243 15770 ts_tablet_manager.cc:1403] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.017s
I20260709 13:05:54.510422 15771 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.514864 15770 raft_consensus.cc:359] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.515575 15770 raft_consensus.cc:385] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.515825 15770 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.516487 15770 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.518097 15771 tablet_bootstrap.cc:654] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.519088 15770 ts_tablet_manager.cc:1434] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:05:54.519968 15770 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.520430 15478 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.523388 15771 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.523877 15771 ts_tablet_manager.cc:1403] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:05:54.524115 15769 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.524688 15769 ts_tablet_manager.cc:1403] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.015s
I20260709 13:05:54.525923 15770 tablet_bootstrap.cc:654] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.526175 15859 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.526628 15859 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.528263 15769 raft_consensus.cc:359] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.529932 15769 raft_consensus.cc:385] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.530323 15769 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.528939 15859 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.529274 15771 raft_consensus.cc:359] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.531243 15771 raft_consensus.cc:385] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.531220 15769 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.531714 15771 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.531669 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.531740 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.532580 15729 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:54.532630 15771 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.533910 15769 ts_tablet_manager.cc:1434] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:54.534526 15619 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:54.537621 15769 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.544164 15859 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.544495 15769 tablet_bootstrap.cc:654] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.554004 15869 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.554605 15869 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.555243 15771 ts_tablet_manager.cc:1434] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:05:54.556214 15771 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.556828 15869 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.558784 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.559454 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.560088 15726 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.561396 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.562564 15873 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.562929 15873 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.563300 15873 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.563660 15859 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:54.566250 15544 leader_election.cc:343] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.565750 15870 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:54.576030 15873 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.578332 15873 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.579993 15859 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.580677 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.581350 15859 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.585311 15859 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.585530 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.583693 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.586225 15769 tablet_bootstrap.cc:492] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.586395 15726 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.586656 15769 ts_tablet_manager.cc:1403] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
W20260709 13:05:54.587033 15618 leader_election.cc:343] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.589319 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.590278 15729 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:54.590620 15769 raft_consensus.cc:359] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.591315 15769 raft_consensus.cc:385] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.591562 15619 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:05:54.592854 15544 leader_election.cc:343] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.593581 15770 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.594013 15770 ts_tablet_manager.cc:1403] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.024s
I20260709 13:05:54.594436 15771 tablet_bootstrap.cc:654] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.591574 15769 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.596802 15769 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.597373 15873 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.598901 15770 raft_consensus.cc:359] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.599902 15770 raft_consensus.cc:385] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.593964 15859 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.601590 15770 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.602658 15770 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.603138 15726 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.605533 15770 ts_tablet_manager.cc:1434] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:54.601657 15859 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.606262 15859 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.611562 15770 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.613571 15859 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.615746 15818 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.616287 15818 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.616961 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.617549 15726 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.617694 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:54.618357 15575 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.619570 15770 tablet_bootstrap.cc:654] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.619724 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.620395 15574 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:54.621440 15869 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.621937 15869 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.622608 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.623432 15866 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.623770 15866 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.623944 15869 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.624104 15866 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.629345 15726 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:54.630944 15818 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:54.632669 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.633564 15771 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.633543 15654 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:54.634119 15771 ts_tablet_manager.cc:1403] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 13:05:54.636785 15771 raft_consensus.cc:359] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.637434 15771 raft_consensus.cc:385] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.637094 15866 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.637745 15771 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.638422 15771 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.640234 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:54.640795 15574 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.641206 15859 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.640411 15771 ts_tablet_manager.cc:1434] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:54.642684 15771 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.644338 15619 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:54.645781 15809 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.646503 15809 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:54.647756 15809 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.649614 15771 tablet_bootstrap.cc:654] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.650684 15769 ts_tablet_manager.cc:1434] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:05:54.652515 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.653122 15654 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.653654 15574 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:54.655072 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.657675 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.658324 15575 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:54.660481 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.661114 15726 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.659173 15818 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.662566 15818 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:54.663780 15818 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.691362 15770 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.691920 15770 ts_tablet_manager.cc:1403] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.020s
I20260709 13:05:54.692041 15866 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:54.693785 15769 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.699040 15770 raft_consensus.cc:359] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.699784 15770 raft_consensus.cc:385] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.700084 15770 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.700742 15770 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.665061 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:54.658330 15651 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.708505 15859 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.709656 15873 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.710142 15859 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:54.718663 15770 ts_tablet_manager.cc:1434] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:05:54.722500 15770 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.724421 15873 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.725653 15873 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.734949 15654 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
W20260709 13:05:54.734400 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 69471.8us
I20260709 13:05:54.726943 15477 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.742787 15869 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.744807 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.757944 15873 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.758605 15873 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.759228 15873 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.758662 15475 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.748950 15770 tablet_bootstrap.cc:654] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.752883 15477 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.774859 15769 tablet_bootstrap.cc:654] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.780762 15873 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.783524 15873 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.792423 15771 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.793066 15771 ts_tablet_manager.cc:1403] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.050s
I20260709 13:05:54.802593 15771 raft_consensus.cc:359] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.803347 15771 raft_consensus.cc:385] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.803632 15771 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.804253 15771 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.806973 15771 ts_tablet_manager.cc:1434] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:05:54.812381 15771 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.817044 15809 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.817596 15809 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.820261 15771 tablet_bootstrap.cc:654] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.820694 15873 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.821533 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:54.822427 15770 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.823522 15770 ts_tablet_manager.cc:1403] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.001s
W20260709 13:05:54.824024 15618 leader_election.cc:343] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.826660 15770 raft_consensus.cc:359] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.827488 15770 raft_consensus.cc:385] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.822438 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:54.827919 15770 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.828240 15654 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.828779 15770 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.830965 15770 ts_tablet_manager.cc:1434] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:54.831941 15770 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.833319 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:54.833942 15729 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.837648 15769 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:54.838195 15769 ts_tablet_manager.cc:1403] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.145s	user 0.035s	sys 0.004s
I20260709 13:05:54.838510 15770 tablet_bootstrap.cc:654] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.840737 15769 raft_consensus.cc:359] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.841465 15769 raft_consensus.cc:385] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.841723 15769 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.828352 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:54.848646 15619 leader_election.cc:343] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.849262 15619 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:54.850085 15771 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.850378 15927 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.850731 15771 ts_tablet_manager.cc:1403] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.000s
I20260709 13:05:54.851486 15809 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.851707 15654 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.853785 15771 raft_consensus.cc:359] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.855309 15771 raft_consensus.cc:385] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.855580 15771 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.856377 15771 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.858527 15771 ts_tablet_manager.cc:1434] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:54.859464 15771 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.871124 15771 tablet_bootstrap.cc:654] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.873803 15729 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:54.878391 15770 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.878412 15771 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:54.878947 15770 ts_tablet_manager.cc:1403] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.024s
I20260709 13:05:54.878999 15771 ts_tablet_manager.cc:1403] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:05:54.881698 15770 raft_consensus.cc:359] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.882432 15770 raft_consensus.cc:385] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.882745 15770 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.882282 15771 raft_consensus.cc:359] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.883128 15771 raft_consensus.cc:385] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.883388 15771 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.883337 15770 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.884063 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.885396 15770 ts_tablet_manager.cc:1434] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:54.884141 15771 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.891016 15774 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.891480 15774 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:54.892693 15771 ts_tablet_manager.cc:1434] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:05:54.892341 15774 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.893600 15771 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:54.891461 15770 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.899389 15771 tablet_bootstrap.cc:654] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.901504 15769 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.902561 15873 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.905658 15770 tablet_bootstrap.cc:654] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.920697 15769 ts_tablet_manager.cc:1434] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 13:05:54.921110 15770 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.921550 15770 ts_tablet_manager.cc:1403] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:05:54.923135 15769 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:54.924494 15770 raft_consensus.cc:359] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.927812 15770 raft_consensus.cc:385] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.928121 15770 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.927507 15477 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.929013 15770 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.932301 15770 ts_tablet_manager.cc:1434] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:05:54.933187 15770 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.934267 15774 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.934725 15774 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.938714 15873 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.939486 15774 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.941128 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:54.941757 15653 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.944645 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:54.945446 15770 tablet_bootstrap.cc:654] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.945386 15729 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:54.957214 15770 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:54.957685 15770 ts_tablet_manager.cc:1403] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:05:54.963657 15770 raft_consensus.cc:359] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.964377 15770 raft_consensus.cc:385] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.963990 15818 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.964660 15770 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.965577 15770 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.967952 15770 ts_tablet_manager.cc:1434] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:54.968819 15770 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:54.974361 15770 tablet_bootstrap.cc:654] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.979683 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:54.980671 15870 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.981047 15870 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.981385 15870 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.981962 15818 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.988510 15870 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:54.990805 15870 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:54.996982 15769 tablet_bootstrap.cc:654] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.003808 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:55.004498 15771 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.004586 15654 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.005121 15771 ts_tablet_manager.cc:1403] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.112s	user 0.031s	sys 0.044s
I20260709 13:05:55.007011 15770 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.007503 15770 ts_tablet_manager.cc:1403] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
I20260709 13:05:55.008020 15771 raft_consensus.cc:359] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.008769 15771 raft_consensus.cc:385] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.009084 15771 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.009788 15771 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.009948 15770 raft_consensus.cc:359] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.010835 15770 raft_consensus.cc:385] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.011114 15770 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.011765 15770 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.012542 15771 ts_tablet_manager.cc:1434] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:55.013468 15771 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.015077 15770 ts_tablet_manager.cc:1434] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:55.019841 15769 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.020077 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.020233 15771 tablet_bootstrap.cc:654] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.020376 15769 ts_tablet_manager.cc:1403] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.005s
I20260709 13:05:55.020730 15726 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.023631 15769 raft_consensus.cc:359] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.024343 15769 raft_consensus.cc:385] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.024627 15769 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.025470 15769 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.032743 15770 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.038640 15873 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.040083 15873 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.042196 15873 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.027968 15769 ts_tablet_manager.cc:1434] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:55.043514 15769 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.047338 15873 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.049898 15654 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.045310 15726 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.053009 15770 tablet_bootstrap.cc:654] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.061681 15769 tablet_bootstrap.cc:654] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.061758 15873 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.064738 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.066111 15873 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.066285 15771 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.066584 15873 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:55.067139 15771 ts_tablet_manager.cc:1403] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.009s
I20260709 13:05:55.067437 15873 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.071589 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.072232 15653 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.074467 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.079547 15870 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.079927 15870 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.080266 15870 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.083806 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.084427 15726 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.087281 15771 raft_consensus.cc:359] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.088693 15770 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.090126 15770 ts_tablet_manager.cc:1403] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.005s
I20260709 13:05:55.090003 15771 raft_consensus.cc:385] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.091387 15771 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.095535 15771 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.103132 15771 ts_tablet_manager.cc:1434] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:05:55.104034 15771 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
W20260709 13:05:55.109088 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:55.108829 15870 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.114609 15870 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.111995 15478 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.119812 15866 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.121038 15927 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.121508 15927 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.123611 15927 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.131852 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.132141 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:55.132658 15726 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:55.136523 15618 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:55.138741 15809 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.140928 15770 raft_consensus.cc:359] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.141579 15770 raft_consensus.cc:385] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.141836 15770 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.143887 15770 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.145426 15809 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.147930 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.148559 15729 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.150980 15769 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.151443 15769 ts_tablet_manager.cc:1403] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.108s	user 0.005s	sys 0.017s
I20260709 13:05:55.152215 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:55.152778 15654 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.155130 15771 tablet_bootstrap.cc:654] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.158782 15867 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.159794 15729 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.166204 15771 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.166648 15771 ts_tablet_manager.cc:1403] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 13:05:55.169266 15771 raft_consensus.cc:359] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.169723 15771 raft_consensus.cc:385] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.169936 15771 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.170568 15771 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.174485 15771 ts_tablet_manager.cc:1434] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:55.175298 15771 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.180984 15771 tablet_bootstrap.cc:654] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.187052 15770 ts_tablet_manager.cc:1434] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.000s
I20260709 13:05:55.189364 15873 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.187247 15809 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.190922 15770 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.191464 15654 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.196905 15770 tablet_bootstrap.cc:654] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.188994 15771 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
W20260709 13:05:55.189278 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43983.8us
I20260709 13:05:55.201354 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.204680 15870 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.188585 15769 raft_consensus.cc:359] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.205613 15769 raft_consensus.cc:385] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.205550 15807 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.206061 15769 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.206797 15769 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.208489 15989 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.208920 15769 ts_tablet_manager.cc:1434] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 13:05:55.227742 15771 ts_tablet_manager.cc:1403] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.004s
I20260709 13:05:55.230263 15769 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.234869 15771 raft_consensus.cc:359] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.235797 15771 raft_consensus.cc:385] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.236121 15771 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.241425 15859 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.245765 15771 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.248446 15771 ts_tablet_manager.cc:1434] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:05:55.249444 15771 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.241899 15769 tablet_bootstrap.cc:654] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.259583 15989 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:05:55.260265 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50807.4us
I20260709 13:05:55.260601 15989 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.273020 15770 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.273545 15770 ts_tablet_manager.cc:1403] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.083s	user 0.003s	sys 0.010s
I20260709 13:05:55.281114 15771 tablet_bootstrap.cc:654] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.281646 15769 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.282176 15769 ts_tablet_manager.cc:1403] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 13:05:55.292917 15770 raft_consensus.cc:359] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.293629 15770 raft_consensus.cc:385] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.293911 15770 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.298544 15774 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.299827 15869 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.301047 15807 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.301229 15869 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.301545 15807 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.303149 15869 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.303937 15807 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.304711 15770 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.306107 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.306751 15651 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.310654 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.310768 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.311499 15770 ts_tablet_manager.cc:1434] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:05:55.312431 15770 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.313494 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.314435 15869 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.315017 15869 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.315441 15869 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:55.317148 15544 leader_election.cc:343] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.319176 15807 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.319617 15807 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.320513 15769 raft_consensus.cc:359] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.320744 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.321214 15769 raft_consensus.cc:385] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.321542 15769 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.321647 15807 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.322245 15807 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.322782 15869 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:55.323925 15544 leader_election.cc:343] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.325289 15769 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.334465 15870 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.334949 15870 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.337891 15769 ts_tablet_manager.cc:1434] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:05:55.339119 15769 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.333729 15478 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:55.363060 15544 leader_election.cc:343] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.363740 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:55.401880 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.402627 15728 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.425688 15993 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.443645 15809 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.450474 15809 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.475562 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.476016 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.477079 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:55.478884 15618 leader_election.cc:343] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.469691 15869 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.480741 15771 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.480369 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.481220 15771 ts_tablet_manager.cc:1403] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.003s
I20260709 13:05:55.481297 15653 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.485379 15809 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.487582 15927 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.494707 15927 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.492447 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:05:55.496373 15544 leader_election.cc:343] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.496774 15651 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.496809 15927 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.493182 15873 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.500195 15873 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.500551 15873 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.509068 15873 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.511737 15771 raft_consensus.cc:359] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.512456 15771 raft_consensus.cc:385] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.512722 15771 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.513302 15771 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.514532 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.515684 15771 ts_tablet_manager.cc:1434] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:05:55.525669 15873 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.527433 15769 tablet_bootstrap.cc:654] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.529366 15619 leader_election.cc:343] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.529850 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:55.534363 15859 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.535296 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.538234 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.538828 15654 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
W20260709 13:05:55.534179 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 44280.5us
I20260709 13:05:55.542116 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.542685 15727 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.543351 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:55.543735 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:55.543923 15653 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.547267 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:55.547585 15618 leader_election.cc:343] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.550077 15727 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.550366 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.556511 15807 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:55.559099 15726 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
W20260709 13:05:55.561293 15619 leader_election.cc:343] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.530915 15870 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.553610 15989 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.568266 15989 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.568675 15989 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.578653 15770 tablet_bootstrap.cc:654] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.579167 15771 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.568665 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:55.583123 15859 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.580534 15651 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.591365 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.592099 15774 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.592772 15989 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.592577 15774 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.595021 15774 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.595484 15653 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.597067 15993 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.597627 15993 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:55.598564 15993 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.604782 15989 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.608923 15770 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.609678 15770 ts_tablet_manager.cc:1403] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.297s	user 0.010s	sys 0.006s
I20260709 13:05:55.614934 15869 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.615324 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.616094 15989 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.616753 15989 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:55.618227 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.617827 15989 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.619491 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.620060 15727 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:55.624336 15544 leader_election.cc:343] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.625623 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:55.626237 15653 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.625672 15769 tablet_bootstrap.cc:492] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.629423 15769 ts_tablet_manager.cc:1403] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.291s	user 0.021s	sys 0.016s
I20260709 13:05:55.631467 15770 raft_consensus.cc:359] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.633718 15771 tablet_bootstrap.cc:654] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.638520 15770 raft_consensus.cc:385] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.633337 15990 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.639683 15990 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.639148 15770 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.642452 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:55.650178 15544 leader_election.cc:343] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.650830 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:55.653368 15727 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.654287 15869 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.655447 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:55.655045 15770 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.656432 15807 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.656873 15807 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:55.657078 15770 ts_tablet_manager.cc:1434] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.005s
I20260709 13:05:55.657426 15990 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.658042 15770 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.657675 15807 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.663021 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:55.668346 15544 leader_election.cc:343] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.669054 15869 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.675988 15770 tablet_bootstrap.cc:654] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.680470 15769 raft_consensus.cc:359] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.682377 15769 raft_consensus.cc:385] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.682721 15769 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.683646 15769 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.690546 15769 ts_tablet_manager.cc:1434] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.004s
I20260709 13:05:55.696193 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:55.703480 15544 leader_election.cc:343] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.703873 15544 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:55.676795 15653 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.706110 15869 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.686928 16002 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:05:55.716085 15771 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.716576 15771 ts_tablet_manager.cc:1403] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.011s
I20260709 13:05:55.720054 15771 raft_consensus.cc:359] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.720708 15771 raft_consensus.cc:385] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.720981 15771 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.721745 15771 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.725867 15771 ts_tablet_manager.cc:1434] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:55.730436 15771 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.730185 15478 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.732353 15478 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.736492 16002 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.739665 15770 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.740208 15770 ts_tablet_manager.cc:1403] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.001s
I20260709 13:05:55.742812 15770 raft_consensus.cc:359] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.743566 15770 raft_consensus.cc:385] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.743902 15770 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.745286 15771 tablet_bootstrap.cc:654] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.748317 15770 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.750713 15770 ts_tablet_manager.cc:1434] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:55.751608 15770 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.744803 15478 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.757109 15770 tablet_bootstrap.cc:654] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.759826 15769 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.768741 15770 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.769310 15770 ts_tablet_manager.cc:1403] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:05:55.771977 15770 raft_consensus.cc:359] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.772658 15770 raft_consensus.cc:385] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.772890 15770 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.773386 15770 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.775122 15770 ts_tablet_manager.cc:1434] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:05:55.775836 15770 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.780377 15770 tablet_bootstrap.cc:654] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.784807 15989 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.785442 15989 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.788223 15989 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.791652 15769 tablet_bootstrap.cc:654] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.793170 15770 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.793624 15770 ts_tablet_manager.cc:1403] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.010s
I20260709 13:05:55.796928 15809 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.797387 15809 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.799615 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.800387 15809 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:55.800845 15544 leader_election.cc:343] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.801887 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.805470 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:55.806855 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:55.807245 15619 leader_election.cc:343] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:55.808547 15544 leader_election.cc:343] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.808928 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:55.809831 16002 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.809568 15770 raft_consensus.cc:359] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.811107 15770 raft_consensus.cc:385] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.811381 15770 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.812136 15576 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:55.812026 15770 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.815104 15770 ts_tablet_manager.cc:1434] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:05:55.815274 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.816043 15770 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.816406 16001 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.816783 16001 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.817111 16001 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.822248 15769 tablet_bootstrap.cc:492] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.822407 15770 tablet_bootstrap.cc:654] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.822736 15769 ts_tablet_manager.cc:1403] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 13:05:55.823114 15771 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.823714 15771 ts_tablet_manager.cc:1403] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.093s	user 0.030s	sys 0.030s
I20260709 13:05:55.825399 15769 raft_consensus.cc:359] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.826129 15769 raft_consensus.cc:385] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.826424 15769 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.827169 15769 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.828102 15771 raft_consensus.cc:359] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.828948 15771 raft_consensus.cc:385] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.829272 15771 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.830116 15771 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.832463 15771 ts_tablet_manager.cc:1434] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:55.833760 15770 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.834208 15770 ts_tablet_manager.cc:1403] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:05:55.835685 15809 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.836136 15809 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.836577 15770 raft_consensus.cc:359] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.837211 15770 raft_consensus.cc:385] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.837452 15770 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.838125 15770 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.838706 15769 ts_tablet_manager.cc:1434] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:55.839291 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.839834 15769 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.840435 15770 ts_tablet_manager.cc:1434] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:55.841502 15770 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.833307 15771 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.845561 15989 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.846328 15989 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:55.846938 15619 leader_election.cc:343] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.850004 15809 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.851806 15989 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.852030 15769 tablet_bootstrap.cc:654] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.852694 15770 tablet_bootstrap.cc:654] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.852569 16002 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.854619 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.854161 16002 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.855666 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.856662 16002 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:55.856837 15544 leader_election.cc:343] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.857379 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:55.858628 15544 leader_election.cc:343] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.859261 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.859877 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.859051 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:55.861121 15544 leader_election.cc:343] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.861724 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.862319 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:55.862974 15576 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:55.864317 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.857287 16001 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.865469 15809 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.865895 15809 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.866295 15809 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.867875 15989 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.868635 16002 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.869065 16002 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.869417 16002 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.870008 16001 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.864609 15771 tablet_bootstrap.cc:654] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.871273 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:05:55.872589 15619 leader_election.cc:343] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.873764 15809 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.877317 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.877977 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:55.878686 15576 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.877324 16002 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.881946 16002 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.882673 15770 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
W20260709 13:05:55.882794 15619 leader_election.cc:343] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.883157 15770 ts_tablet_manager.cc:1403] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260709 13:05:55.883052 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:55.883548 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:55.884167 15651 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:55.884547 15544 leader_election.cc:343] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.884485 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:55.885335 15575 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.886405 15770 raft_consensus.cc:359] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.887313 15770 raft_consensus.cc:385] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.887655 15770 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.888720 15770 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.891646 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:55.892449 15575 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:55.892768 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.893697 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.893846 15989 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.894455 15989 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:55.879948 15769 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.895371 15769 ts_tablet_manager.cc:1403] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 13:05:55.895393 15989 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.896736 15770 ts_tablet_manager.cc:1434] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:55.897535 15770 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.898207 15769 raft_consensus.cc:359] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.898893 15769 raft_consensus.cc:385] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.902216 15769 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.902599 16001 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.903067 16001 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:55.902912 15769 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.903817 16001 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.904883 15576 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:55.905153 15769 ts_tablet_manager.cc:1434] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:05:55.906067 15769 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.911753 15770 tablet_bootstrap.cc:654] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.911607 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:55.912482 15859 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.913131 15859 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:55.914978 15771 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:55.915660 15771 ts_tablet_manager.cc:1403] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.083s	user 0.005s	sys 0.017s
I20260709 13:05:55.915341 15859 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.917096 15769 tablet_bootstrap.cc:654] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.917771 15475 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.919425 15771 raft_consensus.cc:359] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.920148 15771 raft_consensus.cc:385] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.920405 15771 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.910308 15809 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.921463 15771 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.927145 15771 ts_tablet_manager.cc:1434] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:05:55.931124 15771 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:55.944031 15478 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.945685 15770 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:55.946187 15770 ts_tablet_manager.cc:1403] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.016s
I20260709 13:05:55.947836 15771 tablet_bootstrap.cc:654] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.948694 15770 raft_consensus.cc:359] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.949338 15770 raft_consensus.cc:385] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.949596 15770 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.950433 15770 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.951903 15770 ts_tablet_manager.cc:1434] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:05:55.952772 15770 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:55.954802 15769 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:55.955245 15769 ts_tablet_manager.cc:1403] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.004s
I20260709 13:05:55.957108 15867 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.957553 15867 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.957798 15769 raft_consensus.cc:359] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.958323 15770 tablet_bootstrap.cc:654] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.958491 15769 raft_consensus.cc:385] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.958746 15769 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.959576 15867 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:55.960055 15769 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.961321 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.962054 15651 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:55.962574 15769 ts_tablet_manager.cc:1434] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:55.963718 15769 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:55.968390 15478 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.969319 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:55.972172 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:55.973517 15818 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.978816 15866 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.979491 15866 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.979895 15989 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.980361 15989 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:55.983654 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:55.984211 15729 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.996040 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:55.998886 15651 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:55.995396 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:56.000130 15576 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:55.988059 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:56.001199 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:56.001331 16002 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.002363 16002 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.002674 15867 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.002853 16002 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.003083 15867 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.005389 15867 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.006851 15769 tablet_bootstrap.cc:654] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.982342 15989 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:55.981994 15866 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:55.983366 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.011934 15818 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:56.014617 15693 leader_election.cc:343] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.015125 15867 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.016320 15771 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:56.017056 15771 ts_tablet_manager.cc:1403] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.005s
I20260709 13:05:56.017657 16002 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.019114 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:56.019722 16002 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.019873 15576 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.020972 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:56.021595 15770 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:56.022112 15770 ts_tablet_manager.cc:1403] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.041s
I20260709 13:05:56.021992 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:56.022589 15653 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.021472 15729 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.033063 15867 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:56.035171 15770 raft_consensus.cc:359] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.035889 15770 raft_consensus.cc:385] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.036180 15770 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.036487 15576 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:56.036907 15770 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.035732 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:56.038131 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:56.039491 15867 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.038295 15653 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:56.041239 15770 ts_tablet_manager.cc:1434] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:05:56.034058 15771 raft_consensus.cc:359] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.042157 15771 raft_consensus.cc:385] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.042421 15771 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.043390 15769 tablet_bootstrap.cc:492] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:56.043859 15769 ts_tablet_manager.cc:1403] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.018s
I20260709 13:05:56.044315 15770 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:56.045830 15769 raft_consensus.cc:359] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.046620 15769 raft_consensus.cc:385] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.046886 15769 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.047485 15769 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.049325 15769 ts_tablet_manager.cc:1434] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:56.049851 15770 tablet_bootstrap.cc:654] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.050467 15769 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:56.043049 15771 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.053761 15771 ts_tablet_manager.cc:1434] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:05:56.054916 15771 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:56.057457 15769 tablet_bootstrap.cc:654] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.058444 15654 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.060315 15771 tablet_bootstrap.cc:654] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.069108 15769 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:56.069733 15769 ts_tablet_manager.cc:1403] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:05:56.069047 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:56.070962 15989 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.071439 15989 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:56.072291 15769 raft_consensus.cc:359] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.072346 15989 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.073096 15769 raft_consensus.cc:385] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.073427 15769 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.074570 15769 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.076862 15769 ts_tablet_manager.cc:1434] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:56.077795 15769 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:56.080884 15990 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.082332 15769 tablet_bootstrap.cc:654] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.081161 15729 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:56.086225 15654 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:56.089150 15990 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.090310 16002 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.090817 16002 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.092819 16002 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.096340 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.100234 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:56.101959 15544 leader_election.cc:343] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:56.102622 15544 leader_election.cc:343] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.102978 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:56.109061 15867 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:56.110003 15867 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.113235 15993 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.125427 15771 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:56.126003 15771 ts_tablet_manager.cc:1403] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.007s
I20260709 13:05:56.175434 15769 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:56.176018 15769 ts_tablet_manager.cc:1403] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.018s
I20260709 13:05:56.175668 15809 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.178175 15809 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.180827 16002 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.181228 15809 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.181340 16002 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.183068 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:56.183370 16002 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.184177 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:56.184497 15618 leader_election.cc:343] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.184796 15725 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:56.199517 15769 raft_consensus.cc:359] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.200253 15769 raft_consensus.cc:385] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.200516 15769 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.201112 15769 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.201768 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:56.203166 15478 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.207077 15809 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.207594 15809 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.208021 15809 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.194231 15771 raft_consensus.cc:359] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.217736 15989 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.225713 15770 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:56.227406 15771 raft_consensus.cc:385] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.228442 15771 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.229188 15771 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.227569 15769 ts_tablet_manager.cc:1434] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:05:56.230693 15993 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.231235 15993 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.233392 15769 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:56.233464 15770 ts_tablet_manager.cc:1403] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.189s	user 0.016s	sys 0.010s
I20260709 13:05:56.231343 15809 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.239248 15771 ts_tablet_manager.cc:1434] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.113s	user 0.015s	sys 0.016s
I20260709 13:05:56.243724 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.244848 15993 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:56.246347 15544 leader_election.cc:343] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.255106 15770 raft_consensus.cc:359] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.255651 15770 raft_consensus.cc:385] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.255870 15770 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.257270 15770 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.250310 15990 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:56.259804 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:05:56.261196 15618 leader_election.cc:343] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.267081 15770 ts_tablet_manager.cc:1434] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:05:56.269485 15770 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:56.272722 15809 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.274010 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:56.280827 15771 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:56.281077 15729 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.277043 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:56.277292 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:56.279115 15989 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.279663 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.285868 15729 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:56.290997 15993 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.292482 15771 tablet_bootstrap.cc:654] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.297078 16001 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.297824 16001 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.300664 16001 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.301451 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:56.309792 15544 leader_election.cc:343] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.309463 15576 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:56.308826 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:56.307544 16001 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.314814 15807 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.321480 15807 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:56.325045 15544 leader_election.cc:343] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.325490 15544 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:56.325692 15807 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.326195 15993 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:56.326560 15544 leader_election.cc:343] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.328217 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:56.328869 15993 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.318710 15809 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.314800 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:56.316246 16001 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.362428 15927 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.362862 15927 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.363170 15927 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.360091 15809 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:56.382210 16001 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.384219 15769 tablet_bootstrap.cc:654] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.386003 15770 tablet_bootstrap.cc:654] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:56.363634 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 49850.2us
I20260709 13:05:56.389984 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:56.391058 15729 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:56.398573 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:56.399293 15576 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:56.403544 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:56.409435 15544 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.396528 16002 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.414206 16002 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.404399 16046 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:56.416291 16002 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.418699 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:56.406581 16001 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.420759 16001 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.421106 16001 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.421933 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:56.424211 15544 leader_election.cc:343] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.404778 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:56.426832 15769 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:56.427465 15769 ts_tablet_manager.cc:1403] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.194s	user 0.005s	sys 0.009s
I20260709 13:05:56.408182 15867 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.429982 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:56.433041 15544 leader_election.cc:343] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.433794 15544 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:56.411728 15809 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.440541 15989 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.438813 15867 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:56.450956 15544 leader_election.cc:343] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.444025 15927 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.464843 15927 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.466058 16002 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.479976 15771 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:56.480655 15771 ts_tablet_manager.cc:1403] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.200s	user 0.026s	sys 0.016s
I20260709 13:05:56.488258 15867 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:56.492410 15771 raft_consensus.cc:359] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.493001 15771 raft_consensus.cc:385] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.493227 15771 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.564466 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:56.572901 16036 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.560964 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.493723 16001 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.584517 16001 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:56.585975 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:56.587148 15727 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.592355 15770 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
W20260709 13:05:56.595696 15619 leader_election.cc:343] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.605044 15769 raft_consensus.cc:359] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.607285 15770 ts_tablet_manager.cc:1403] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.339s	user 0.018s	sys 0.002s
I20260709 13:05:56.608738 15769 raft_consensus.cc:385] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.616407 15769 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
W20260709 13:05:56.619961 15692 leader_election.cc:343] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.574334 16036 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.629261 15989 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.625540 15769 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.641999 15726 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.644341 15866 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.648766 16036 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:56.650619 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.636627 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:56.641803 15770 raft_consensus.cc:359] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:56.655251 15770 raft_consensus.cc:385] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.655649 15770 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.656440 15770 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:56.632673 15619 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.661465 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:56.666432 15770 ts_tablet_manager.cc:1434] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:05:56.669432 15769 ts_tablet_manager.cc:1434] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.242s	user 0.007s	sys 0.004s
I20260709 13:05:56.685667 15727 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:56.704180 15769 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:56.717397 15769 tablet_bootstrap.cc:654] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.154393 16066 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.155480 16066 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.158597 16066 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.162474 16067 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.174222 15769 tablet_bootstrap.cc:492] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:57.174641 15769 ts_tablet_manager.cc:1403] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.504s	user 0.010s	sys 0.015s
I20260709 13:05:57.177304 15769 raft_consensus.cc:359] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.178012 15769 raft_consensus.cc:385] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.178361 15769 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.179006 15769 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.180367 15769 ts_tablet_manager.cc:1434] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:57.181088 15769 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.188025 15769 tablet_bootstrap.cc:654] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.191128 15619 leader_election.cc:343] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.192603 15619 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:57.193889 16061 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.194531 16061 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:57.195827 16061 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.202808 15769 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:57.203352 15769 ts_tablet_manager.cc:1403] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 13:05:57.208042 15769 raft_consensus.cc:359] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.209005 15769 raft_consensus.cc:385] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.209357 15769 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.210215 15769 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.213003 15769 ts_tablet_manager.cc:1434] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:05:57.216943 15769 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.218461 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:57.221101 15693 leader_election.cc:343] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.221621 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:57.223202 15769 tablet_bootstrap.cc:654] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.226753 15867 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.228272 15769 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
W20260709 13:05:57.228392 15693 leader_election.cc:343] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.228739 15769 ts_tablet_manager.cc:1403] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:05:57.231304 16001 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.231720 15769 raft_consensus.cc:359] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.232434 15769 raft_consensus.cc:385] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.232685 15769 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.233471 15769 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.235774 15769 ts_tablet_manager.cc:1434] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:57.235412 15771 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.236938 15769 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.244431 15769 tablet_bootstrap.cc:654] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.249573 15544 leader_election.cc:343] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.237958 15771 ts_tablet_manager.cc:1434] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.757s	user 0.012s	sys 0.005s
I20260709 13:05:57.250149 15544 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:57.250339 15771 ts_tablet_manager.cc:1467] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Tablet startup took 769ms
W20260709 13:05:57.255255 15650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.004s	sys 0.012s
W20260709 13:05:57.255589 15650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.004s	sys 0.012s
I20260709 13:05:57.253271 15989 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.262467 15809 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.279021 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.280195 15579 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:57.288215 15770 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:57.327845 15993 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.328419 15993 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.330210 15869 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:05:57.330425 15722 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.330849 15869 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.322513 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:57.250821 15771 ts_tablet_manager.cc:1469] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Trace:
0709 13:05:51.553511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.553643 (+   132us) service_pool.cc:224] Handling call
0709 13:05:51.566355 (+ 12712us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:05:51.566455 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:05:51.667184 (+100729us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:51.819069 (+151885us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:51.832093 (+ 13024us) inbound_call.cc:177] Queueing success response
0709 13:05:56.280459 (+4448366us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:56.481018 (+200559us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:56.490352 (+  9334us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:56.490894 (+   542us) tablet_replica.cc:280] Starting consensus
0709 13:05:57.234865 (+743971us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b4c00350a40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d93cdfa20 00007f2d93cf0a29 00007f2d93cb6644 00007f2d93cddf2d 00007f2d93cddb93 00007f2d95a0e18b 00007f2d95a0ecb5 00007f2d95a09f30 00007f2d95a08c40 00007f2d99405b2e 00007f2d9aa27d8a
Metrics: {"raft.queue_time_us":1827,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":174115712,"tablet-open.queue_time_us":4452983}
I20260709 13:05:57.343670 15771 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:57.340550 16067 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.344421 16067 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.344797 16067 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.339205 15869 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.346849 15993 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.350827 15769 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:57.351428 15769 ts_tablet_manager.cc:1403] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.115s	user 0.051s	sys 0.034s
I20260709 13:05:57.352034 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.355608 15692 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:57.361366 15866 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.378732 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.379472 15578 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.383843 15769 raft_consensus.cc:359] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.384801 15769 raft_consensus.cc:385] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.385135 15769 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.385970 15769 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.388295 15769 ts_tablet_manager.cc:1434] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:05:57.388650 15770 tablet_bootstrap.cc:654] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.392241 15769 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.402436 15990 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.404326 16059 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:05:57.404531 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.405329 15576 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.405050 16059 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.410427 15729 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.412429 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:57.460124 15478 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 79) took 1192 ms. Trace:
I20260709 13:05:57.460601 15478 rpcz_store.cc:276] 0709 13:05:56.267180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.267425 (+   245us) service_pool.cc:224] Handling call
0709 13:05:57.459927 (+1192502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":287389,"reported_tablets":2}
I20260709 13:05:57.472566 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.473275 15578 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:57.464555 15477 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.485216 15769 tablet_bootstrap.cc:654] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.485415 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.487246 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.489367 16059 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.492973 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.493621 15723 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
W20260709 13:05:57.491690 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93880us
I20260709 13:05:57.507954 16001 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.539338 16067 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.542152 16001 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.542697 15771 tablet_bootstrap.cc:654] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.547067 15576 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:57.558414 15544 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:57.559481 15989 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.559851 15989 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.560184 15989 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.562747 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.562769 16058 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.567217 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.565412 16001 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.568255 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.569042 15576 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.569347 15619 leader_election.cc:343] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.570470 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.572217 15990 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.572347 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:57.573791 15770 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:57.575233 15770 ts_tablet_manager.cc:1403] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.297s	user 0.014s	sys 0.015s
W20260709 13:05:57.575337 15544 leader_election.cc:343] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.564633 16058 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:57.579851 15693 leader_election.cc:343] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.581043 16058 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.573402 16067 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.585266 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.592509 16001 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.593832 15576 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:57.598235 15769 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:57.598861 15769 ts_tablet_manager.cc:1403] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.006s
I20260709 13:05:57.599888 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.607415 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.607707 15769 raft_consensus.cc:359] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.608495 15769 raft_consensus.cc:385] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.608523 15867 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.608825 15769 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.609091 15867 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:57.609740 15769 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.609899 15867 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.614751 15769 ts_tablet_manager.cc:1434] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:57.615797 15769 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.619249 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.620529 15576 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:57.617880 15770 raft_consensus.cc:359] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.622237 15770 raft_consensus.cc:385] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.622597 15770 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.631681 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.632809 15770 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.619335 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:57.637727 15809 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.644474 15770 ts_tablet_manager.cc:1434] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:05:57.645419 15770 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:57.648717 15809 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:57.649668 15809 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.652563 15771 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:57.653012 15771 ts_tablet_manager.cc:1403] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.310s	user 0.011s	sys 0.011s
I20260709 13:05:57.663287 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.666851 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.675915 15769 tablet_bootstrap.cc:654] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.678278 15869 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.679989 15989 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.681119 16036 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.681814 16036 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.690565 16036 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.682893 15869 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.694392 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.695190 15576 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:57.695608 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:57.696836 15618 consensus_peers.cc:597] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:57.697584 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:57.697921 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:57.682194 16067 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.701948 16036 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.702832 16036 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.702868 15989 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.703301 16036 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.704237 15693 leader_election.cc:343] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.706261 16047 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.713006 16047 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.713382 16047 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.702003 16067 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.714541 15770 tablet_bootstrap.cc:654] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.713630 15927 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.716989 16067 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.720563 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:57.735708 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 51783.8us
W20260709 13:05:57.740631 15509 debug-util.cc:398] Leaking SignalData structure 0x7b080003c5e0 after lost signal to thread 14477
W20260709 13:05:57.741674 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800035f40 after lost signal to thread 15512
W20260709 13:05:57.742743 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08002602e0 after lost signal to thread 15604
W20260709 13:05:57.743695 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800263b60 after lost signal to thread 15679
W20260709 13:05:57.744648 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800272100 after lost signal to thread 15753
W20260709 13:05:57.744897 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800272120 after lost signal to thread 15754
W20260709 13:05:57.745319 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800272360 after lost signal to thread 15960
W20260709 13:05:57.745702 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800272480 after lost signal to thread 16011
I20260709 13:05:57.747371 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.748898 15577 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:57.750336 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:57.751217 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:57.752418 15867 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.752827 15867 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.753151 15867 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.753357 16046 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.759290 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:57.759868 15723 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.760041 15771 raft_consensus.cc:359] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.760831 15771 raft_consensus.cc:385] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.761152 15771 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
W20260709 13:05:57.764134 15544 leader_election.cc:343] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.755760 16047 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.770042 15771 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:57.772040 16093 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:05:57.776194 15867 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.779589 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.779738 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:57.780330 15577 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.782205 15771 ts_tablet_manager.cc:1434] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260709 13:05:57.783401 15771 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:57.786685 15867 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.788635 15654 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:05:57.806339 16036 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.814261 15771 tablet_bootstrap.cc:654] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.820218 15769 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:57.820922 15769 ts_tablet_manager.cc:1403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.205s	user 0.018s	sys 0.007s
I20260709 13:05:57.801180 15723 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:57.822650 16047 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.827988 15544 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.831167 16082 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.831738 16082 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:57.832729 16082 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.837895 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:57.838153 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.838850 15723 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:05:57.840778 16036 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.840910 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:57.841516 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:57.841559 15576 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.842995 15693 leader_election.cc:343] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.842585 15770 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:57.844223 15770 ts_tablet_manager.cc:1403] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.001s
I20260709 13:05:57.845052 15769 raft_consensus.cc:359] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.845872 15769 raft_consensus.cc:385] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.846211 15769 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.846881 15769 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.853262 15577 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:57.853566 15576 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:57.854550 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.855670 16036 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.856562 15769 ts_tablet_manager.cc:1434] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:05:57.856372 16036 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:57.858992 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.859557 16036 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.860430 16066 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.860968 16066 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:57.861860 16066 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.864748 15770 raft_consensus.cc:359] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.865820 15770 raft_consensus.cc:385] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.866266 15770 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.866446 16097 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.867848 15770 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.872372 15770 ts_tablet_manager.cc:1434] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:05:57.869356 16097 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.874841 15770 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:57.864885 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:57.883534 16047 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.884073 16097 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.886418 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:57.887162 15723 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:57.889999 15769 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:57.892637 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.888743 16065 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.894639 15544 leader_election.cc:343] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.893764 16065 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.900597 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.902249 16065 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:57.903968 15989 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.904341 15989 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.904673 15989 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.905686 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:57.906363 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:57.909570 15771 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:57.910040 15771 ts_tablet_manager.cc:1403] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.015s
I20260709 13:05:57.913854 15477 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 80) took 1622 ms. Trace:
W20260709 13:05:57.910404 15693 leader_election.cc:343] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.919426 15769 tablet_bootstrap.cc:654] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.920773 15989 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.922060 15576 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:57.923939 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:57.924896 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:57.926047 16036 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.931396 15770 tablet_bootstrap.cc:654] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.932139 16036 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.937741 15989 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:57.938968 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:57.938863 15478 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.941476 15478 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.914314 15477 rpcz_store.cc:276] 0709 13:05:56.291380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.291912 (+   532us) service_pool.cc:224] Handling call
0709 13:05:57.913797 (+1621885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:57.568795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:57.577240 (+  8445us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:57.582909 (+  5669us) write_op.cc:435] Acquired schema lock
0709 13:05:57.588313 (+  5404us) tablet.cc:662] Decoding operations
0709 13:05:57.589811 (+  1498us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:57.589877 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:57.589913 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:57.590282 (+   369us) tablet.cc:701] Row locks acquired
0709 13:05:57.590320 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:05:57.594601 (+  4281us) write_op.cc:270] Start()
0709 13:05:57.594777 (+   176us) write_op.cc:276] Timestamp: P: 1783602357594522 usec, L: 0
0709 13:05:57.594820 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:05:57.599354 (+  4534us) log.cc:844] Serialized 540 byte log entry
0709 13:05:57.791706 (+192352us) op_driver.cc:464] REPLICATION: finished
0709 13:05:57.888630 (+ 96924us) write_op.cc:301] APPLY: starting
0709 13:05:57.888735 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:57.888848 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:57.891333 (+  2485us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:57.891633 (+   300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:57.891856 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:57.891903 (+    47us) write_op.cc:312] APPLY: finished
0709 13:05:57.892185 (+   282us) log.cc:844] Serialized 22 byte log entry
0709 13:05:57.892371 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:57.892443 (+    72us) write_op.cc:454] Released schema lock
0709 13:05:57.892493 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:57.892808 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:57.892836 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1104128,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":86554,"apply.run_cpu_time_us":2023,"apply.run_wall_time_us":8096,"num_ops":1,"prepare.queue_time_us":91819,"prepare.run_cpu_time_us":12795,"prepare.run_wall_time_us":112939,"raft.queue_time_us":26256,"raft.run_cpu_time_us":34878,"raft.run_wall_time_us":73651,"replication_time_us":177100,"thread_start_us":154052,"threads_started":4,"wal-append.queue_time_us":102816}]]}
W20260709 13:05:57.947628 15544 leader_election.cc:343] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.948726 15771 raft_consensus.cc:359] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.949486 15771 raft_consensus.cc:385] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.956363 15723 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:57.949749 15771 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.959214 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:57.960034 15989 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.960508 15989 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:57.961652 15770 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:57.961289 15989 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.962106 15770 ts_tablet_manager.cc:1403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.008s
I20260709 13:05:57.964810 15770 raft_consensus.cc:359] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.965576 15770 raft_consensus.cc:385] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.965921 15770 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.966836 15770 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.969666 15770 ts_tablet_manager.cc:1434] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:57.971027 15770 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:57.975504 15771 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:57.985126 15771 ts_tablet_manager.cc:1434] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 13:05:57.986380 15771 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.003805 15769 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.004338 15769 ts_tablet_manager.cc:1403] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.006s
I20260709 13:05:58.006503 15770 tablet_bootstrap.cc:654] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.003720 15989 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.008894 15989 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.011660 15771 tablet_bootstrap.cc:654] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.011809 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.015013 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:58.016206 15544 leader_election.cc:343] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.016561 15989 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:05:58.016782 15544 leader_election.cc:343] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.017216 15544 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.017840 15989 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.017544 15475 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.019948 15475 catalog_manager.cc:5697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.021844 15475 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.029003 15769 raft_consensus.cc:359] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.029807 15769 raft_consensus.cc:385] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.033354 15769 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.034075 15770 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.034143 15769 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.034746 15770 ts_tablet_manager.cc:1403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.004s
I20260709 13:05:58.036765 15769 ts_tablet_manager.cc:1434] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:58.037751 15769 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.038373 15770 raft_consensus.cc:359] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.039243 15770 raft_consensus.cc:385] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.039568 15770 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.041965 15771 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.042443 15771 ts_tablet_manager.cc:1403] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.007s
I20260709 13:05:58.046651 16036 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.048224 15771 raft_consensus.cc:359] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.040393 15770 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.050503 15771 raft_consensus.cc:385] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.050851 15771 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.051452 15771 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.052968 15477 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.059500 15771 ts_tablet_manager.cc:1434] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:58.064625 15771 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.061483 15770 ts_tablet_manager.cc:1434] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:58.070107 15770 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.076629 15770 tablet_bootstrap.cc:654] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:58.078013 15693 consensus_peers.cc:597] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.079484 15771 tablet_bootstrap.cc:654] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.083707 15769 tablet_bootstrap.cc:654] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:58.083747 15619 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.085254 15478 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.091114 15478 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.096822 15770 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.097679 15770 ts_tablet_manager.cc:1403] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.011s
I20260709 13:05:58.098517 15769 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.101002 15769 ts_tablet_manager.cc:1403] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.001s
I20260709 13:05:58.103823 15769 raft_consensus.cc:359] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.104588 15769 raft_consensus.cc:385] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.104926 15769 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.098438 16047 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.107633 15769 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.109515 16047 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.110098 16047 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.112852 15770 raft_consensus.cc:359] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.098735 16096 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.113195 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.114547 15576 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:58.113903 15769 ts_tablet_manager.cc:1434] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:58.100389 15771 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.114462 16096 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.115813 15771 ts_tablet_manager.cc:1403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.001s
I20260709 13:05:58.116222 15769 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.117719 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.118285 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:58.118532 15770 raft_consensus.cc:385] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.114799 16047 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.119263 15809 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.119968 15809 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:58.120258 15619 leader_election.cc:343] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.120354 15809 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.119369 15770 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.124043 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.143147 15770 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.144320 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:58.144713 15544 leader_election.cc:343] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.145217 15723 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:58.149847 15809 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.151639 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.153475 15989 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.154233 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:58.157328 15989 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.157402 15579 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.158039 15989 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.158195 15771 raft_consensus.cc:359] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.158946 15771 raft_consensus.cc:385] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.159225 15771 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.159250 15807 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.159814 15807 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.159941 15771 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.154939 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.162019 15771 ts_tablet_manager.cc:1434] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.000s
I20260709 13:05:58.161959 15807 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.163084 15771 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
W20260709 13:05:58.162943 15619 leader_election.cc:343] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.140394 16096 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.164767 16082 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.172353 16082 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.173032 15579 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:58.165833 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.166860 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.171241 15989 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.174552 15654 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
W20260709 13:05:58.183954 15544 leader_election.cc:343] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.175712 16082 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.176307 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:58.184000 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.185910 15729 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:58.186542 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:58.174044 15809 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.187916 15809 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.189009 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.190819 15809 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:58.192394 15807 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.189697 15729 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.192791 15807 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.193176 15807 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.194530 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:58.192207 15769 tablet_bootstrap.cc:654] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.191851 15809 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.200011 15807 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.192203 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:58.204422 15544 leader_election.cc:343] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.205055 15544 leader_election.cc:343] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.206380 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.207005 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:58.207515 15654 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.207808 15807 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.208019 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.218295 16082 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.218742 16082 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.219084 16082 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.223026 15654 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:58.223109 16036 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.223771 16036 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.225353 16082 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.226950 15769 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.227048 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.227321 16036 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.227419 16082 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.227754 15769 ts_tablet_manager.cc:1403] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.001s
I20260709 13:05:58.227805 15579 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:58.229214 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:58.230059 16036 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.230400 16036 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.230806 16036 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.231763 15769 raft_consensus.cc:359] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.232549 15769 raft_consensus.cc:385] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.232906 15769 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.233896 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.233709 15769 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:58.235258 15693 leader_election.cc:343] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.235430 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.236056 15723 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.236428 15769 ts_tablet_manager.cc:1434] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:58.237493 15769 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.238303 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:58.239238 16036 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.242686 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:58.243248 15579 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.244510 15769 tablet_bootstrap.cc:654] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.184744 15989 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.247563 15770 ts_tablet_manager.cc:1434] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.137s	user 0.004s	sys 0.010s
I20260709 13:05:58.248488 15723 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:58.250147 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:58.250902 15544 leader_election.cc:343] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.251744 15544 leader_election.cc:343] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.251842 15770 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.234149 15771 tablet_bootstrap.cc:654] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.252305 16002 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.254956 16002 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:58.255815 16002 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.259945 15729 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:58.260017 16065 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.260041 15579 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:58.261914 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:58.262727 16065 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.263232 16065 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:58.264097 16065 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.266989 16036 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.270450 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:58.274559 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:58.274833 15693 leader_election.cc:343] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.275311 16097 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.275823 16097 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:58.276650 16097 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.284085 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:58.287050 15693 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.292312 16002 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.294987 16002 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:58.296950 15477 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.297716 16002 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.301398 15649 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.302714 15478 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.305892 15769 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.307849 15769 ts_tablet_manager.cc:1403] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.011s
I20260709 13:05:58.324625 15769 raft_consensus.cc:359] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.325332 15769 raft_consensus.cc:385] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.325047 15771 tablet_bootstrap.cc:492] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.325625 15769 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.325855 15771 ts_tablet_manager.cc:1403] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.004s
I20260709 13:05:58.326316 15769 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.329864 15771 raft_consensus.cc:359] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.330583 15771 raft_consensus.cc:385] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.330859 15771 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.334481 15771 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.341275 15771 ts_tablet_manager.cc:1434] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:58.347045 15771 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.347095 15769 ts_tablet_manager.cc:1434] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:05:58.348222 15769 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.352002 16036 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.351918 15476 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.357254 16082 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.358922 16001 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.362217 16001 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.362903 15927 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.363363 15927 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.365208 15927 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.363741 15770 tablet_bootstrap.cc:654] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.376636 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.377964 16065 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.378468 16065 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.380507 16065 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.383013 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:58.386529 15693 leader_election.cc:343] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.386626 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.390869 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.391223 16001 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.391444 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.391695 15724 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:05:58.392201 15692 leader_election.cc:343] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.397082 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.397410 15619 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.398424 16001 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.398852 16036 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.392940 15769 tablet_bootstrap.cc:654] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.394310 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.405193 15723 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:58.388443 15477 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.406683 15477 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.408383 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.411885 15809 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.411763 16065 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.413483 15809 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:05:58.413852 15809 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.415024 16001 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.427211 16001 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.427665 16001 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.436583 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.436866 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.438308 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.439060 16047 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.444278 15771 tablet_bootstrap.cc:654] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.446525 15809 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.450927 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:58.439097 16001 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.459358 15809 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.459937 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.466120 15724 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.460232 16097 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.464639 15654 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.477707 15724 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:05:58.480726 15769 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.480999 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.482926 15809 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.483378 15809 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:58.481201 15769 ts_tablet_manager.cc:1403] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.000s
I20260709 13:05:58.484081 15809 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.480677 15726 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.488590 15807 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.491070 15807 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.491499 15807 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:58.494910 16002 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.495713 16096 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.501879 15770 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.502465 15770 ts_tablet_manager.cc:1403] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.251s	user 0.017s	sys 0.002s
I20260709 13:05:58.505539 15769 raft_consensus.cc:359] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.506237 15769 raft_consensus.cc:385] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.506492 15769 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.507221 15769 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.509698 15769 ts_tablet_manager.cc:1434] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:58.511384 15769 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.506434 15807 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.512315 15807 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.513684 15771 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.514143 15771 ts_tablet_manager.cc:1403] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.003s
I20260709 13:05:58.512449 15770 raft_consensus.cc:359] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.514492 15770 raft_consensus.cc:385] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.514778 15770 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.515312 15770 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.520253 15770 ts_tablet_manager.cc:1434] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:05:58.527938 15770 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
W20260709 13:05:58.529255 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:58.539146 15771 raft_consensus.cc:359] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.542490 15771 raft_consensus.cc:385] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.542814 15771 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.542150 15478 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.543654 15771 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.548192 15771 ts_tablet_manager.cc:1434] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:05:58.554790 15771 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.556165 16065 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.551518 15769 tablet_bootstrap.cc:654] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.556687 16065 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.559077 16065 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.560127 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:58.561406 15693 leader_election.cc:343] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.563928 15771 tablet_bootstrap.cc:654] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.565948 16065 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.566498 16065 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.566524 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:58.568405 15692 leader_election.cc:343] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.568634 16065 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.568847 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.571790 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:58.573231 15693 leader_election.cc:343] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.574471 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:58.575974 15692 leader_election.cc:343] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.576416 15692 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.577207 16067 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.577814 16067 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.580003 16097 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.580482 16097 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.582459 16097 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.585847 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.586503 15720 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:58.587222 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.588534 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:05:58.591244 15544 leader_election.cc:343] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.591260 15807 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.595772 15807 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.596153 15807 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.614161 15769 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.614741 15769 ts_tablet_manager.cc:1403] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.000s
I20260709 13:05:58.615281 15770 tablet_bootstrap.cc:654] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.615352 15807 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.627475 15769 raft_consensus.cc:359] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.628693 15769 raft_consensus.cc:385] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.629000 15769 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.629907 15769 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.631968 15769 ts_tablet_manager.cc:1434] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:58.632879 15769 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.632973 15807 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.636179 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:58.637259 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:58.637842 15720 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:58.638767 15544 leader_election.cc:343] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.641266 15771 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.641758 15771 ts_tablet_manager.cc:1403] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.034s
I20260709 13:05:58.649545 15771 raft_consensus.cc:359] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.650276 15771 raft_consensus.cc:385] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.650532 15771 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.651104 15771 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:58.651975 15544 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.656558 15771 ts_tablet_manager.cc:1434] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:58.660566 15720 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:58.663225 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:05:58.663579 15619 consensus_peers.cc:597] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.664412 16097 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.664922 16097 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:58.665515 15771 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.665699 16097 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.669139 15770 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.669617 15770 ts_tablet_manager.cc:1403] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.018s
I20260709 13:05:58.681540 15770 raft_consensus.cc:359] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.682559 15770 raft_consensus.cc:385] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.682859 15770 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.683480 15770 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.690523 16001 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.694084 15769 tablet_bootstrap.cc:654] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.694448 15771 tablet_bootstrap.cc:654] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.698137 15649 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.698503 16001 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.699009 16001 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.700865 15478 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.702288 16001 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.703033 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.704002 15770 ts_tablet_manager.cc:1434] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
W20260709 13:05:58.705673 15693 consensus_peers.cc:597] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.706367 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.707125 15720 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:05:58.708127 15619 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.708822 16001 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.714264 15770 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.716677 16001 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.726487 15770 tablet_bootstrap.cc:654] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.732717 15771 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.738132 15771 ts_tablet_manager.cc:1403] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.003s
I20260709 13:05:58.744867 15769 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.745394 15769 ts_tablet_manager.cc:1403] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.008s
I20260709 13:05:58.747319 15771 raft_consensus.cc:359] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.748080 15771 raft_consensus.cc:385] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.748337 15771 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.753032 15770 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.753955 15770 ts_tablet_manager.cc:1403] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.006s
I20260709 13:05:58.755460 15769 raft_consensus.cc:359] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.756127 15769 raft_consensus.cc:385] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.756363 15769 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.756410 15770 raft_consensus.cc:359] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.748973 15771 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.757138 15770 raft_consensus.cc:385] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.757411 15770 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.758157 15770 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.760692 15770 ts_tablet_manager.cc:1434] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:58.761997 15770 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.762812 15769 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.759009 15771 ts_tablet_manager.cc:1434] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:58.764621 15771 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.778214 16097 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.780452 15770 tablet_bootstrap.cc:654] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.794889 15769 ts_tablet_manager.cc:1434] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:05:58.798843 15769 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:58.804862 15770 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.805358 15770 ts_tablet_manager.cc:1403] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.011s
W20260709 13:05:58.809262 15544 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:58.810884 15770 raft_consensus.cc:359] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.811563 15770 raft_consensus.cc:385] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.811833 15770 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.812465 15770 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.814504 15770 ts_tablet_manager.cc:1434] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:58.815568 15770 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.817821 16067 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.818382 16067 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.821780 16067 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.822515 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.823987 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:58.825732 15692 leader_election.cc:343] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.828748 15693 leader_election.cc:343] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.829267 15693 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.829703 15807 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.830700 16036 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.830806 16065 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.832244 15770 tablet_bootstrap.cc:654] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.843217 15771 tablet_bootstrap.cc:654] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.844455 15989 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.844954 15989 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.846998 15989 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.848686 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.848635 15807 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.850162 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.854846 15770 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.855329 15770 ts_tablet_manager.cc:1403] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
W20260709 13:05:58.855890 15544 leader_election.cc:343] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:58.856541 15544 leader_election.cc:343] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.856913 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.858444 15989 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.874010 15770 raft_consensus.cc:359] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.878752 15770 raft_consensus.cc:385] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.879493 15770 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.879318 15807 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.883520 15770 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.887413 16096 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.887902 16096 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.888968 15769 tablet_bootstrap.cc:654] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.890539 16096 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.889963 15770 ts_tablet_manager.cc:1434] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:58.897539 15770 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:58.901388 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.903458 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.904165 15770 tablet_bootstrap.cc:654] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.909718 15770 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.910290 15770 ts_tablet_manager.cc:1403] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:58.911746 15771 tablet_bootstrap.cc:492] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:58.912395 15771 ts_tablet_manager.cc:1403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.005s
I20260709 13:05:58.913250 15770 raft_consensus.cc:359] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.914129 15770 raft_consensus.cc:385] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.914489 15770 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.914840 15771 raft_consensus.cc:359] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.915511 15771 raft_consensus.cc:385] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.915200 15770 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.917986 15770 ts_tablet_manager.cc:1434] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:05:58.918802 15544 leader_election.cc:343] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.919972 15770 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
W20260709 13:05:58.926335 15544 leader_election.cc:343] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.926896 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.915789 15771 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.928000 15771 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.929868 15771 ts_tablet_manager.cc:1434] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:05:58.931674 16036 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.932312 16036 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.934376 16036 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:58.935343 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.935729 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:58.937433 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:58.937829 15770 tablet_bootstrap.cc:654] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.938947 15771 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:58.939852 16036 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.940737 16096 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.962728 15771 tablet_bootstrap.cc:654] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.969154 15770 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:58.969648 15770 ts_tablet_manager.cc:1403] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:05:58.974151 15770 raft_consensus.cc:359] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.974876 15770 raft_consensus.cc:385] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.975157 15770 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.981913 15770 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.986999 15989 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.987478 15989 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.989473 15989 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:58.990192 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:58.992425 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:58.993973 15544 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:58.994716 15807 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.995638 15770 ts_tablet_manager.cc:1434] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:05:58.996352 16001 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.997159 15769 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:58.996827 16001 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:58.997614 15769 ts_tablet_manager.cc:1403] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.003s
I20260709 13:05:58.998412 15770 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:59.000064 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.001801 15579 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:59.003127 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.000367 15807 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.004084 15807 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.004475 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.005280 16047 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.005688 16047 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.006063 16047 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.006181 15807 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.008271 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.008973 15724 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:59.000170 15769 raft_consensus.cc:359] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.001042 16001 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.011108 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.015360 15809 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.015899 15809 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.011108 15769 raft_consensus.cc:385] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.018301 15769 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.019568 15769 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.020473 15726 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:59.025878 15771 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.021092 16047 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.030000 15770 tablet_bootstrap.cc:654] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.027290 15579 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.055023 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:59.023708 15769 ts_tablet_manager.cc:1434] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:05:59.055668 15575 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.017863 15809 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.056500 15771 ts_tablet_manager.cc:1403] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.011s
I20260709 13:05:59.021240 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.057281 15769 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:59.025084 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.063651 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:59.012822 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.064563 15809 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.065243 15807 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.065590 15807 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.063630 15771 raft_consensus.cc:359] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.065934 15807 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.066231 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 53503.2us
W20260709 13:05:59.074209 15544 leader_election.cc:343] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.074651 15771 raft_consensus.cc:385] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.079303 15771 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.080807 15771 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.085237 15771 ts_tablet_manager.cc:1434] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:05:59.086381 15771 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.074041 15807 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.088003 15807 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.078990 15769 tablet_bootstrap.cc:654] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.084055 15770 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:59.088959 15770 ts_tablet_manager.cc:1403] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.000s
I20260709 13:05:59.090211 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:59.091914 15770 raft_consensus.cc:359] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.092648 15770 raft_consensus.cc:385] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.092991 15770 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.093788 15770 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.103533 15770 ts_tablet_manager.cc:1434] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:59.105149 15575 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:59.106572 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.107088 15771 tablet_bootstrap.cc:654] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.106984 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:59.107519 15809 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.107677 15726 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.108028 15809 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:59.108835 15809 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.119318 16047 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.120616 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:59.121266 15724 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.128162 15771 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.128360 15724 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:59.128659 15771 ts_tablet_manager.cc:1403] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.006s
I20260709 13:05:59.129663 15769 tablet_bootstrap.cc:492] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.130569 15769 ts_tablet_manager.cc:1403] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.003s
I20260709 13:05:59.131258 15771 raft_consensus.cc:359] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.129709 15720 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.131904 15771 raft_consensus.cc:385] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.132216 15771 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.120616 15770 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:59.132862 15771 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.133148 16047 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.139734 15807 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.140172 15807 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.141820 15807 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.139442 15769 raft_consensus.cc:359] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.143190 15769 raft_consensus.cc:385] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.143488 15769 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.144367 15769 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.146517 15769 ts_tablet_manager.cc:1434] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:05:59.147451 15769 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
W20260709 13:05:59.147564 15544 leader_election.cc:343] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.145444 15770 tablet_bootstrap.cc:654] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:59.148778 15544 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.151331 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:59.153965 15544 leader_election.cc:343] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.155144 15575 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.155170 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.156003 15722 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:59.156998 15771 ts_tablet_manager.cc:1434] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:05:59.158597 15771 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.156860 16047 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:59.163136 15726 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:59.176887 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:59.178373 15989 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.178745 15989 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.179073 15989 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.182797 15769 tablet_bootstrap.cc:654] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.195659 15989 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.197956 15989 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.202114 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:59.203399 15770 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:59.203846 15770 ts_tablet_manager.cc:1403] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.003s
I20260709 13:05:59.205531 15989 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.209573 15649 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.215543 16097 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.216106 16097 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.216569 15770 raft_consensus.cc:359] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.217751 15770 raft_consensus.cc:385] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.225170 15770 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.220294 15720 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.226573 15771 tablet_bootstrap.cc:654] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.219344 16097 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.234624 15478 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.236006 15770 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.240372 15770 ts_tablet_manager.cc:1434] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:05:59.240239 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:59.242385 15770 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:59.243491 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:59.244823 15726 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.247445 15989 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:59.248190 15989 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.251196 15726 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:59.256013 15726 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.268345 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.275309 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.281904 15771 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.282469 15771 ts_tablet_manager.cc:1403] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.008s
I20260709 13:05:59.288965 15770 tablet_bootstrap.cc:654] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.285176 15771 raft_consensus.cc:359] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.291961 15771 raft_consensus.cc:385] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.292263 15771 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.296733 15769 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.297317 15769 ts_tablet_manager.cc:1403] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.020s
I20260709 13:05:59.299301 15771 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.289809 16165 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.302416 16165 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.305377 15770 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:59.306016 15770 ts_tablet_manager.cc:1403] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.005s
I20260709 13:05:59.307351 16165 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.304071 15771 ts_tablet_manager.cc:1434] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:05:59.312845 15770 raft_consensus.cc:359] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.315681 15771 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.316056 15770 raft_consensus.cc:385] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.316430 15770 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.320859 15770 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.314703 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.318599 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.323426 15649 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:59.323448 15720 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 0.
I20260709 13:05:59.323742 15771 tablet_bootstrap.cc:654] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.324586 15770 ts_tablet_manager.cc:1434] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:05:59.325673 15770 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Bootstrap starting.
I20260709 13:05:59.327663 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.334234 16164 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.334367 16047 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.334786 16164 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:59.334944 16047 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.336253 16096 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.336563 16164 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:05:59.337735 15544 leader_election.cc:343] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.340263 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.340400 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:59.341068 15544 leader_election.cc:343] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.341009 16097 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.341699 16097 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.342070 16097 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.342927 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:59.343482 15544 leader_election.cc:343] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.343884 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:59.344501 16096 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.344573 16047 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.347072 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:59.348242 15809 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.349102 16097 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.353797 15770 tablet_bootstrap.cc:654] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.354194 15769 raft_consensus.cc:359] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.355621 15769 raft_consensus.cc:385] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:59.355738 15681 tablet.cc:2406] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:59.356256 16097 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.359469 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:59.360184 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:05:59.361663 15769 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.368250 15769 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.369685 15649 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.370507 15769 ts_tablet_manager.cc:1434] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.003s
I20260709 13:05:59.371544 15769 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:59.361050 15476 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.381987 15722 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.391335 15655 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.393898 15927 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.395713 15927 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.428104 15809 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.428584 15809 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.433429 15649 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:59.433743 15809 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.446305 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.447322 15724 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:59.449723 15927 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.452417 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:59.453877 15769 tablet_bootstrap.cc:654] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.464612 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:59.467412 15619 leader_election.cc:343] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.455158 15927 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.468606 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.470609 16082 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.474078 16082 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:05:59.474968 16082 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.476248 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.476909 15575 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:05:59.478566 15771 tablet_bootstrap.cc:492] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.470826 15927 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.480198 15771 ts_tablet_manager.cc:1403] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.165s	user 0.035s	sys 0.026s
I20260709 13:05:59.482998 15927 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.488340 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:59.488904 15722 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:05:59.489333 15478 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.505519 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:05:59.508769 15618 leader_election.cc:343] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.509595 15809 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.509975 15809 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.510308 15809 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.516109 15809 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.517889 15809 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.519914 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:05:59.521302 15619 leader_election.cc:343] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.497694 15927 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.548998 15927 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.550074 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:05:59.550688 15724 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.550963 15771 raft_consensus.cc:359] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.551846 15771 raft_consensus.cc:385] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.552170 15771 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.553120 15770 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: No bootstrap required, opened a new log
I20260709 13:05:59.553580 15770 ts_tablet_manager.cc:1403] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent bootstrapping tablet: real 0.228s	user 0.028s	sys 0.011s
I20260709 13:05:59.556066 15770 raft_consensus.cc:359] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.552950 15771 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.556707 15770 raft_consensus.cc:385] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.557030 15770 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.559684 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:59.560480 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:59.560954 16178 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.561200 15577 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.568562 15771 ts_tablet_manager.cc:1434] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.003s
I20260709 13:05:59.572512 15724 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:59.574141 15771 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.574014 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:05:59.578830 15927 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.579341 15927 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:59.580144 15927 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.584196 15478 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.588881 16047 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.589246 16002 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.589689 16002 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.591611 16002 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.557634 15770 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.592224 15573 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.593808 15770 ts_tablet_manager.cc:1434] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.004s
I20260709 13:05:59.599279 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.599687 15573 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:59.600083 15769 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.600033 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:05:59.608326 15544 leader_election.cc:343] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:59.609001 15544 leader_election.cc:343] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.602749 15769 ts_tablet_manager.cc:1403] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.231s	user 0.002s	sys 0.037s
I20260709 13:05:59.609412 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:59.613896 16184 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.611711 15577 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:05:59.618803 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:05:59.619928 15927 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.620997 15927 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:05:59.621776 15927 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.635986 15769 raft_consensus.cc:359] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.650303 15769 raft_consensus.cc:385] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:59.642534 15526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:59.651037 15769 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.651769 15769 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.653743 15769 ts_tablet_manager.cc:1434] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.004s
I20260709 13:05:59.663836 15771 tablet_bootstrap.cc:654] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.666018 15478 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.675494 15807 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.683045 15769 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
W20260709 13:05:59.703928 15544 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.720006 15769 tablet_bootstrap.cc:654] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.727663 15477 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.730454 15771 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.731073 15771 ts_tablet_manager.cc:1403] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.012s
I20260709 13:05:59.735527 15771 raft_consensus.cc:359] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.736299 15771 raft_consensus.cc:385] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.736641 15771 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.737315 15771 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.747117 15771 ts_tablet_manager.cc:1434] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:05:59.748095 15769 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.748198 15771 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.748785 15769 ts_tablet_manager.cc:1403] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.013s
I20260709 13:05:59.751770 15769 raft_consensus.cc:359] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.752420 15769 raft_consensus.cc:385] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.752698 15769 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.753364 15769 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.755121 16065 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.755584 16065 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.757589 16065 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:59.760496 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.761135 15578 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:59.760504 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:05:59.763546 15693 leader_election.cc:343] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.764148 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:05:59.764164 15769 ts_tablet_manager.cc:1434] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:05:59.766691 16065 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.767063 15769 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:59.755080 15771 tablet_bootstrap.cc:654] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.767215 16065 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.778944 16065 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.789815 16082 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.798416 15769 tablet_bootstrap.cc:654] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.807621 15649 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.824358 16165 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.825152 15771 tablet_bootstrap.cc:492] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.825624 15771 ts_tablet_manager.cc:1403] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.018s
I20260709 13:05:59.828820 15771 raft_consensus.cc:359] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.829558 15771 raft_consensus.cc:385] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.829941 15771 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.829668 16065 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.830685 15771 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.832980 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:05:59.833591 15578 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.833930 15771 ts_tablet_manager.cc:1434] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:59.834991 15771 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.840773 15771 tablet_bootstrap.cc:654] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.852622 16065 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:59.853685 15578 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:05:59.854909 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.856653 16036 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.860848 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:05:59.863746 15693 leader_election.cc:343] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.865092 16036 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:05:59.866117 16036 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.875109 16001 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.876005 16001 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.879509 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.880427 16001 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.880651 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.883261 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:59.883787 15769 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.884274 15769 ts_tablet_manager.cc:1403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.021s
I20260709 13:05:59.884840 16001 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.887154 15769 raft_consensus.cc:359] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.888342 15769 raft_consensus.cc:385] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.888665 15769 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.889122 15771 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.890349 15771 ts_tablet_manager.cc:1403] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.016s
I20260709 13:05:59.892760 15771 raft_consensus.cc:359] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.893255 15771 raft_consensus.cc:385] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.893487 15771 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.894203 15771 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.896131 15771 ts_tablet_manager.cc:1434] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:59.895668 15477 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.897176 15771 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.890280 15769 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.901599 15769 ts_tablet_manager.cc:1434] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:05:59.905238 15769 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:05:59.902689 15771 tablet_bootstrap.cc:654] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.913167 15769 tablet_bootstrap.cc:654] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.923913 16036 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.924458 16036 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.927556 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.935024 15771 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:05:59.935647 15771 ts_tablet_manager.cc:1403] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.007s
I20260709 13:05:59.936954 16065 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.938803 16001 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.939303 16001 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.939934 15771 raft_consensus.cc:359] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.939893 16036 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:59.940598 15771 raft_consensus.cc:385] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.940884 15771 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.941761 15771 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.943439 15771 ts_tablet_manager.cc:1434] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:59.944423 15771 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:05:59.950603 15771 tablet_bootstrap.cc:654] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.955127 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:05:59.974480 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.977314 15693 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:59.937455 16065 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.980713 16036 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.981529 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.973690 15769 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:05:59.982205 15573 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:59.982395 15769 ts_tablet_manager.cc:1403] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.004s
I20260709 13:05:59.983640 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:05:59.984419 16036 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.984903 16036 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.985327 16036 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.985142 15769 raft_consensus.cc:359] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.985857 15769 raft_consensus.cc:385] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.985976 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:05:59.986189 15769 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.986979 15769 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:05:59.987484 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:05:59.988471 16047 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.941704 16001 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:05:59.994186 16065 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:05:59.996616 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:05:59.997172 15654 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:05:59.999025 15769 ts_tablet_manager.cc:1434] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:59.999719 16165 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.017584 16036 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.021522 15927 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.023579 15769 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:06:00.045265 16002 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.046458 15927 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.048005 15771 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:06:00.048435 15771 ts_tablet_manager.cc:1403] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.104s	user 0.053s	sys 0.047s
I20260709 13:06:00.048485 15927 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:00.051090 15771 raft_consensus.cc:359] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.051505 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:00.051843 15771 raft_consensus.cc:385] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.052142 15771 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.052790 15771 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.053726 15769 tablet_bootstrap.cc:654] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.054895 15771 ts_tablet_manager.cc:1434] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:00.055953 15771 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:06:00.058339 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:00.059278 15578 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:00.060670 15618 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:00.061753 16047 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.061753 15771 tablet_bootstrap.cc:654] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.078504 16047 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.091580 15769 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:06:00.092058 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:00.092723 15655 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.092993 16036 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:00.100778 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:00.101465 15578 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.115106 15771 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:06:00.115700 15771 ts_tablet_manager.cc:1403] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.012s
I20260709 13:06:00.115763 16001 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.105535 15655 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:00.124214 15693 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:00.092172 15769 ts_tablet_manager.cc:1403] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.006s
I20260709 13:06:00.125140 16204 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.125010 15771 raft_consensus.cc:359] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.125820 15771 raft_consensus.cc:385] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.125754 16204 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:00.129281 15578 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:00.127291 16204 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.129114 15720 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.138182 15654 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.139998 15724 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.126222 15771 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.130246 15655 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.149096 15809 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.148355 15771 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.151192 15771 ts_tablet_manager.cc:1434] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:00.152107 15771 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Bootstrap starting.
I20260709 13:06:00.168751 15477 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.176582 15771 tablet_bootstrap.cc:654] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.182521 15809 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.185494 15769 raft_consensus.cc:359] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.189591 15771 tablet_bootstrap.cc:492] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: No bootstrap required, opened a new log
I20260709 13:06:00.201906 15771 ts_tablet_manager.cc:1403] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.000s
I20260709 13:06:00.204933 15771 raft_consensus.cc:359] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.193662 16178 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:06:00.205758 15771 raft_consensus.cc:385] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.211195 15771 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.212225 15771 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.216454 15771 ts_tablet_manager.cc:1434] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:06:00.186210 15769 raft_consensus.cc:385] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.217284 15769 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.218467 15769 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.242177 15769 ts_tablet_manager.cc:1434] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 13:06:00.243788 15769 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Bootstrap starting.
I20260709 13:06:00.251009 15769 tablet_bootstrap.cc:654] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.267887 15769 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: No bootstrap required, opened a new log
I20260709 13:06:00.268369 15769 ts_tablet_manager.cc:1403] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 13:06:00.271128 15769 raft_consensus.cc:359] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.271818 15769 raft_consensus.cc:385] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.272094 15769 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.280478 15769 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.282709 15769 ts_tablet_manager.cc:1434] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:06:00.283571 16178 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.284057 16178 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.287019 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:00.287614 15578 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:06:00.289301 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:00.290057 15927 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.290398 15927 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.290704 15927 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.298571 16036 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.299176 16036 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.301337 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:00.303356 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:00.301981 15724 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 0.
I20260709 13:06:00.305105 15649 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.309566 16178 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:00.310037 15927 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.312047 15655 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:00.312206 15927 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:00.312312 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:00.313012 15578 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:06:00.314102 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:00.314172 15692 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:00.314657 15578 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.315102 16065 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.315481 16065 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.315811 16065 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.320114 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:00.323729 16036 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:00.331307 15578 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:00.332691 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:00.333555 16178 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.334659 16178 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:00.335719 16178 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.342741 16065 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.344528 15724 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 1: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:00.348316 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:00.349056 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:00.349797 15578 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 1: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:00.350152 16065 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:00.351858 15692 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:00.352972 16065 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.367812 15477 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 0 to 1, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.397022 16065 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.411706 16204 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.575007 16203 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.588757 16203 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.593144 16067 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.593662 16067 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.596868 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:00.597452 15655 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:06:00.597731 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:00.598439 15573 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 0.
I20260709 13:06:00.598716 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:00.599550 16203 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.595818 16067 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:00.599989 16203 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.600353 16203 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.620884 16203 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.623824 16203 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:00.624545 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:00.625208 15573 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.625164 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:00.625860 15654 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.632263 15573 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:00.633414 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:00.639185 16067 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.639572 15654 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:00.639716 16067 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:00.640626 16067 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:00.655757 15478 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.733768 15927 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.765842 16178 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.068703 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:01.118134 16226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.123740 16229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:01.124907 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:01.128255 14474 server_base.cc:1061] running on GCE node
I20260709 13:06:01.129779 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:01.130115 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:01.130354 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602361130338 us; error 0 us; skew 500 ppm
I20260709 13:06:01.132417 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:01.146628 14474 webserver.cc:533] Webserver started at http://127.14.34.132:39527/ using document root <none> and password file <none>
I20260709 13:06:01.147399 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:01.147684 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:01.148121 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:01.149827 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-3-root/instance:
uuid: "681370bcf39d46b189ec8e9a5957f93d"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-nr1f"
I20260709 13:06:01.156602 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:06:01.175578 16234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.179790 14474 fs_manager.cc:730] Time spent opening block manager: real 0.018s	user 0.004s	sys 0.009s
I20260709 13:06:01.180202 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
uuid: "681370bcf39d46b189ec8e9a5957f93d"
format_stamp: "Formatted at 2026-07-09 13:06:01 on dist-test-slave-nr1f"
I20260709 13:06:01.180574 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:01.205734 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:01.207692 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:01.209990 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:01.213601 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:01.213872 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.214210 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:01.214452 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:01.249728 16204 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.280000 16067 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.417992 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.132:39301
I20260709 13:06:01.418202 16302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.132:39301 every 8 connection(s)
I20260709 13:06:01.424975 14474 auto_leader_rebalancer-test.cc:384] add a tserver: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:01.451561 16303 heartbeater.cc:344] Connected to a master server at 127.14.34.190:46799
I20260709 13:06:01.452067 16303 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:01.452912 16303 heartbeater.cc:507] Master 127.14.34.190:46799 requested a full tablet report, sending...
I20260709 13:06:01.454797 15476 ts_manager.cc:194] Registered new tserver with Master: 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:01.456164 15476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46872
I20260709 13:06:01.818831 15573 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:01.825744 15726 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:01.828490 15654 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:01.830982 15807 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.832682 15807 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:01.849581 15543 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6043256b63964d729edc1a480d265404. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.858856 16165 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:01.859979 15655 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:01.887955 15476 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:01.925726 15720 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:01.950954 15654 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:01.977026 15726 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:01.978724 15927 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.993664 15577 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:01.995489 16258 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:02.009768 16258 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:02.019292 15618 consensus_peers.cc:597] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f560ec7039940e59212368b2f12385e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.020262 15724 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.024646 15578 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.041834 15477 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.068502 15578 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.079967 15724 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:02.080835 15543 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78b5c231d4c74287b7bcdae567611bea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.082366 16312 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.083115 15655 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.089001 15807 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.100452 15807 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.102424 15724 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.127987 15649 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.134198 15478 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.148298 15654 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.159409 15723 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:02.159818 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 070f910fe7cf4a4ca2ca43b63d4d997f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.161420 16318 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.163189 15578 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.164479 16318 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.190510 15578 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.188651 16258 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.212903 15478 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.214428 15726 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:02.361553 16337 ts_tablet_manager.cc:933] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:02.376899 16337 tablet_copy_client.cc:323] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:02.397444 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 6043256b63964d729edc1a480d265404 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:02.398087 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 6043256b63964d729edc1a480d265404 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-6043256b63964d729edc1a480d265404
I20260709 13:06:02.406278 15590 tablet_copy_source_session.cc:215] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:02.410503 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6043256b63964d729edc1a480d265404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.430512 16337 tablet_copy_client.cc:806] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:02.431157 16337 tablet_copy_client.cc:670] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:02.436643 16337 tablet_copy_client.cc:538] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.447463 16337 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:02.458711 16303 heartbeater.cc:499] Master 127.14.34.190:46799 was elected leader, sending a full tablet report...
I20260709 13:06:02.485646 16342 ts_tablet_manager.cc:933] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:02.494324 16342 tablet_copy_client.cc:323] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:02.672992 16337 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.674093 16337 tablet_bootstrap.cc:492] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:02.674795 16337 ts_tablet_manager.cc:1403] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.228s	user 0.088s	sys 0.104s
I20260709 13:06:02.677765 16337 raft_consensus.cc:359] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.678697 16337 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:02.679373 16337 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.691514 16337 ts_tablet_manager.cc:1434] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:02.700030 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-6043256b63964d729edc1a480d265404 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:02.700569 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-6043256b63964d729edc1a480d265404 on tablet 6043256b63964d729edc1a480d265404 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:02.707515 15665 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 4f560ec7039940e59212368b2f12385e from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:02.708139 15665 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 4f560ec7039940e59212368b2f12385e from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-4f560ec7039940e59212368b2f12385e
I20260709 13:06:02.716785 16345 ts_tablet_manager.cc:933] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:02.722591 16337 ts_tablet_manager.cc:933] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:02.726099 16345 tablet_copy_client.cc:323] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:02.728119 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 78b5c231d4c74287b7bcdae567611bea from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:02.728626 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 78b5c231d4c74287b7bcdae567611bea from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-78b5c231d4c74287b7bcdae567611bea
I20260709 13:06:02.742957 15665 tablet_copy_source_session.cc:215] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:02.746479 15590 tablet_copy_source_session.cc:215] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:02.753952 16278 raft_consensus.cc:1217] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:02.754755 16337 tablet_copy_client.cc:323] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:02.756508 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 070f910fe7cf4a4ca2ca43b63d4d997f from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:02.757102 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 070f910fe7cf4a4ca2ca43b63d4d997f from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-070f910fe7cf4a4ca2ca43b63d4d997f
I20260709 13:06:02.753093 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b5c231d4c74287b7bcdae567611bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.771006 15664 tablet_copy_source_session.cc:215] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:02.774463 16337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070f910fe7cf4a4ca2ca43b63d4d997f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.787755 16345 tablet_copy_client.cc:806] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:02.788355 16345 tablet_copy_client.cc:670] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:02.792886 16345 tablet_copy_client.cc:538] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.793411 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f560ec7039940e59212368b2f12385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:02.804536 16345 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:02.808132 16337 tablet_copy_client.cc:806] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:02.809196 16342 tablet_copy_client.cc:806] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:02.810608 16342 tablet_copy_client.cc:670] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:02.810209 16337 tablet_copy_client.cc:670] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:02.816316 16342 tablet_copy_client.cc:538] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.818123 16337 tablet_copy_client.cc:538] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:02.829005 16337 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:02.835162 16342 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:02.871495 16337 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.872085 16345 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.879797 16345 tablet_bootstrap.cc:492] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:02.880538 16345 ts_tablet_manager.cc:1403] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.007s
I20260709 13:06:02.878917 16342 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:02.884114 16342 tablet_bootstrap.cc:492] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:02.884913 16342 ts_tablet_manager.cc:1403] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.010s
I20260709 13:06:02.885295 16345 raft_consensus.cc:359] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.886253 16345 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:02.886965 16345 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.872462 16337 tablet_bootstrap.cc:492] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:02.889299 16337 ts_tablet_manager.cc:1403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.013s
I20260709 13:06:02.891186 16345 ts_tablet_manager.cc:1434] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:06:02.892086 16337 raft_consensus.cc:359] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.892756 16337 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:02.893267 16337 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.887912 16342 raft_consensus.cc:359] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.894727 16342 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:02.895471 16337 ts_tablet_manager.cc:1434] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:02.895437 16342 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:02.896313 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78b5c231d4c74287b7bcdae567611bea received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:02.896723 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78b5c231d4c74287b7bcdae567611bea on tablet 78b5c231d4c74287b7bcdae567611bea with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:02.898144 16342 ts_tablet_manager.cc:1434] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:02.900102 15665 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-4f560ec7039940e59212368b2f12385e received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:02.900540 15665 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-4f560ec7039940e59212368b2f12385e on tablet 4f560ec7039940e59212368b2f12385e with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:02.908579 15665 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-070f910fe7cf4a4ca2ca43b63d4d997f received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:02.908979 15665 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-070f910fe7cf4a4ca2ca43b63d4d997f on tablet 070f910fe7cf4a4ca2ca43b63d4d997f with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:02.992766 16278 raft_consensus.cc:1217] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.054121 16278 raft_consensus.cc:1217] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.262637 16165 raft_consensus.cc:1064] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:03.265970 16165 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.283191 16278 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.286947 15654 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.288585 16353 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.291540 15807 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.288470 15726 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.302345 16353 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.331897 16278 raft_consensus.cc:1217] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.355129 15807 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.364614 15650 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.377787 16277 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.385979 15477 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.452369 16362 raft_consensus.cc:1064] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:03.472249 16362 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.475430 15724 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.502117 15724 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.503744 15927 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.504160 16277 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.503746 15577 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.506603 16318 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:03.510067 16363 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.528841 16362 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.532469 15578 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.538575 16277 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.553896 16278 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.555783 15807 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:03.567279 15476 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.567965 16165 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.569861 15724 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.570519 15577 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.575479 16278 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.590706 15724 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.598871 16358 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:03.599767 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6043256b63964d729edc1a480d265404 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:03.606999 15654 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.609450 15476 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.619930 15726 raft_consensus.cc:2955] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.626389 16278 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.632275 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 6043256b63964d729edc1a480d265404 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:03.632139 16318 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:03.648010 16371 tablet_replica.cc:333] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:03.649852 16258 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.655509 15723 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.659613 16318 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:03.661654 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f560ec7039940e59212368b2f12385e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:03.672731 15724 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.673380 15476 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.656123 16278 raft_consensus.cc:2955] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.677860 16371 raft_consensus.cc:2243] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.682647 16371 raft_consensus.cc:2272] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.690837 16359 raft_consensus.cc:1064] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:03.693238 16359 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.701432 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f560ec7039940e59212368b2f12385e with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:03.718926 16371 ts_tablet_manager.cc:1916] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:03.734751 16278 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.737211 16317 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.753074 15724 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.755311 16373 tablet_replica.cc:333] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:03.756093 15650 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:03.760458 16371 ts_tablet_manager.cc:1929] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:03.760967 16371 log.cc:1199] T 6043256b63964d729edc1a480d265404 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/6043256b63964d729edc1a480d265404
I20260709 13:06:03.761103 16317 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.766957 16353 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.766007 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 6043256b63964d729edc1a480d265404 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:03.780193 16373 raft_consensus.cc:2243] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:03.781054 16373 raft_consensus.cc:2272] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:03.785526 16373 ts_tablet_manager.cc:1916] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:03.808187 16373 ts_tablet_manager.cc:1929] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:03.808581 16373 log.cc:1199] T 4f560ec7039940e59212368b2f12385e P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/4f560ec7039940e59212368b2f12385e
I20260709 13:06:03.810218 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 4f560ec7039940e59212368b2f12385e (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:03.821868 16353 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.831393 15724 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.834801 16277 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.842710 15476 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.860126 15578 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.897742 15655 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.900665 16358 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.908022 15655 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.917762 16278 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:03.919958 16358 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:03.928153 16353 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.949909 16318 raft_consensus.cc:1064] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:03.960532 15650 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.963855 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78b5c231d4c74287b7bcdae567611bea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:03.966930 16278 raft_consensus.cc:2955] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:03.967703 16318 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:03.988850 15478 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.014289 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 78b5c231d4c74287b7bcdae567611bea with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:04.016652 16379 tablet_replica.cc:333] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:04.017755 16379 raft_consensus.cc:2243] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.018584 16379 raft_consensus.cc:2272] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.022013 16379 ts_tablet_manager.cc:1916] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.026535 15724 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.038174 16379 ts_tablet_manager.cc:1929] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.038697 16379 log.cc:1199] T 78b5c231d4c74287b7bcdae567611bea P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/78b5c231d4c74287b7bcdae567611bea
I20260709 13:06:04.040509 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 78b5c231d4c74287b7bcdae567611bea (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:04.043562 16362 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.046581 16278 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.048017 16318 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.055290 15577 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.058537 16362 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:04.083166 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72876us
I20260709 13:06:04.095191 16362 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.102571 15724 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.128317 15578 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.172442 15475 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.185524 16278 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.204876 15655 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:04.220491 16277 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.227453 15578 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.229480 16318 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.231431 16318 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.251914 16363 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.258296 16277 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.260288 15578 raft_consensus.cc:2955] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.272830 15476 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:04.281697 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 070f910fe7cf4a4ca2ca43b63d4d997f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.286142 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 070f910fe7cf4a4ca2ca43b63d4d997f with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:04.287175 16379 tablet_replica.cc:333] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:04.288203 16379 raft_consensus.cc:2243] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.289018 16379 raft_consensus.cc:2272] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.294737 16379 ts_tablet_manager.cc:1916] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.330188 16379 ts_tablet_manager.cc:1929] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.330610 16379 log.cc:1199] T 070f910fe7cf4a4ca2ca43b63d4d997f P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/070f910fe7cf4a4ca2ca43b63d4d997f
I20260709 13:06:04.333854 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 070f910fe7cf4a4ca2ca43b63d4d997f (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
W20260709 13:06:05.311802 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45279.6us
W20260709 13:06:05.340132 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54752.1us
W20260709 13:06:05.498359 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 171598us
W20260709 13:06:05.546351 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 203461us
I20260709 13:06:05.706610 15722 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:05.721832 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 222339us
I20260709 13:06:05.763223 15650 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:05.764114 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67008.5us
I20260709 13:06:05.775420 16393 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.811543 15578 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:05.826339 16401 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.828857 16401 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:05.830152 15650 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:05.849534 15475 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:05.857544 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b42acde8d7184571acdbe8d34af2df1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.873595 15655 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:05.883066 15578 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:05.924294 15723 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:05.925577 15618 consensus_peers.cc:597] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a514609784146e8a8b6917d543f83e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:05.926504 16258 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.938510 15573 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:05.940064 16258 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.956969 16388 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:05.958122 15573 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:05.982791 15573 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.071784 15722 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:06.073699 15543 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a52b1ff912bd4f07a795a7bfccb8a2f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.074002 15724 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.075827 16397 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.088974 15655 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.112860 16397 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.129920 16386 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.131778 15476 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.162818 15724 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.172489 15650 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.191486 15478 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:06.217679 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89f37c80078841efa574af907a802c86. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.219707 15577 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.221431 16394 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.227486 15724 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.229961 15655 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.238394 16258 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.260039 16387 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.263688 15573 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:06.292686 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800168760 after lost signal to thread 14477
W20260709 13:06:06.293713 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800168580 after lost signal to thread 15512
W20260709 13:06:06.294958 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000aee80 after lost signal to thread 15604
W20260709 13:06:06.297016 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3000 after lost signal to thread 15679
W20260709 13:06:06.298156 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800305480 after lost signal to thread 15753
I20260709 13:06:06.312294 15724 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.319509 15476 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:06.324630 16430 ts_tablet_manager.cc:933] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:06.340288 16430 tablet_copy_client.cc:323] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:06.434880 15739 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet b42acde8d7184571acdbe8d34af2df1f from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:06.435458 15739 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet b42acde8d7184571acdbe8d34af2df1f from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-b42acde8d7184571acdbe8d34af2df1f
I20260709 13:06:06.454581 15739 tablet_copy_source_session.cc:215] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.457659 16430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42acde8d7184571acdbe8d34af2df1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.475049 16434 ts_tablet_manager.cc:933] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:06.484335 16434 tablet_copy_client.cc:323] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:06.484319 16430 tablet_copy_client.cc:806] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.485839 16430 tablet_copy_client.cc:670] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.486346 15665 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 6a514609784146e8a8b6917d543f83e7 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:06.486984 15665 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 6a514609784146e8a8b6917d543f83e7 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-6a514609784146e8a8b6917d543f83e7
I20260709 13:06:06.490070 16430 tablet_copy_client.cc:538] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.501401 16430 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:06.508169 15665 tablet_copy_source_session.cc:215] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.512725 16434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a514609784146e8a8b6917d543f83e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.533687 16430 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.534951 16430 tablet_bootstrap.cc:492] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:06.536034 16430 ts_tablet_manager.cc:1403] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.002s
I20260709 13:06:06.539374 16430 raft_consensus.cc:359] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.540335 16430 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:06.541112 16430 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.541808 16434 tablet_copy_client.cc:806] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.544070 16434 tablet_copy_client.cc:670] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.548133 16434 tablet_copy_client.cc:538] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.563161 16430 ts_tablet_manager.cc:1434] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:06:06.565086 16434 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:06.565418 15739 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-b42acde8d7184571acdbe8d34af2df1f received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:06.565924 15739 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-b42acde8d7184571acdbe8d34af2df1f on tablet b42acde8d7184571acdbe8d34af2df1f with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:06.581204 16438 ts_tablet_manager.cc:933] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:06.597963 16434 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.599161 16434 tablet_bootstrap.cc:492] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:06.600080 16434 ts_tablet_manager.cc:1403] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.004s
I20260709 13:06:06.603351 16434 raft_consensus.cc:359] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.604450 16434 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:06.605219 16434 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:06.608081 16434 ts_tablet_manager.cc:1434] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:06.627619 15665 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-6a514609784146e8a8b6917d543f83e7 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:06.628250 15665 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-6a514609784146e8a8b6917d543f83e7 on tablet 6a514609784146e8a8b6917d543f83e7 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:06.725800 16434 ts_tablet_manager.cc:933] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:06.738243 16434 tablet_copy_client.cc:323] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:06.748208 16438 tablet_copy_client.cc:323] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:06.800311 15665 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 89f37c80078841efa574af907a802c86 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:06.802000 15665 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 89f37c80078841efa574af907a802c86 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-89f37c80078841efa574af907a802c86
I20260709 13:06:06.837193 16278 raft_consensus.cc:1217] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:06.860868 15665 tablet_copy_source_session.cc:215] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.902159 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:06.903131 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet a52b1ff912bd4f07a795a7bfccb8a2f0 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-a52b1ff912bd4f07a795a7bfccb8a2f0
I20260709 13:06:06.912371 16434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f37c80078841efa574af907a802c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.947719 15590 tablet_copy_source_session.cc:215] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.987154 16438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52b1ff912bd4f07a795a7bfccb8a2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.994131 16434 tablet_copy_client.cc:806] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.995551 16434 tablet_copy_client.cc:670] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.004559 16434 tablet_copy_client.cc:538] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.011073 16438 tablet_copy_client.cc:806] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.011914 16438 tablet_copy_client.cc:670] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.016587 16438 tablet_copy_client.cc:538] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.027426 16438 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:07.042083 16434 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:07.042253 16278 raft_consensus.cc:1217] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.168663 16438 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:07.169741 16438 tablet_bootstrap.cc:492] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:07.170581 16438 ts_tablet_manager.cc:1403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.143s	user 0.025s	sys 0.016s
I20260709 13:06:07.176561 16438 raft_consensus.cc:359] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:07.182144 16438 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:07.184226 16438 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:07.199497 16438 ts_tablet_manager.cc:1434] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:06:07.186724 16434 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:07.200991 16434 tablet_bootstrap.cc:492] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:07.201817 16434 ts_tablet_manager.cc:1403] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.028s
I20260709 13:06:07.207417 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a52b1ff912bd4f07a795a7bfccb8a2f0 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:07.208024 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a52b1ff912bd4f07a795a7bfccb8a2f0 on tablet a52b1ff912bd4f07a795a7bfccb8a2f0 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:07.211395 16434 raft_consensus.cc:359] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:07.212387 16434 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:07.213138 16434 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:07.221975 16434 ts_tablet_manager.cc:1434] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:07.229939 15665 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-89f37c80078841efa574af907a802c86 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:07.230437 15665 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-89f37c80078841efa574af907a802c86 on tablet 89f37c80078841efa574af907a802c86 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:07.266710 16407 raft_consensus.cc:1064] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:07.269747 16407 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:07.306828 16278 raft_consensus.cc:1217] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.366480 15650 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.368306 16278 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.369987 16377 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.372165 16377 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.372778 15577 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.379141 16401 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.412357 16325 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.426851 15650 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.432744 16387 raft_consensus.cc:1064] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:07.438400 16387 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:07.449102 15575 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.476378 15475 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.481602 15724 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.483311 16448 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.492604 16278 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.494375 15575 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.494323 16387 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.496034 16448 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.512203 16277 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.548348 16387 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.551000 16278 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.572592 15728 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.577549 15575 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.603682 15724 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:07.620157 15478 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.634460 16278 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.635468 15578 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.635771 16325 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:07.638337 16377 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:07.643239 16278 raft_consensus.cc:1217] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.652968 16377 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.657141 16277 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.662973 15573 raft_consensus.cc:2955] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.668421 15650 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:07.675595 15724 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.687865 16278 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:07.691048 16387 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:07.703083 16447 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:07.710125 16388 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.715068 16278 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.726771 15475 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.734228 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b42acde8d7184571acdbe8d34af2df1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:07.766984 15476 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.781842 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a514609784146e8a8b6917d543f83e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:07.728018 15724 raft_consensus.cc:2955] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.789177 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a514609784146e8a8b6917d543f83e7 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:07.791839 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet b42acde8d7184571acdbe8d34af2df1f with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:07.809474 16466 tablet_replica.cc:333] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:07.810750 16466 raft_consensus.cc:2243] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:07.811468 16466 raft_consensus.cc:2272] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:07.811839 16465 tablet_replica.cc:333] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:07.819016 16465 raft_consensus.cc:2243] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:07.819789 16465 raft_consensus.cc:2272] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:07.815451 16466 ts_tablet_manager.cc:1916] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:07.832540 16465 ts_tablet_manager.cc:1916] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:07.838268 16466 ts_tablet_manager.cc:1929] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:07.838975 16466 log.cc:1199] T b42acde8d7184571acdbe8d34af2df1f P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/b42acde8d7184571acdbe8d34af2df1f
I20260709 13:06:07.849210 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet b42acde8d7184571acdbe8d34af2df1f (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:07.864630 16465 ts_tablet_manager.cc:1929] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:07.865271 16465 log.cc:1199] T 6a514609784146e8a8b6917d543f83e7 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/6a514609784146e8a8b6917d543f83e7
I20260709 13:06:07.867189 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 6a514609784146e8a8b6917d543f83e7 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:07.909056 16388 raft_consensus.cc:1064] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:07.912191 16388 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:07.926059 15724 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.927901 16464 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.942740 15573 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.944836 16277 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.945259 16447 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.947026 16388 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.972476 16447 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:07.985579 16277 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.003643 15477 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.035475 15573 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.039250 15724 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.103077 16446 raft_consensus.cc:1064] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:08.106747 15655 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:08.106693 16446 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:08.118072 16277 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.120052 16448 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.122936 15573 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.125769 16448 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.127900 16447 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.129341 16277 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.131917 15578 raft_consensus.cc:2955] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.153880 15477 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.169281 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f37c80078841efa574af907a802c86 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:08.183941 16277 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.186957 16445 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:08.207064 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89f37c80078841efa574af907a802c86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:08.211436 15729 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.213124 15655 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.219919 16445 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.221874 16446 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.237139 16472 tablet_replica.cc:333] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:08.310701 16449 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.323843 16472 raft_consensus.cc:2243] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:08.324960 16472 raft_consensus.cc:2272] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:08.328739 16472 ts_tablet_manager.cc:1916] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:08.325699 15728 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.337042 15655 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.360070 16277 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.367442 15477 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.378739 16472 ts_tablet_manager.cc:1929] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:08.387215 16472 log.cc:1199] T 89f37c80078841efa574af907a802c86 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/89f37c80078841efa574af907a802c86
I20260709 13:06:08.389366 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 89f37c80078841efa574af907a802c86 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:08.410724 15578 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:08.416952 15728 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.419934 16446 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:08.431401 16445 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.436795 15724 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.451153 16277 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.457377 16444 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:08.502405 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48070.5us
I20260709 13:06:08.481061 16277 raft_consensus.cc:2955] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.541134 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:08.547767 15476 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:08.563022 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet a52b1ff912bd4f07a795a7bfccb8a2f0 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:08.595032 16477 tablet_replica.cc:333] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:08.596732 16477 raft_consensus.cc:2243] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:08.597482 16477 raft_consensus.cc:2272] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:08.604532 16477 ts_tablet_manager.cc:1916] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:08.620558 16477 ts_tablet_manager.cc:1929] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:08.621042 16477 log.cc:1199] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/a52b1ff912bd4f07a795a7bfccb8a2f0
I20260709 13:06:08.622895 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet a52b1ff912bd4f07a795a7bfccb8a2f0 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:09.726080 15650 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:09.741200 15729 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:09.741803 15618 consensus_peers.cc:597] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 363fa81d735347758e73efea5dc3fae6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.742591 15578 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.743105 16478 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.752326 16478 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.777753 15573 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:09.773463 16478 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:09.777753 15729 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:09.802423 15575 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:09.818955 15543 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e25768ee42b44e978e9d8764ecd10199. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.848445 15724 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.864441 15650 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:09.900079 15476 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:09.925755 16449 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:09.946858 16445 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:09.978488 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 64412.1us
W20260709 13:06:10.023190 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 103121us
I20260709 13:06:10.059691 16476 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.087407 15724 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.091403 15475 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:10.095947 15653 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.099205 15729 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.151450 15653 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:10.152981 16377 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.157407 15573 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:10.158736 15692 consensus_peers.cc:597] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40c2674fd9d04c0fb406ca8f6eef4025. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.159809 16325 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.162312 16496 ts_tablet_manager.cc:933] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:10.167356 16496 tablet_copy_client.cc:323] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:10.167786 16480 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.170258 15653 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.174369 15665 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 363fa81d735347758e73efea5dc3fae6 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:10.174971 15665 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 363fa81d735347758e73efea5dc3fae6 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-363fa81d735347758e73efea5dc3fae6
I20260709 13:06:10.192492 15476 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.196404 15573 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.200750 15665 tablet_copy_source_session.cc:215] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.207904 16496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 363fa81d735347758e73efea5dc3fae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.223708 15573 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.232257 15654 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:10.234985 16494 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:10.237293 15726 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:10.239698 15543 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5de522f1a56b4d09aebf0748d415d7d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.255959 16445 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:10.275077 16445 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.278748 15654 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.297981 15476 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.306927 15729 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:10.317526 16496 tablet_copy_client.cc:806] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.318827 16496 tablet_copy_client.cc:670] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.326071 16496 tablet_copy_client.cc:538] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.336010 16496 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:10.359771 16496 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.360692 16496 tablet_bootstrap.cc:492] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:10.361375 16496 ts_tablet_manager.cc:1403] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 13:06:10.364435 16496 raft_consensus.cc:359] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.365444 16496 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:10.366175 16496 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.376534 16496 ts_tablet_manager.cc:1434] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:06:10.378435 15665 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-363fa81d735347758e73efea5dc3fae6 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:10.378882 15665 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-363fa81d735347758e73efea5dc3fae6 on tablet 363fa81d735347758e73efea5dc3fae6 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:10.417948 16496 ts_tablet_manager.cc:933] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:10.507421 16496 tablet_copy_client.cc:323] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:10.509004 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet e25768ee42b44e978e9d8764ecd10199 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:10.509514 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet e25768ee42b44e978e9d8764ecd10199 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-e25768ee42b44e978e9d8764ecd10199
I20260709 13:06:10.517128 15590 tablet_copy_source_session.cc:215] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.520254 16496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25768ee42b44e978e9d8764ecd10199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.538269 16496 tablet_copy_client.cc:806] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.538945 16496 tablet_copy_client.cc:670] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.542948 16496 tablet_copy_client.cc:538] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.552312 16496 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:10.575603 16496 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.576651 16496 tablet_bootstrap.cc:492] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:10.577431 16496 ts_tablet_manager.cc:1403] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.006s
I20260709 13:06:10.581734 16278 raft_consensus.cc:1217] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.582988 16496 raft_consensus.cc:359] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.583993 16496 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:10.586298 16496 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.589110 16496 ts_tablet_manager.cc:1434] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:10.591318 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-e25768ee42b44e978e9d8764ecd10199 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:10.591763 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-e25768ee42b44e978e9d8764ecd10199 on tablet e25768ee42b44e978e9d8764ecd10199 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:10.639799 16496 ts_tablet_manager.cc:933] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:10.641847 16496 tablet_copy_client.cc:323] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:10.643828 15739 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 40c2674fd9d04c0fb406ca8f6eef4025 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:10.644420 15739 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 40c2674fd9d04c0fb406ca8f6eef4025 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-40c2674fd9d04c0fb406ca8f6eef4025
I20260709 13:06:10.653292 15739 tablet_copy_source_session.cc:215] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.657032 16496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c2674fd9d04c0fb406ca8f6eef4025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.676282 16496 tablet_copy_client.cc:806] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.676947 16496 tablet_copy_client.cc:670] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.683292 16496 tablet_copy_client.cc:538] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.693606 16496 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:10.717794 16496 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.718488 16496 tablet_bootstrap.cc:492] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:10.718979 16496 ts_tablet_manager.cc:1403] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.006s
I20260709 13:06:10.720784 16496 raft_consensus.cc:359] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.721369 16496 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:10.721872 16496 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.726186 16496 ts_tablet_manager.cc:1434] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:10.727851 15739 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-40c2674fd9d04c0fb406ca8f6eef4025 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:10.728250 15739 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-40c2674fd9d04c0fb406ca8f6eef4025 on tablet 40c2674fd9d04c0fb406ca8f6eef4025 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:10.746930 16496 ts_tablet_manager.cc:933] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:10.749043 16496 tablet_copy_client.cc:323] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:10.750641 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 5de522f1a56b4d09aebf0748d415d7d5 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:10.751164 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 5de522f1a56b4d09aebf0748d415d7d5 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-5de522f1a56b4d09aebf0748d415d7d5
I20260709 13:06:10.758595 15590 tablet_copy_source_session.cc:215] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:10.761770 16496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de522f1a56b4d09aebf0748d415d7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:10.780565 16496 tablet_copy_client.cc:806] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:10.781383 16496 tablet_copy_client.cc:670] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:10.785930 16496 tablet_copy_client.cc:538] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:10.797601 16496 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:10.815403 16278 raft_consensus.cc:1217] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:10.863030 16496 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.863883 16496 tablet_bootstrap.cc:492] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:10.864598 16496 ts_tablet_manager.cc:1403] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.004s
I20260709 13:06:10.870549 16496 raft_consensus.cc:359] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.872639 16496 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:10.873317 16496 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:10.875751 16496 ts_tablet_manager.cc:1434] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:06:10.878922 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-5de522f1a56b4d09aebf0748d415d7d5 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:10.879323 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-5de522f1a56b4d09aebf0748d415d7d5 on tablet 5de522f1a56b4d09aebf0748d415d7d5 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:11.185662 16484 raft_consensus.cc:1064] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:11.191107 16278 raft_consensus.cc:1217] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:11.196017 16484 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:11.231966 15724 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.235437 16278 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.238121 15573 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.241418 16512 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:11.243541 16512 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.247416 16448 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.269677 16448 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.273535 15573 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.279985 15726 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.306818 15476 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.316051 16278 raft_consensus.cc:1217] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:11.344135 16278 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.358211 16476 raft_consensus.cc:1064] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:11.360812 16476 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:11.404562 16278 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.404946 15726 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.408169 16444 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.409534 16449 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.411962 15655 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.416531 16517 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.521360 16444 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.529189 16277 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.533365 15729 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.542914 15655 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.552819 15653 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:11.557997 15477 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.567955 15729 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.569594 16448 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.575631 16277 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.578624 16484 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:11.581283 16484 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.587333 16277 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.604300 15573 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:11.607506 15726 raft_consensus.cc:2955] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.608661 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 363fa81d735347758e73efea5dc3fae6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.616487 15477 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.620147 15654 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.621022 16277 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:11.622869 16476 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.627755 16444 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:11.634351 16444 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.642506 16277 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.643289 15654 raft_consensus.cc:2955] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.647504 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e25768ee42b44e978e9d8764ecd10199 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.659196 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 363fa81d735347758e73efea5dc3fae6 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:11.666936 16528 tablet_replica.cc:333] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:11.665148 15478 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.681721 16528 raft_consensus.cc:2243] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.688437 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet e25768ee42b44e978e9d8764ecd10199 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:11.682708 16528 raft_consensus.cc:2272] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.695883 16528 ts_tablet_manager.cc:1916] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.699215 16529 tablet_replica.cc:333] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:11.700538 16529 raft_consensus.cc:2243] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.701439 16529 raft_consensus.cc:2272] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.709596 16529 ts_tablet_manager.cc:1916] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.726169 16528 ts_tablet_manager.cc:1929] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.726765 16528 log.cc:1199] T 363fa81d735347758e73efea5dc3fae6 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/363fa81d735347758e73efea5dc3fae6
I20260709 13:06:11.728449 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 363fa81d735347758e73efea5dc3fae6 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:11.729715 16529 ts_tablet_manager.cc:1929] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:11.730175 16529 log.cc:1199] T e25768ee42b44e978e9d8764ecd10199 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/e25768ee42b44e978e9d8764ecd10199
I20260709 13:06:11.731825 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet e25768ee42b44e978e9d8764ecd10199 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:11.768724 16377 raft_consensus.cc:1064] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:11.771035 16377 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:11.803433 15655 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.805572 16277 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.805639 16325 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.808684 16325 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.812884 15573 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:11.814786 16325 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.852947 16325 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.855690 15578 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.861081 16277 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.873466 15477 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.878360 15655 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:11.990561 16476 raft_consensus.cc:1064] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:11.993163 16476 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:12.010349 15726 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:12.019227 16277 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:12.020601 15654 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:12.024236 16535 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:12.026953 16536 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:12.036548 16535 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.040393 15654 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.051841 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40c2674fd9d04c0fb406ca8f6eef4025 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:12.049403 16277 raft_consensus.cc:2955] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.068955 15477 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.084044 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 40c2674fd9d04c0fb406ca8f6eef4025 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:12.085026 16528 tablet_replica.cc:333] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:12.085978 16528 raft_consensus.cc:2243] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:12.086738 16528 raft_consensus.cc:2272] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:12.091849 16528 ts_tablet_manager.cc:1916] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:12.113029 15726 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:12.115183 16277 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:12.118748 16527 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:12.120630 16527 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:12.129122 15654 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:12.142652 16449 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:12.167044 15650 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.163127 16449 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.182750 16528 ts_tablet_manager.cc:1929] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:12.184659 16528 log.cc:1199] T 40c2674fd9d04c0fb406ca8f6eef4025 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/40c2674fd9d04c0fb406ca8f6eef4025
I20260709 13:06:12.184459 15477 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.186335 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 40c2674fd9d04c0fb406ca8f6eef4025 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:12.190503 15726 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.206611 16278 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.232738 15578 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:12.244367 16278 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:12.246273 16449 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:12.252106 15726 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:12.253350 16476 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:12.252812 16449 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.256675 16278 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.263523 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5de522f1a56b4d09aebf0748d415d7d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:12.264243 15726 raft_consensus.cc:2955] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:12.271740 15477 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.292194 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 5de522f1a56b4d09aebf0748d415d7d5 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:12.295122 16542 tablet_replica.cc:333] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:12.300328 16542 raft_consensus.cc:2243] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:12.300966 16542 raft_consensus.cc:2272] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:12.305094 16542 ts_tablet_manager.cc:1916] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:12.319151 16542 ts_tablet_manager.cc:1929] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:12.319623 16542 log.cc:1199] T 5de522f1a56b4d09aebf0748d415d7d5 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/5de522f1a56b4d09aebf0748d415d7d5
I20260709 13:06:12.321146 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 5de522f1a56b4d09aebf0748d415d7d5 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:13.386420 15572 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:13.395239 15726 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:13.395514 15543 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57649fad66734a1786f0f9c09f4fa317. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.395701 15654 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.396911 16476 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.397732 16449 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.406442 16449 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.409010 15654 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.414912 15726 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.421824 15476 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.427873 15729 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:13.445400 15654 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.448293 16377 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.491338 16552 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:13.494247 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 49372.9us
I20260709 13:06:13.495003 15650 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.517342 15572 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.525537 15477 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.529490 15654 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:13.546676 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78adb81d1456468f8ad75e99085c54ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.560043 16552 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:13.596585 15573 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:13.599047 15618 consensus_peers.cc:597] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 692cb3906e474706ae13f98e2b050415. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.601667 15722 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.604809 16543 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:13.606141 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 63227.8us
I20260709 13:06:13.615042 15572 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.618707 16526 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:13.639917 16543 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.641916 15722 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.659617 15476 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.667141 15578 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.677472 15655 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:13.693187 15729 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:13.695528 16526 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:13.696498 15618 consensus_peers.cc:597] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fd8c2b67a6b46399004625b89edc3ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.698108 15573 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:13.700902 16543 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.714959 16561 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.719544 15722 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.722648 15573 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:13.737468 15478 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.942097 16566 ts_tablet_manager.cc:933] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:13.944211 16566 tablet_copy_client.cc:323] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:13.946174 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 57649fad66734a1786f0f9c09f4fa317 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:13.946748 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 57649fad66734a1786f0f9c09f4fa317 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-57649fad66734a1786f0f9c09f4fa317
I20260709 13:06:13.955189 15590 tablet_copy_source_session.cc:215] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.986325 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57649fad66734a1786f0f9c09f4fa317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.006876 16568 ts_tablet_manager.cc:933] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:14.008962 16568 tablet_copy_client.cc:323] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:14.010605 15739 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 78adb81d1456468f8ad75e99085c54ba from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:14.011072 15739 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 78adb81d1456468f8ad75e99085c54ba from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-78adb81d1456468f8ad75e99085c54ba
I20260709 13:06:14.019774 15739 tablet_copy_source_session.cc:215] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.022495 16566 tablet_copy_client.cc:806] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.023286 16566 tablet_copy_client.cc:670] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.028724 16566 tablet_copy_client.cc:538] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.035188 16568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78adb81d1456468f8ad75e99085c54ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.039065 16566 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:14.052302 16568 tablet_copy_client.cc:806] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.052991 16568 tablet_copy_client.cc:670] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.057272 16568 tablet_copy_client.cc:538] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.063117 16566 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.064154 16566 tablet_bootstrap.cc:492] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:14.064919 16566 ts_tablet_manager.cc:1403] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:06:14.068497 16568 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:14.068856 16566 raft_consensus.cc:359] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.069799 16566 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:14.070523 16566 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.083743 16566 ts_tablet_manager.cc:1434] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.005s
I20260709 13:06:14.086798 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-57649fad66734a1786f0f9c09f4fa317 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:14.087378 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-57649fad66734a1786f0f9c09f4fa317 on tablet 57649fad66734a1786f0f9c09f4fa317 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:14.096670 16566 ts_tablet_manager.cc:933] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:14.102398 16572 ts_tablet_manager.cc:933] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:14.108587 16566 tablet_copy_client.cc:323] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:14.108848 16572 tablet_copy_client.cc:323] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:14.110337 15665 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 5fd8c2b67a6b46399004625b89edc3ba from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:14.110880 15665 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 5fd8c2b67a6b46399004625b89edc3ba from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-5fd8c2b67a6b46399004625b89edc3ba
I20260709 13:06:14.111157 16568 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.111805 16568 tablet_bootstrap.cc:492] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:14.112277 16568 ts_tablet_manager.cc:1403] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.010s
I20260709 13:06:14.110848 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 692cb3906e474706ae13f98e2b050415 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:14.114921 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 692cb3906e474706ae13f98e2b050415 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-692cb3906e474706ae13f98e2b050415
I20260709 13:06:14.114913 16568 raft_consensus.cc:359] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.115841 16568 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:14.116528 16568 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.118256 15665 tablet_copy_source_session.cc:215] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.119240 16568 ts_tablet_manager.cc:1434] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:14.122334 15739 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78adb81d1456468f8ad75e99085c54ba received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:14.122736 15739 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78adb81d1456468f8ad75e99085c54ba on tablet 78adb81d1456468f8ad75e99085c54ba with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:14.123049 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd8c2b67a6b46399004625b89edc3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.123497 15664 tablet_copy_source_session.cc:215] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.129727 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692cb3906e474706ae13f98e2b050415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.147640 16572 tablet_copy_client.cc:806] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.148483 16572 tablet_copy_client.cc:670] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.157905 16572 tablet_copy_client.cc:538] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.168094 16572 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:14.172238 16566 tablet_copy_client.cc:806] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.172988 16566 tablet_copy_client.cc:670] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.177930 16566 tablet_copy_client.cc:538] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.187948 16566 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:14.200964 16572 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.202786 16572 tablet_bootstrap.cc:492] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:14.205570 16572 ts_tablet_manager.cc:1403] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.004s
I20260709 13:06:14.208377 16572 raft_consensus.cc:359] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.209019 16572 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:14.209532 16572 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.212401 16572 ts_tablet_manager.cc:1434] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:06:14.213443 16566 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.214221 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-692cb3906e474706ae13f98e2b050415 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:14.214448 16566 tablet_bootstrap.cc:492] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:14.214715 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-692cb3906e474706ae13f98e2b050415 on tablet 692cb3906e474706ae13f98e2b050415 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:14.215212 16566 ts_tablet_manager.cc:1403] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.010s
I20260709 13:06:14.218448 16566 raft_consensus.cc:359] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.219267 16566 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:14.219923 16566 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:14.222621 16566 ts_tablet_manager.cc:1434] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:14.224251 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-5fd8c2b67a6b46399004625b89edc3ba received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:14.224653 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-5fd8c2b67a6b46399004625b89edc3ba on tablet 5fd8c2b67a6b46399004625b89edc3ba with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:14.385906 16277 raft_consensus.cc:1217] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.514856 16277 raft_consensus.cc:1217] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.547863 16277 raft_consensus.cc:1217] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:14.645288 16277 raft_consensus.cc:1217] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:14.841572 16449 raft_consensus.cc:1064] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:14.843932 16449 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:14.853084 16277 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.856330 16556 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.861939 15729 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.863763 15650 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.865520 16578 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.867499 16449 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.876756 16449 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:14.878136 15650 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:14.901863 16278 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:14.927479 15478 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:14.939464 16579 raft_consensus.cc:1064] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:14.939160 15722 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:14.942691 16579 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:14.953344 15655 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.954862 16579 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.959102 15573 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.971858 16535 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.981287 16278 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:14.984337 16552 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:14.995095 16526 raft_consensus.cc:1064] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:15.004897 16526 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.006590 15578 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.021031 16552 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.022569 16278 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.022622 16277 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.025324 16556 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.034147 16449 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.040671 15476 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.044953 15729 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:15.046142 16276 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:15.046325 16543 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.047772 16561 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.048317 16278 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.061237 15573 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:15.062534 15572 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.065886 16543 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.080919 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57649fad66734a1786f0f9c09f4fa317 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.085744 15650 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.090658 16561 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.098064 15476 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.098229 15729 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.107069 15573 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.112890 16449 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.116194 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 57649fad66734a1786f0f9c09f4fa317 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:15.134094 15653 raft_consensus.cc:2955] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.145682 15650 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.151543 16276 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.152980 15729 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.170053 15572 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.171617 16278 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.175375 16579 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.176044 15475 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.186784 16579 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:15.201900 15573 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.202252 16552 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.210427 16599 tablet_replica.cc:333] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:15.211630 16599 raft_consensus.cc:2243] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.212481 16599 raft_consensus.cc:2272] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.208839 16278 raft_consensus.cc:2955] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.220899 16599 ts_tablet_manager.cc:1916] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.238346 15653 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.241010 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78adb81d1456468f8ad75e99085c54ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.247013 15478 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.249226 16276 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.247048 16561 raft_consensus.cc:1064] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:15.250770 16543 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.252259 16561 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.260985 15729 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:15.263690 16593 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.266299 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 78adb81d1456468f8ad75e99085c54ba with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:15.268632 16599 ts_tablet_manager.cc:1929] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.270174 16599 log.cc:1199] T 57649fad66734a1786f0f9c09f4fa317 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/57649fad66734a1786f0f9c09f4fa317
I20260709 13:06:15.271936 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 57649fad66734a1786f0f9c09f4fa317 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:15.284024 16526 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.285607 16276 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.289062 15729 raft_consensus.cc:2955] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.303998 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 692cb3906e474706ae13f98e2b050415 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.306505 16602 tablet_replica.cc:333] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:15.308367 16602 raft_consensus.cc:2243] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.313480 16278 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:15.316727 16602 raft_consensus.cc:2272] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.317370 16526 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.318295 15573 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:15.319904 15726 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:15.313200 15475 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.321578 16526 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.322414 16543 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:15.325105 16602 ts_tablet_manager.cc:1916] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.348416 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 692cb3906e474706ae13f98e2b050415 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:15.357419 16602 ts_tablet_manager.cc:1929] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.357973 16602 log.cc:1199] T 78adb81d1456468f8ad75e99085c54ba P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/78adb81d1456468f8ad75e99085c54ba
I20260709 13:06:15.357024 16543 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.359817 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 78adb81d1456468f8ad75e99085c54ba (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:15.365913 15729 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.370586 16278 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.378157 15476 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.381675 16606 tablet_replica.cc:333] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:15.382745 16606 raft_consensus.cc:2243] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.384289 16606 raft_consensus.cc:2272] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.390744 15572 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.393887 16606 ts_tablet_manager.cc:1916] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.410691 16606 ts_tablet_manager.cc:1929] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:15.411262 16606 log.cc:1199] T 692cb3906e474706ae13f98e2b050415 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/692cb3906e474706ae13f98e2b050415
I20260709 13:06:15.413785 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 692cb3906e474706ae13f98e2b050415 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:15.424144 15655 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:15.430068 16278 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:15.431701 16526 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.441948 15729 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:15.444103 16593 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.446183 16561 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.447358 16278 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.453455 15729 raft_consensus.cc:2955] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.458616 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fd8c2b67a6b46399004625b89edc3ba with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:15.468860 15476 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:15.484571 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd8c2b67a6b46399004625b89edc3ba with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:15.485970 16606 tablet_replica.cc:333] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:15.500425 16606 raft_consensus.cc:2243] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:15.501113 16606 raft_consensus.cc:2272] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:15.504207 16606 ts_tablet_manager.cc:1916] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:15.518472 16606 ts_tablet_manager.cc:1929] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:15.518986 16606 log.cc:1199] T 5fd8c2b67a6b46399004625b89edc3ba P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/5fd8c2b67a6b46399004625b89edc3ba
I20260709 13:06:15.520412 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 5fd8c2b67a6b46399004625b89edc3ba (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:16.566497 15573 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:16.573210 15543 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e251fb313da4e75911104bd3aedca42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.573477 15655 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.573508 15722 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.576407 16541 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.581086 16607 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.587263 16607 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.589159 15722 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.600708 15573 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:16.601011 15653 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.604336 15478 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.627835 15729 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.628399 15653 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:16.629119 15543 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bc3f862b6ee4e76ab0d4372c4bcd7be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.630102 16607 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.630887 16556 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.639911 16541 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.641534 15729 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.656956 15655 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:16.661850 15653 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.665112 15573 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.666982 16619 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:16.668579 15618 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88df0ea72a7846ebb2982ffb2d948734. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.661024 15475 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.668599 15729 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.672806 16526 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.682682 16526 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.687671 15729 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.692608 15573 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.702404 15572 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:16.712116 15478 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.725374 15653 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:16.725566 15729 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:16.726095 15543 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfa9aad2b798480db18c5b0e3bac6a57. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.726792 16556 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.727792 16607 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.735358 16541 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.738559 15729 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.738399 15653 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:16.754974 15475 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.953140 16629 ts_tablet_manager.cc:933] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:16.956816 16629 tablet_copy_client.cc:323] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:16.959048 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 7e251fb313da4e75911104bd3aedca42 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:16.959642 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 7e251fb313da4e75911104bd3aedca42 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-7e251fb313da4e75911104bd3aedca42
I20260709 13:06:16.970968 15590 tablet_copy_source_session.cc:215] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.975286 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e251fb313da4e75911104bd3aedca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:17.016276 16629 tablet_copy_client.cc:806] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:17.017057 16629 tablet_copy_client.cc:670] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:17.021976 16629 tablet_copy_client.cc:538] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:17.034768 16629 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:17.060789 16629 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.062007 16629 tablet_bootstrap.cc:492] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:17.062825 16629 ts_tablet_manager.cc:1403] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 13:06:17.067250 16629 raft_consensus.cc:359] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.069551 16629 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:17.070715 16629 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.127326 16634 ts_tablet_manager.cc:933] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:17.145458 16629 ts_tablet_manager.cc:1434] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.082s	user 0.029s	sys 0.048s
I20260709 13:06:17.161976 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-7e251fb313da4e75911104bd3aedca42 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:17.162645 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-7e251fb313da4e75911104bd3aedca42 on tablet 7e251fb313da4e75911104bd3aedca42 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:17.178217 16629 ts_tablet_manager.cc:933] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:17.201882 16634 tablet_copy_client.cc:323] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:17.208547 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:17.209290 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-9bc3f862b6ee4e76ab0d4372c4bcd7be
I20260709 13:06:17.209944 16629 tablet_copy_client.cc:323] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:17.216109 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 88df0ea72a7846ebb2982ffb2d948734 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:17.216874 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 88df0ea72a7846ebb2982ffb2d948734 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-88df0ea72a7846ebb2982ffb2d948734
I20260709 13:06:17.219323 15590 tablet_copy_source_session.cc:215] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:17.225804 16634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:17.226282 15664 tablet_copy_source_session.cc:215] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:17.233412 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88df0ea72a7846ebb2982ffb2d948734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:17.252805 16634 tablet_copy_client.cc:806] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:17.253589 16634 tablet_copy_client.cc:670] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:17.252889 16629 tablet_copy_client.cc:806] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:17.255766 16629 tablet_copy_client.cc:670] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:17.259384 16634 tablet_copy_client.cc:538] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:17.260744 16629 tablet_copy_client.cc:538] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:17.270282 16634 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:17.272045 16636 ts_tablet_manager.cc:933] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:17.289582 16636 tablet_copy_client.cc:323] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:17.291535 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet dfa9aad2b798480db18c5b0e3bac6a57 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:17.292140 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet dfa9aad2b798480db18c5b0e3bac6a57 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-dfa9aad2b798480db18c5b0e3bac6a57
I20260709 13:06:17.303997 15590 tablet_copy_source_session.cc:215] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:17.314445 16636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa9aad2b798480db18c5b0e3bac6a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:17.316885 16634 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.317555 16629 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:17.317854 16634 tablet_bootstrap.cc:492] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:17.318578 16634 ts_tablet_manager.cc:1403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.007s
I20260709 13:06:17.322324 16634 raft_consensus.cc:359] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.323367 16634 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:17.324144 16634 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.339962 16634 ts_tablet_manager.cc:1434] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:06:17.341966 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9bc3f862b6ee4e76ab0d4372c4bcd7be received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:17.342487 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9bc3f862b6ee4e76ab0d4372c4bcd7be on tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:17.340862 16636 tablet_copy_client.cc:806] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:17.345458 16636 tablet_copy_client.cc:670] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:17.353255 16636 tablet_copy_client.cc:538] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:17.364158 16636 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:17.379649 16629 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.380808 16629 tablet_bootstrap.cc:492] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:17.381474 16629 ts_tablet_manager.cc:1403] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.007s
I20260709 13:06:17.384167 16629 raft_consensus.cc:359] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.384796 16629 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:17.385463 16629 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.387730 16629 ts_tablet_manager.cc:1434] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:06:17.389918 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-88df0ea72a7846ebb2982ffb2d948734 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:17.390422 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-88df0ea72a7846ebb2982ffb2d948734 on tablet 88df0ea72a7846ebb2982ffb2d948734 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:17.390730 16636 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.391710 16636 tablet_bootstrap.cc:492] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:17.392870 16636 ts_tablet_manager.cc:1403] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 13:06:17.398111 16636 raft_consensus.cc:359] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.399111 16636 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:17.399842 16636 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:17.402946 16636 ts_tablet_manager.cc:1434] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:06:17.404738 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-dfa9aad2b798480db18c5b0e3bac6a57 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:17.405181 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-dfa9aad2b798480db18c5b0e3bac6a57 on tablet dfa9aad2b798480db18c5b0e3bac6a57 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:17.433727 16276 raft_consensus.cc:1217] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.662668 16276 raft_consensus.cc:1217] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.673623 16276 raft_consensus.cc:1217] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.708487 16276 raft_consensus.cc:1217] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:17.835641 16627 raft_consensus.cc:1064] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:17.839421 16627 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:17.847391 16276 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.849784 15655 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.849902 16556 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:17.851711 16625 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.847966 15729 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:17.859582 16627 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:17.863894 16625 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.866840 15654 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.876140 16278 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.889659 15475 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.910490 15722 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.934115 15573 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:17.939205 16276 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.940840 15722 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.941483 16556 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.943590 16556 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.948697 16541 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.951086 16276 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.956727 15729 raft_consensus.cc:2955] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.969169 15478 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:17.976423 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e251fb313da4e75911104bd3aedca42 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.999292 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e251fb313da4e75911104bd3aedca42 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:18.014003 16652 tablet_replica.cc:333] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:18.016404 16652 raft_consensus.cc:2243] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.020686 16652 raft_consensus.cc:2272] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.025792 16652 ts_tablet_manager.cc:1916] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.053040 16652 ts_tablet_manager.cc:1929] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.053619 16652 log.cc:1199] T 7e251fb313da4e75911104bd3aedca42 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/7e251fb313da4e75911104bd3aedca42
I20260709 13:06:18.055451 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 7e251fb313da4e75911104bd3aedca42 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:18.097543 16650 raft_consensus.cc:1064] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:18.100230 16650 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.106961 16276 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.107219 15722 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.108855 16650 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.109750 15654 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.117635 16556 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:18.120134 16541 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.133278 16541 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.136504 16619 raft_consensus.cc:1064] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:18.135036 15654 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.140022 16619 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.162591 16278 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.161207 15476 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.168138 15722 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.182315 16275 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.184278 15729 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.185047 15572 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.188122 16655 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:18.189626 16561 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:18.191272 16561 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.229312 16651 raft_consensus.cc:1064] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:18.232555 16651 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.228264 15573 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.237476 16561 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.250594 16276 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.252133 16627 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.256785 16275 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.259716 16541 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.261571 16276 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.271811 15728 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.277985 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfa9aad2b798480db18c5b0e3bac6a57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.284759 15476 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.287338 15722 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.281680 15475 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.297137 15575 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.305302 16541 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.307494 16275 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.308413 15722 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.310909 15654 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:18.308871 16541 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:18.326941 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet dfa9aad2b798480db18c5b0e3bac6a57 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:18.327308 15722 raft_consensus.cc:2955] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.328889 16652 tablet_replica.cc:333] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:18.330092 16652 raft_consensus.cc:2243] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.330744 16652 raft_consensus.cc:2272] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.341578 15654 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.343863 16627 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.346123 16651 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:18.345921 16652 ts_tablet_manager.cc:1916] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.359023 16276 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.360755 16660 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:18.368520 16652 ts_tablet_manager.cc:1929] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.369011 16652 log.cc:1199] T dfa9aad2b798480db18c5b0e3bac6a57 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/dfa9aad2b798480db18c5b0e3bac6a57
I20260709 13:06:18.369951 16655 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.371349 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet dfa9aad2b798480db18c5b0e3bac6a57 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:18.377066 15572 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.381733 16561 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.387044 15572 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.391480 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88df0ea72a7846ebb2982ffb2d948734 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.396304 16276 raft_consensus.cc:2955] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.402423 16625 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.412081 15478 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:18.424659 16276 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.427840 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 88df0ea72a7846ebb2982ffb2d948734 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:18.433522 15729 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.438063 15654 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.447009 15476 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.458003 16668 tablet_replica.cc:333] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:18.491153 16668 raft_consensus.cc:2243] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.491947 16668 raft_consensus.cc:2272] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.493320 15572 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:18.497560 16668 ts_tablet_manager.cc:1916] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.500298 15654 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.500749 16276 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:18.502314 16625 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.504081 16625 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:18.512398 16651 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.516251 16276 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.524595 16668 ts_tablet_manager.cc:1929] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.525175 16668 log.cc:1199] T 88df0ea72a7846ebb2982ffb2d948734 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/88df0ea72a7846ebb2982ffb2d948734
I20260709 13:06:18.527140 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 88df0ea72a7846ebb2982ffb2d948734 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:18.530221 15654 raft_consensus.cc:2955] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.534789 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:18.537750 15475 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:18.558743 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:18.559720 16668 tablet_replica.cc:333] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:18.560702 16668 raft_consensus.cc:2243] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:18.561430 16668 raft_consensus.cc:2272] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:18.565274 16668 ts_tablet_manager.cc:1916] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:18.578946 16668 ts_tablet_manager.cc:1929] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:18.579370 16668 log.cc:1199] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/9bc3f862b6ee4e76ab0d4372c4bcd7be
I20260709 13:06:18.580766 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 9bc3f862b6ee4e76ab0d4372c4bcd7be (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:19.621563 15722 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:19.630417 15692 consensus_peers.cc:597] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69ec834a3b71420c9f09248e41809358. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.632017 15573 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.633908 16628 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.635680 15653 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.637636 16628 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.648370 16628 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.651048 15572 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.655138 15655 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.661530 15653 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:19.670482 15476 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.684010 15722 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.684422 15572 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.685457 16561 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:19.689011 15618 consensus_peers.cc:597] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a96efb5d87b14ca19297799c72e797f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.690094 16619 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.714265 16561 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.718802 15572 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.719848 15722 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.741820 15477 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.740854 15573 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:19.764209 15722 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:19.764678 15543 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d98a5c01953408b8ad3eb550494fbf2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.765465 16669 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.765868 15655 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.767251 16669 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.790048 16627 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.797451 15722 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.799685 15655 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.808563 15724 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:19.811896 15476 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:19.835707 15573 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:19.836841 15692 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f7baa38cef34b39ab9d39592b319ba3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:19.836761 15655 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:19.837925 16671 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:19.841574 16671 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:19.846393 16653 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.848176 15573 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.853353 15655 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:19.865054 15476 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:20.232960 16690 ts_tablet_manager.cc:933] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:20.237403 16690 tablet_copy_client.cc:323] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:20.238940 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 8d98a5c01953408b8ad3eb550494fbf2 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:20.239372 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 8d98a5c01953408b8ad3eb550494fbf2 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-8d98a5c01953408b8ad3eb550494fbf2
I20260709 13:06:20.246832 15590 tablet_copy_source_session.cc:215] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.246966 16692 ts_tablet_manager.cc:933] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:20.249449 16692 tablet_copy_client.cc:323] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:20.250201 16690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d98a5c01953408b8ad3eb550494fbf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.251331 15739 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 69ec834a3b71420c9f09248e41809358 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:20.251878 15739 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 69ec834a3b71420c9f09248e41809358 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-69ec834a3b71420c9f09248e41809358
I20260709 13:06:20.261473 15739 tablet_copy_source_session.cc:215] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.263912 16694 ts_tablet_manager.cc:933] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:20.270426 16692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ec834a3b71420c9f09248e41809358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.273422 16690 tablet_copy_client.cc:806] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.274080 16690 tablet_copy_client.cc:670] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.279788 16690 tablet_copy_client.cc:538] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.292800 16690 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:20.327172 16692 tablet_copy_client.cc:806] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.327821 16692 tablet_copy_client.cc:670] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.336136 16692 tablet_copy_client.cc:538] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.342279 16694 tablet_copy_client.cc:323] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:20.344075 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet a96efb5d87b14ca19297799c72e797f0 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:20.344585 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet a96efb5d87b14ca19297799c72e797f0 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-a96efb5d87b14ca19297799c72e797f0
I20260709 13:06:20.347350 16690 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.348304 16690 tablet_bootstrap.cc:492] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:20.348984 16690 ts_tablet_manager.cc:1403] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.009s
I20260709 13:06:20.352464 16690 raft_consensus.cc:359] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.352917 15664 tablet_copy_source_session.cc:215] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.353307 16690 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:20.357110 16694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96efb5d87b14ca19297799c72e797f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.357336 16690 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.356843 16692 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:20.374743 16694 tablet_copy_client.cc:806] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.376051 16694 tablet_copy_client.cc:670] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.378964 16698 ts_tablet_manager.cc:933] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:20.379545 16690 ts_tablet_manager.cc:1434] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:06:20.381497 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-8d98a5c01953408b8ad3eb550494fbf2 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:20.381881 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-8d98a5c01953408b8ad3eb550494fbf2 on tablet 8d98a5c01953408b8ad3eb550494fbf2 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:20.384941 16694 tablet_copy_client.cc:538] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.389657 16698 tablet_copy_client.cc:323] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:20.392407 15739 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 0f7baa38cef34b39ab9d39592b319ba3 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:20.393002 15739 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 0f7baa38cef34b39ab9d39592b319ba3 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-0f7baa38cef34b39ab9d39592b319ba3
I20260709 13:06:20.400768 15739 tablet_copy_source_session.cc:215] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:20.404350 16698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7baa38cef34b39ab9d39592b319ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:20.404386 16694 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:20.430238 16692 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.431509 16692 tablet_bootstrap.cc:492] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:20.432509 16692 ts_tablet_manager.cc:1403] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.004s
I20260709 13:06:20.448226 16692 raft_consensus.cc:359] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.450098 16692 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:20.451133 16698 tablet_copy_client.cc:806] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:20.450830 16692 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.451719 16698 tablet_copy_client.cc:670] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:20.453378 16692 ts_tablet_manager.cc:1434] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:06:20.457176 15739 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-69ec834a3b71420c9f09248e41809358 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:20.457610 15739 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-69ec834a3b71420c9f09248e41809358 on tablet 69ec834a3b71420c9f09248e41809358 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:20.459913 16698 tablet_copy_client.cc:538] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:20.467010 16694 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.468037 16694 tablet_bootstrap.cc:492] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:20.468724 16694 ts_tablet_manager.cc:1403] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.020s
I20260709 13:06:20.470148 16698 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:20.471652 16694 raft_consensus.cc:359] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.472525 16694 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:20.473212 16694 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.475809 16694 ts_tablet_manager.cc:1434] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:20.477787 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a96efb5d87b14ca19297799c72e797f0 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:20.478221 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a96efb5d87b14ca19297799c72e797f0 on tablet a96efb5d87b14ca19297799c72e797f0 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:20.492779 16698 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:20.493803 16698 tablet_bootstrap.cc:492] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:20.495774 16698 ts_tablet_manager.cc:1403] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.005s
I20260709 13:06:20.499814 16698 raft_consensus.cc:359] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.500809 16698 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:20.501516 16698 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:20.503918 16698 ts_tablet_manager.cc:1434] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:20.505599 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-0f7baa38cef34b39ab9d39592b319ba3 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:20.506040 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-0f7baa38cef34b39ab9d39592b319ba3 on tablet 0f7baa38cef34b39ab9d39592b319ba3 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:20.657622 16278 raft_consensus.cc:1217] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.757462 16278 raft_consensus.cc:1217] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.773823 16278 raft_consensus.cc:1217] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.826843 16278 raft_consensus.cc:1217] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:21.067679 16541 raft_consensus.cc:1064] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:21.069342 16541 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.074811 16278 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.075488 15722 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.076977 15653 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.078207 16627 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.083601 16707 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:21.084586 16541 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.105516 15653 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.106949 15724 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.108860 16651 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.130893 15476 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.133646 16278 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.177349 15573 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.183566 16278 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.184902 16627 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.187363 15653 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.189075 16627 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.191661 16541 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.198601 15653 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.203315 16278 raft_consensus.cc:2955] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.208220 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d98a5c01953408b8ad3eb550494fbf2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.218567 16705 raft_consensus.cc:1064] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:21.223106 15477 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.221215 16705 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.243865 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d98a5c01953408b8ad3eb550494fbf2 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:21.245496 15655 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.245572 16278 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.247305 16704 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.250006 15573 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.251821 16653 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.253284 16703 raft_consensus.cc:1064] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:21.255831 16703 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.257884 16704 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.277580 16716 tablet_replica.cc:333] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:21.279063 16716 raft_consensus.cc:2243] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.280118 16716 raft_consensus.cc:2272] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.288590 15722 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.290434 16676 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.297232 16716 ts_tablet_manager.cc:1916] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.298578 15573 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.298640 16275 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.300706 16683 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.300935 16705 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.303471 15655 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.307410 16676 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.339165 16671 raft_consensus.cc:1064] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:21.374070 16671 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.377698 16683 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.382340 15573 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.391708 15478 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.402343 16276 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.403530 15573 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.404106 16671 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.315675 16278 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.409690 16705 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.410429 15654 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:21.418169 15729 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.412366 16716 ts_tablet_manager.cc:1929] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.419314 16716 log.cc:1199] T 8d98a5c01953408b8ad3eb550494fbf2 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/8d98a5c01953408b8ad3eb550494fbf2
I20260709 13:06:21.424903 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 8d98a5c01953408b8ad3eb550494fbf2 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:21.434363 15575 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.437752 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:21.441910 16705 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:21.448931 15572 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.461416 16653 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:21.479447 16277 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.488896 16704 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.492027 15572 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.499548 15729 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.491312 16671 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.507844 15477 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.508579 16705 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.513212 15573 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:06:21.521512 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 69202.3us
I20260709 13:06:21.536862 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f7baa38cef34b39ab9d39592b319ba3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.539685 16277 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.543876 16278 raft_consensus.cc:2955] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.556809 16276 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:06:21.615944 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 60396.8us
I20260709 13:06:21.636193 15478 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:06:21.681358 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 132096us
W20260709 13:06:21.682047 16728 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:06:21.690912 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 130055us
W20260709 13:06:21.691139 16722 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.060s	user 0.017s	sys 0.015s
W20260709 13:06:21.696439 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 142708us
I20260709 13:06:21.697362 15477 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.715287 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f7baa38cef34b39ab9d39592b319ba3 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
W20260709 13:06:21.723754 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 107046us
I20260709 13:06:21.730417 15655 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.746474 16739 tablet_replica.cc:333] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:21.751672 16739 raft_consensus.cc:2243] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.775853 15653 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.794646 16739 raft_consensus.cc:2272] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.804903 16739 ts_tablet_manager.cc:1916] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.814591 15724 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.818296 16731 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.835546 16730 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.841423 15724 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.845170 16739 ts_tablet_manager.cc:1929] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.845685 16739 log.cc:1199] T 0f7baa38cef34b39ab9d39592b319ba3 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/0f7baa38cef34b39ab9d39592b319ba3
I20260709 13:06:21.847388 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 0f7baa38cef34b39ab9d39592b319ba3 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:21.849995 15729 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:21.862200 16277 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.863452 15476 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.864164 16671 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.870205 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a96efb5d87b14ca19297799c72e797f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.878140 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet a96efb5d87b14ca19297799c72e797f0 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
W20260709 13:06:21.883859 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 122764us
I20260709 13:06:21.884130 16704 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.886053 15650 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.889178 16278 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:21.890883 16736 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:21.889294 16277 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.900192 16743 tablet_replica.cc:333] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:21.901293 16743 raft_consensus.cc:2243] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.900563 15650 raft_consensus.cc:2955] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.902076 16743 raft_consensus.cc:2272] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.906713 16676 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:21.914448 16743 ts_tablet_manager.cc:1916] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.919942 16276 raft_consensus.cc:2955] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.926743 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69ec834a3b71420c9f09248e41809358 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:21.937901 15476 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:21.939141 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:21.939795 15650 raft_consensus.cc:606] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:21.944728 16743 ts_tablet_manager.cc:1929] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.945283 16743 log.cc:1199] T a96efb5d87b14ca19297799c72e797f0 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/a96efb5d87b14ca19297799c72e797f0
I20260709 13:06:21.952725 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet a96efb5d87b14ca19297799c72e797f0 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:21.952744 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ec834a3b71420c9f09248e41809358 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:21.953790 16743 tablet_replica.cc:333] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:21.954766 16743 raft_consensus.cc:2243] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:21.955503 16743 raft_consensus.cc:2272] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:21.958746 16743 ts_tablet_manager.cc:1916] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:21.972674 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:21.973196 15573 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:21.973323 16743 ts_tablet_manager.cc:1929] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:21.973846 16743 log.cc:1199] T 69ec834a3b71420c9f09248e41809358 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/69ec834a3b71420c9f09248e41809358
I20260709 13:06:21.975333 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 69ec834a3b71420c9f09248e41809358 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:21.975891 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:21.976373 15653 raft_consensus.cc:606] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:21.979079 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:21.979604 15573 raft_consensus.cc:606] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:21.982335 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab663998de28482d8438f0c594104dd5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:21.982882 15573 raft_consensus.cc:606] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:21.984038 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:21.985152 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:22.051730 16541 raft_consensus.cc:993] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:22.052211 16734 raft_consensus.cc:1081] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:22.053543 15650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:06:22.054065 15650 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.054339 15650 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.058408 15650 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.059770 15650 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:22.060645 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:22.060473 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:22.061149 15729 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.061211 15573 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.061574 15573 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:22.062209 15573 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.063014 15573 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.066069 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:22.067235 15619 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:22.067978 16731 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.068106 15573 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:22.068447 16731 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:22.069284 16731 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.079282 15478 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.170466 16730 raft_consensus.cc:993] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.170933 16731 raft_consensus.cc:1081] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.172356 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:06:22.172780 16276 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.173067 16276 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.178668 16276 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.181389 16276 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:22.181731 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:22.182317 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:22.182406 15650 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.182899 15724 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.183002 15650 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:22.183729 15650 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.184818 15650 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.189143 15724 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.190358 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:22.191262 16735 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.191352 15650 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.192502 16735 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:22.193478 16735 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.209419 15476 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.286770 16731 raft_consensus.cc:993] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.287271 16730 raft_consensus.cc:1081] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.288724 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:06:22.289142 16276 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.289427 16276 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.293974 16276 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.295352 16276 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:22.296080 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:22.296665 15653 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.296782 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:22.297015 15653 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:22.297403 15724 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.297791 15653 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.299857 15653 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.303628 15724 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.304710 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:22.305565 16735 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.306056 16735 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:22.306923 16735 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.307235 15653 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.316313 15476 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.394642 16734 raft_consensus.cc:993] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.395192 16541 raft_consensus.cc:1081] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:22.396559 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39940
I20260709 13:06:22.397004 16276 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.397240 16276 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.401638 16276 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.403244 16276 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:22.404047 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:22.404309 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:22.404656 15572 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.404812 15724 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.404985 15572 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:22.405793 15572 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.406970 15572 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.411262 15724 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.412341 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:22.413208 16735 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.413218 15572 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:22.413811 16735 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:22.414731 16735 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:22.421331 16734 raft_consensus.cc:993] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:22.421854 16734 raft_consensus.cc:1081] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:22.423314 15724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab663998de28482d8438f0c594104dd5"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:22.423058 15476 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.423772 15724 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.424144 15724 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.429998 15724 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.432372 15724 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:22.432730 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:22.432976 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:22.433360 15572 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.433446 15649 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.433692 15572 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:22.434435 15572 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.435633 15572 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.440013 15649 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:22.441491 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:22.442265 16737 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:22.442714 16737 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:22.442873 15572 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:22.443490 16737 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:22.452777 15476 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:22.606892 15649 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.608192 16735 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.625415 15724 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.628931 15729 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:22.629974 16746 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.630568 16751 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.639008 15572 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:22.641819 16751 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:22.705607 15722 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.706979 16735 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.716739 15650 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.718001 16735 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.826107 15573 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.827399 16735 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.835824 15729 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:22.837368 16754 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.923218 15650 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:22.924636 16671 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.936252 15573 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:22.937541 16766 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.985963 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.034785 15573 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:23.037706 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.061105 15650 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.064924 16651 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.065382 15729 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:23.071266 15543 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b55db060b644f01bd9ec436b864e377. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.073580 16541 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.090726 16734 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.094347 15650 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.096768 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:23.097383 15653 raft_consensus.cc:606] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:23.097141 15722 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.111917 15477 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.124861 15653 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:23.133950 15729 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.136296 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:23.136935 15573 raft_consensus.cc:606] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:23.136096 16769 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:06:23.146207 15618 consensus_peers.cc:597] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0eba092a851143659b8e87e62bb71b1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.147291 15573 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.148407 16769 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.150588 15572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:23.151202 15572 raft_consensus.cc:606] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:23.150578 15729 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.151780 16751 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:23.176354 15526 auto_rebalancer.cc:629] Failed to schedule move for tablet 2b413aeb892643a1af655defc3b03c4d: Remote error: Service unavailable: leader transfer in progress
I20260709 13:06:23.181581 15573 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:23.183723 15578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:23.184319 15578 raft_consensus.cc:606] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:23.183517 15572 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.187510 15478 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.202739 16773 raft_consensus.cc:993] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.203330 16541 raft_consensus.cc:1081] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.204993 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:23.205785 15729 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.206378 15729 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.220403 15729 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.230751 15729 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:23.232690 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:23.232679 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:23.233687 15572 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.233954 15653 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.234624 15572 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:23.235819 15572 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.237056 15572 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.241101 15653 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:23.244875 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:23.245808 16766 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.246366 16766 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:23.247160 16766 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.248390 15572 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
W20260709 13:06:23.250182 15543 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9027c3c93a9b4774bba818a406e5e36b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:23.255184 15729 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.259428 16774 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.264614 15653 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:23.271134 16773 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:23.271605 15722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:23.272200 15722 raft_consensus.cc:606] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:23.275363 15477 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.277956 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:23.279767 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:23.283898 16773 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.291267 15722 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.309415 15653 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:23.312584 15477 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.335450 16737 raft_consensus.cc:993] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:23.340149 16671 raft_consensus.cc:1081] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:23.353199 15650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:23.353971 15650 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.354446 15650 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.364261 15650 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.366705 15650 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:23.367722 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:23.368539 15572 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.380524 15572 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:23.381362 15573 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.381683 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:23.383363 16730 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.383738 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:23.383865 16730 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:23.384311 15722 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.384644 15722 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:23.384866 16730 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.385341 15722 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.386642 15722 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.399993 15722 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:23.418787 16751 raft_consensus.cc:993] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.419449 16730 raft_consensus.cc:1081] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.420194 15478 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.421236 15722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:23.421816 15722 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.422215 15722 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.428716 15722 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.431288 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:23.431835 15573 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.435567 15722 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:23.436546 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:23.437121 15650 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.437418 15650 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:23.438287 15573 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:23.438831 15650 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.439404 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:23.440156 15650 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.442230 16787 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.443608 16787 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:23.444518 16787 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.447036 15650 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:23.461338 15478 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.468055 16773 raft_consensus.cc:993] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:23.468564 16541 raft_consensus.cc:1081] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:23.470618 15653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:06:23.471134 15653 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.471462 15653 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.481302 15653 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.484220 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:23.484423 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:23.484788 15572 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.484916 15722 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.485111 15572 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:23.485162 15653 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:23.486002 15572 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.487217 15572 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.490753 16541 raft_consensus.cc:993] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.491230 16773 raft_consensus.cc:1081] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:23.492748 15724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:23.493221 15724 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.493543 15724 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.493561 15572 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:23.499106 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:23.500118 16730 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.500599 16730 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:23.501005 16791 ts_tablet_manager.cc:933] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:23.501422 16730 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.502409 15722 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:23.505287 16791 tablet_copy_client.cc:323] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:23.499532 15724 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.507159 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 2b55db060b644f01bd9ec436b864e377 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:23.507774 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 2b55db060b644f01bd9ec436b864e377 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-2b55db060b644f01bd9ec436b864e377
I20260709 13:06:23.511734 15724 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:23.515556 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:23.516208 15572 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:23.516484 15572 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:23.517127 15572 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.519063 15590 tablet_copy_source_session.cc:215] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.524351 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b55db060b644f01bd9ec436b864e377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:23.525919 15572 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.527422 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:23.528002 15650 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.527678 15478 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.544531 16791 tablet_copy_client.cc:806] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.545192 16791 tablet_copy_client.cc:670] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:23.546343 15650 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:23.545276 15572 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:23.548849 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:23.550808 16671 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:23.554824 16671 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:23.557122 16791 tablet_copy_client.cc:538] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.555775 16671 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:23.566942 16791 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:23.572258 15478 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.590512 16791 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.591486 16791 tablet_bootstrap.cc:492] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:23.592226 16791 ts_tablet_manager.cc:1403] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 13:06:23.594959 16791 raft_consensus.cc:359] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:23.595664 16791 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:23.596347 16791 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:23.598826 16791 ts_tablet_manager.cc:1434] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:23.601768 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-2b55db060b644f01bd9ec436b864e377 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:23.602213 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-2b55db060b644f01bd9ec436b864e377 on tablet 2b55db060b644f01bd9ec436b864e377 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:23.637833 15572 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.639189 16671 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.652081 16791 ts_tablet_manager.cc:933] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:23.656139 15653 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.658977 16787 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.691084 16791 tablet_copy_client.cc:323] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:23.692878 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 0eba092a851143659b8e87e62bb71b1c from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:23.693625 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 0eba092a851143659b8e87e62bb71b1c from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-0eba092a851143659b8e87e62bb71b1c
I20260709 13:06:23.709096 15664 tablet_copy_source_session.cc:215] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:23.712481 16800 ts_tablet_manager.cc:933] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:23.717392 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eba092a851143659b8e87e62bb71b1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:23.788730 16801 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:23.912563 16800 tablet_copy_client.cc:323] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:23.927258 15722 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.931689 15573 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.933169 15653 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.934394 16671 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.930970 16789 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:23.943470 16730 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:23.969317 15653 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:23.970840 16791 tablet_copy_client.cc:806] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:23.972781 16766 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:23.986789 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 9027c3c93a9b4774bba818a406e5e36b from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:23.987277 16276 raft_consensus.cc:1217] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:23.987334 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 9027c3c93a9b4774bba818a406e5e36b from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-9027c3c93a9b4774bba818a406e5e36b
I20260709 13:06:23.999616 16791 tablet_copy_client.cc:670] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:24.019842 15572 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.048988 16791 tablet_copy_client.cc:538] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:24.102221 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 84728.8us
I20260709 13:06:24.107637 15572 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:24.105515 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 53152.5us
I20260709 13:06:24.114038 16789 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.122813 15578 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.123342 15590 tablet_copy_source_session.cc:215] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:24.123692 16766 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.134455 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9027c3c93a9b4774bba818a406e5e36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:24.137214 15722 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.141384 16751 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.155592 16810 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.160768 16791 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:24.187918 16800 tablet_copy_client.cc:806] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:24.188503 16800 tablet_copy_client.cc:670] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:24.201303 16800 tablet_copy_client.cc:538] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:24.208274 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 52057.6us
I20260709 13:06:24.210712 16800 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:24.255153 16800 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:24.256188 16800 tablet_bootstrap.cc:492] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:24.256979 16800 ts_tablet_manager.cc:1403] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.005s
I20260709 13:06:24.260757 16800 raft_consensus.cc:359] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.261650 16800 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:24.262359 16800 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.265058 16800 ts_tablet_manager.cc:1434] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:06:24.266728 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9027c3c93a9b4774bba818a406e5e36b received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:24.267112 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9027c3c93a9b4774bba818a406e5e36b on tablet 9027c3c93a9b4774bba818a406e5e36b with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:24.278079 16791 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:24.279009 16791 tablet_bootstrap.cc:492] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:24.279713 16791 ts_tablet_manager.cc:1403] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.119s	user 0.034s	sys 0.019s
I20260709 13:06:24.280628 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.282568 16791 raft_consensus.cc:359] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.284338 16791 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:24.285012 16791 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.287684 16791 ts_tablet_manager.cc:1434] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:24.289824 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-0eba092a851143659b8e87e62bb71b1c received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:24.290302 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-0eba092a851143659b8e87e62bb71b1c on tablet 0eba092a851143659b8e87e62bb71b1c with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:24.341248 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.391518 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:24.392122 15650 raft_consensus.cc:606] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:24.394544 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:24.395092 15729 raft_consensus.cc:606] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:24.397473 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:24.397985 15650 raft_consensus.cc:606] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:24.400156 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ec834a3b71420c9f09248e41809358"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:24.400684 15729 raft_consensus.cc:606] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:24.402823 15578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:24.403258 15578 raft_consensus.cc:606] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:24.405433 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:24.405938 15729 raft_consensus.cc:606] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:24.406984 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:24.408059 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:24.464814 16787 raft_consensus.cc:993] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.465404 16810 raft_consensus.cc:1081] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.466993 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:24.467585 16276 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.468010 16276 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.473582 16276 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.475984 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:24.476639 15578 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.477171 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:24.481352 15729 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.481753 15729 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:24.483680 15578 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:24.483058 15729 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.485415 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:24.485929 15729 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.486582 16746 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.487112 16746 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:24.487920 16746 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.489537 16276 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:24.492107 16817 raft_consensus.cc:993] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.492640 16817 raft_consensus.cc:1081] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.495118 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:06:24.495669 16276 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.496088 16276 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.496021 15729 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:24.498529 15477 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.502570 16276 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.504675 16276 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:24.505275 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:24.505826 15650 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.506147 15650 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:24.506896 15650 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.508474 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:24.509244 15729 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.520068 15650 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.518532 15729 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:24.527032 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:24.527941 16746 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.527993 16774 raft_consensus.cc:1064] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:24.528469 16746 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:24.529397 16746 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.531466 16774 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.534634 16276 raft_consensus.cc:1217] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.537352 15650 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:24.562901 16277 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.564234 15650 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.565151 16541 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:24.566308 16804 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.581552 15724 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:24.583205 16804 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.618402 16276 raft_consensus.cc:1217] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:24.639401 16671 raft_consensus.cc:993] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.640599 16671 raft_consensus.cc:1081] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:24.648331 16830 raft_consensus.cc:993] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:24.648803 16830 raft_consensus.cc:1081] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:24.647300 15478 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 3 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.650838 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ec834a3b71420c9f09248e41809358"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:24.645747 16789 raft_consensus.cc:993] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:24.651353 16276 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.650096 16828 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.651814 16276 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.654594 16789 raft_consensus.cc:1081] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:24.657395 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:24.657907 15729 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.659232 15729 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.660631 16276 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.663163 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:24.663681 15650 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.668803 15726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:24.669363 15726 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.669704 15726 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.668812 15728 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.674672 16810 raft_consensus.cc:993] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:24.675163 16810 raft_consensus.cc:1081] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:24.675782 15650 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:24.676517 15653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:24.677177 15653 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.677595 15653 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.680652 15729 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.682529 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:24.683352 16746 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.683945 16746 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:24.684968 16746 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.739395 15726 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.746313 16276 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:24.750316 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:24.761830 15728 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.762179 15728 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:24.762509 15653 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.754585 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:24.779846 15649 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.780157 15649 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:24.756830 16277 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.780856 15653 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:24.753906 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:24.781911 15573 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.781999 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:24.782635 15722 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.782923 15722 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:24.765646 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:24.783604 15722 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.784080 15650 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.784595 15722 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.762904 15728 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.786703 15728 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.787505 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:24.788069 15577 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.780876 15649 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.791500 15649 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.764560 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:24.762274 15478 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.764525 15726 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:24.770642 15654 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.778079 15729 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:24.777312 15476 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.792655 15650 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:24.798331 15573 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:24.798622 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:24.799853 16812 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.800288 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:24.800382 16812 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:24.797089 15578 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.794008 15577 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:24.801167 15578 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:24.792714 15728 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:24.802165 16810 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.801921 15578 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.802625 16810 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:24.801514 16812 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.803216 15578 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.805269 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:24.806566 16789 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.807036 16789 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:24.806799 16810 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:24.807839 16789 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:24.821853 15577 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:24.826217 15649 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:24.813820 15722 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:24.835479 16277 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.837005 16804 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.837670 15477 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.840610 15722 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.842949 16828 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:24.847537 16276 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.839637 15477 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.845685 16804 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.867692 15722 raft_consensus.cc:2955] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:24.871308 15476 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.877031 15578 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:24.881752 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b55db060b644f01bd9ec436b864e377 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.890693 15577 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:24.892458 15478 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.896009 15728 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:24.901141 16746 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.905467 16746 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.931195 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b55db060b644f01bd9ec436b864e377 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:24.936720 16841 tablet_replica.cc:333] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:24.942258 16841 raft_consensus.cc:2243] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.955942 16841 raft_consensus.cc:2272] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.990288 16841 ts_tablet_manager.cc:1916] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.030606 16841 ts_tablet_manager.cc:1929] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.031167 16841 log.cc:1199] T 2b55db060b644f01bd9ec436b864e377 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/2b55db060b644f01bd9ec436b864e377
I20260709 13:06:25.033442 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 2b55db060b644f01bd9ec436b864e377 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:25.116150 15728 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:25.116676 16828 raft_consensus.cc:1064] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:25.119308 16828 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.121014 16835 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.132364 15649 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:25.135021 16274 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:25.136574 16804 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.137209 15728 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:25.138515 16774 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.143618 16835 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.148902 15654 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:25.150882 16774 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:25.208595 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48520.1us
I20260709 13:06:25.213514 15578 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.216658 15649 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.222824 16835 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.209563 15728 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.240260 16814 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.245214 16804 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.261264 15728 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.275691 16276 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.281352 16789 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.297848 15722 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.320888 15476 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.323824 15654 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.325379 16789 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:25.326917 16274 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Advancing to term 2
I20260709 13:06:25.346365 15649 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:25.348981 16274 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:25.350795 16671 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.358177 16810 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:25.360332 16671 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.361431 15577 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.369743 16276 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.371240 16804 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.379621 16774 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.387974 16277 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.408824 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.409305 15649 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.419675 15729 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:25.423221 16830 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.424132 15573 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:25.426438 16810 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:25.470337 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 78773.3us
I20260709 13:06:25.508782 15578 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.513902 16810 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.518953 15728 raft_consensus.cc:2955] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.567376 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9027c3c93a9b4774bba818a406e5e36b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.578287 15476 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.610136 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 9027c3c93a9b4774bba818a406e5e36b with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:25.612803 16863 tablet_replica.cc:333] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:25.614084 16863 raft_consensus.cc:2243] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.614907 16863 raft_consensus.cc:2272] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.614840 16671 raft_consensus.cc:1064] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:25.617957 16671 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:25.622169 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 96307us
I20260709 13:06:25.627205 16863 ts_tablet_manager.cc:1916] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.644765 16274 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.646354 16812 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.649087 15649 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.650888 16671 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.652133 15577 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:25.655885 16812 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:25.660892 15649 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.659255 16810 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.684871 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.688819 15573 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.690816 15478 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.703724 16863 ts_tablet_manager.cc:1929] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.705250 16863 log.cc:1199] T 9027c3c93a9b4774bba818a406e5e36b P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/9027c3c93a9b4774bba818a406e5e36b
I20260709 13:06:25.708505 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 9027c3c93a9b4774bba818a406e5e36b (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:25.708271 16277 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.737633 15723 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.742688 15650 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.744012 16671 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.745213 16277 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.748215 16671 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.755553 16812 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.756609 16274 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.759416 15650 raft_consensus.cc:2955] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.773546 15475 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:25.787079 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eba092a851143659b8e87e62bb71b1c with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:25.794452 15723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:25.797744 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0eba092a851143659b8e87e62bb71b1c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:25.801282 16864 tablet_replica.cc:333] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:25.805205 15723 raft_consensus.cc:606] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:25.811403 15728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:25.812040 15728 raft_consensus.cc:606] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:25.817126 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:25.817771 15573 raft_consensus.cc:606] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:25.820604 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:25.821205 15650 raft_consensus.cc:606] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:25.823551 16864 raft_consensus.cc:2243] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.824370 16864 raft_consensus.cc:2272] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.828387 16864 ts_tablet_manager.cc:1916] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.834295 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:25.834993 15573 raft_consensus.cc:606] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:25.836848 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:25.838734 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.846549 16864 ts_tablet_manager.cc:1929] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:25.846962 16864 log.cc:1199] T 0eba092a851143659b8e87e62bb71b1c P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/0eba092a851143659b8e87e62bb71b1c
I20260709 13:06:25.848264 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 0eba092a851143659b8e87e62bb71b1c (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:25.968327 16671 raft_consensus.cc:993] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:25.968868 16812 raft_consensus.cc:1081] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:25.970434 16274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:25.970973 16274 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.971352 16274 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.976986 16274 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.978585 16274 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:25.979220 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:25.979436 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:25.979869 15578 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.980159 15728 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.980485 15728 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:25.981256 15728 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.982393 15728 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.985925 15578 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:25.987138 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:25.987901 16835 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.988233 15728 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:25.988384 16835 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:25.989378 16835 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:25.998170 15475 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.138255 16804 raft_consensus.cc:993] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:26.138794 16861 raft_consensus.cc:1081] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:26.140055 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:26.140508 15723 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.140800 15723 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.147635 15723 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.149596 15723 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:26.150614 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:26.150897 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:26.151197 15578 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.151510 16274 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.151530 15578 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:26.152455 15578 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.153478 15578 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.157931 15578 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:26.157994 16274 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:26.159076 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:26.159835 16810 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.160320 16810 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:26.161121 16810 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.170600 15475 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.175889 16789 raft_consensus.cc:993] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:26.176352 16730 raft_consensus.cc:1081] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:26.178233 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:26.178747 15723 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.179054 15723 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.183313 15723 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:26.185223 15723 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:26.185299 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:26.185691 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:26.185941 15578 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.186329 15650 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.186555 15650 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:26.187019 15650 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:26.187742 15650 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.190789 15578 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:26.192175 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:26.192425 15650 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:26.193265 16812 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:26.193728 16812 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:26.194463 16812 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:26.202896 15475 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.293915 16861 raft_consensus.cc:993] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:26.294425 16804 raft_consensus.cc:1081] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:26.295804 16274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39940
I20260709 13:06:26.296296 16274 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.296694 16274 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.302522 16274 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.304661 16274 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:26.305361 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:26.305608 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:26.306015 15650 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.306134 15578 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.306499 15578 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:26.307196 15578 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.308375 15578 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.312703 15650 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:26.313794 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:26.314503 16835 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.314610 15578 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:26.314970 16835 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:26.315893 16835 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.323319 15475 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.331598 16812 raft_consensus.cc:993] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:26.332078 16810 raft_consensus.cc:1081] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:26.333328 16274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:26.333822 16274 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.334152 16274 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.338691 16274 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.340596 16274 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:26.346465 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:26.346663 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:26.347067 15650 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.347293 15723 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.347592 15723 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:26.348289 15723 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.349531 15723 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.353437 15650 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:26.354606 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:26.356462 15723 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:26.357545 16835 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:26.358249 16835 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:26.359083 16835 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:26.368407 15475 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 3 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.481617 15728 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.482843 16835 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.494477 15578 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.497670 16746 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.584743 15650 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:26.585737 16812 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.595678 15573 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:26.597097 16671 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.679324 15573 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.680898 16812 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.696615 16274 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.699081 15573 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.700519 16671 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.702414 16746 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.718581 15649 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.720121 16746 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.766350 15723 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:26.767536 16881 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:26.777518 15649 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:26.779397 16835 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:26.839643 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.869839 15577 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:26.876297 15543 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57eafeb5dcb749c7be00fa4c5e0eae26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.877379 15728 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.877396 15649 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.878741 16861 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.879580 16804 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.886390 16861 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:26.888509 15649 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:26.889948 15728 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:26.909106 15475 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.910945 15723 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:26.952219 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.961486 15653 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.963973 15692 consensus_peers.cc:597] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7a0379477ed4600a60cd9fde8f2867a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.964322 16810 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.964867 15573 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.968794 16671 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.980901 16810 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.043807 15653 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.047942 15650 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:27.152904 16897 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:06:27.162761 15618 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c3913ed9e5b4674a9091483756deadf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.170920 15478 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.181217 15722 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.185853 15575 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.189643 16896 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:27.196907 16884 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:27.257848 15573 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.277572 16789 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.293428 15723 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:27.310925 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51768us
I20260709 13:06:27.340764 15572 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.360060 15650 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:27.385362 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 68959.9us
I20260709 13:06:27.391297 15723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:27.392400 15723 raft_consensus.cc:606] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:27.397919 15578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:27.398540 15578 raft_consensus.cc:606] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:27.404968 15618 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1059a62c94747b0b296ee50ba126991. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.407114 15728 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.408810 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:27.408699 16896 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.409498 15573 raft_consensus.cc:606] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:27.412899 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:27.414665 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.391338 15478 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.417907 15573 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:27.419477 16896 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:27.422544 16896 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.424917 15723 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.438213 15573 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:27.448745 15477 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.473839 16913 ts_tablet_manager.cc:933] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:27.476048 16913 tablet_copy_client.cc:323] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:27.477947 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:27.478544 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 57eafeb5dcb749c7be00fa4c5e0eae26 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-57eafeb5dcb749c7be00fa4c5e0eae26
I20260709 13:06:27.480999 16909 raft_consensus.cc:993] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:27.481526 16908 raft_consensus.cc:1081] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:27.483202 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:27.483758 15723 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.484045 15723 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.487242 15590 tablet_copy_source_session.cc:215] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.490753 16913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57eafeb5dcb749c7be00fa4c5e0eae26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.492604 15723 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.495579 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:27.496348 15573 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.496654 15723 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:27.496670 15573 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:27.497210 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:27.497748 15650 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.497936 15573 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.499318 15573 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.504598 15650 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:27.506448 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:27.507602 16906 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.508031 16906 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:27.508876 16906 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.512338 16909 raft_consensus.cc:993] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:27.512835 16909 raft_consensus.cc:1081] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:27.513186 16913 tablet_copy_client.cc:806] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.513824 16913 tablet_copy_client.cc:670] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.509372 15573 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:27.515807 15648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:06:27.516373 15648 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.516754 15648 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.520912 16913 tablet_copy_client.cc:538] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.528172 15475 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.531364 16913 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:27.545549 15648 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.548661 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:27.548977 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:27.549253 15578 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.549609 15578 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:27.550673 15578 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.552007 15648 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:27.549521 15723 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.555158 16913 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.555606 15578 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.556154 16913 tablet_bootstrap.cc:492] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:27.560878 16913 ts_tablet_manager.cc:1403] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:06:27.564375 16913 raft_consensus.cc:359] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.565330 16913 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:27.565974 16913 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.569591 16913 ts_tablet_manager.cc:1434] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:27.569979 16917 ts_tablet_manager.cc:933] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:27.571607 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-57eafeb5dcb749c7be00fa4c5e0eae26 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:27.572064 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-57eafeb5dcb749c7be00fa4c5e0eae26 on tablet 57eafeb5dcb749c7be00fa4c5e0eae26 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:27.578303 15723 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:27.580536 15578 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:27.581897 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:27.582808 16896 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.583242 16896 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:27.584043 16896 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.588351 16917 tablet_copy_client.cc:323] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:27.590276 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet a7a0379477ed4600a60cd9fde8f2867a from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:27.590824 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet a7a0379477ed4600a60cd9fde8f2867a from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-a7a0379477ed4600a60cd9fde8f2867a
I20260709 13:06:27.603866 15738 tablet_copy_source_session.cc:215] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.608052 16917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7a0379477ed4600a60cd9fde8f2867a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.609447 15475 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.623876 16917 tablet_copy_client.cc:806] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.624493 16917 tablet_copy_client.cc:670] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.628077 16917 tablet_copy_client.cc:538] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.636098 16906 raft_consensus.cc:993] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:27.636809 16899 raft_consensus.cc:1081] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:27.637646 16917 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:27.638542 15648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:27.639067 15648 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.639374 15648 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.644531 15648 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.647150 15648 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:27.651026 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:27.651610 15578 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.680511 15578 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:27.684579 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:27.685832 16884 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:27.686409 16884 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:27.687244 16884 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.692804 16917 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.693854 16917 tablet_bootstrap.cc:492] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:27.694602 16917 ts_tablet_manager.cc:1403] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.033s
I20260709 13:06:27.697695 16917 raft_consensus.cc:359] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.698693 16917 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:27.699481 16917 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.701583 16913 ts_tablet_manager.cc:933] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:27.702201 16917 ts_tablet_manager.cc:1434] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:06:27.673245 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:27.704262 15723 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:27.704634 15723 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:27.705323 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a7a0379477ed4600a60cd9fde8f2867a received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:27.705780 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a7a0379477ed4600a60cd9fde8f2867a on tablet a7a0379477ed4600a60cd9fde8f2867a with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:27.706833 15723 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:27.707784 15723 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.718664 16913 tablet_copy_client.cc:323] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:27.722730 15723 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:27.723649 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 1c3913ed9e5b4674a9091483756deadf from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:27.724440 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 1c3913ed9e5b4674a9091483756deadf from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-1c3913ed9e5b4674a9091483756deadf
I20260709 13:06:27.743146 15664 tablet_copy_source_session.cc:215] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.747856 16913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3913ed9e5b4674a9091483756deadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:27.753542 15478 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.782927 16913 tablet_copy_client.cc:806] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.783473 16913 tablet_copy_client.cc:670] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.789305 16913 tablet_copy_client.cc:538] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.797194 16913 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:27.814917 16913 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.815788 16913 tablet_bootstrap.cc:492] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:27.816433 16913 ts_tablet_manager.cc:1403] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.008s
I20260709 13:06:27.820322 16913 raft_consensus.cc:359] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.821206 16913 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:27.821892 16913 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:27.828902 16913 ts_tablet_manager.cc:1434] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:27.830827 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-1c3913ed9e5b4674a9091483756deadf received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:27.831290 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-1c3913ed9e5b4674a9091483756deadf on tablet 1c3913ed9e5b4674a9091483756deadf with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:27.864523 16276 raft_consensus.cc:1217] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.922540 16913 ts_tablet_manager.cc:933] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:27.924170 16913 tablet_copy_client.cc:323] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:27.925750 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet b1059a62c94747b0b296ee50ba126991 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:27.926298 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet b1059a62c94747b0b296ee50ba126991 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-b1059a62c94747b0b296ee50ba126991
I20260709 13:06:27.933739 15664 tablet_copy_source_session.cc:215] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:27.935732 15578 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.937435 16276 raft_consensus.cc:1217] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.941819 16906 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.960621 15648 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.963266 16905 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:27.979835 16913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1059a62c94747b0b296ee50ba126991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:28.002982 16913 tablet_copy_client.cc:806] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:28.003618 16913 tablet_copy_client.cc:670] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:28.007452 16913 tablet_copy_client.cc:538] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:28.012385 15573 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.013981 16884 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.016831 16913 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:28.036201 15723 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.037883 16789 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.069623 16913 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:28.070710 16913 tablet_bootstrap.cc:492] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:28.071395 16913 ts_tablet_manager.cc:1403] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.016s
I20260709 13:06:28.074411 16913 raft_consensus.cc:359] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:28.075613 16913 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:28.076330 16913 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:28.087211 15723 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.088979 16789 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.093554 16913 ts_tablet_manager.cc:1434] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 13:06:28.107605 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-b1059a62c94747b0b296ee50ba126991 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:28.108110 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-b1059a62c94747b0b296ee50ba126991 on tablet b1059a62c94747b0b296ee50ba126991 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:28.124300 15578 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.125708 16789 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.172284 16276 raft_consensus.cc:1217] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:28.297474 16909 raft_consensus.cc:1064] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:28.300606 16909 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.306823 16277 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.307071 15728 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.307821 15650 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.308626 16901 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.309469 16908 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.314524 16804 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.325191 16901 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.326630 15728 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.338039 16276 raft_consensus.cc:1217] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:28.345929 15475 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.355013 15650 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.347448 16277 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.399879 15578 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.405102 16277 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.407109 16901 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.408265 15650 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.409832 16901 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.415982 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.417030 16804 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.424011 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.422701 16277 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.430593 15650 raft_consensus.cc:2955] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.443895 15477 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.462606 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 57eafeb5dcb749c7be00fa4c5e0eae26 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:28.497099 16942 tablet_replica.cc:333] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:28.501189 16942 raft_consensus.cc:2243] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.502072 16942 raft_consensus.cc:2272] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.507149 16942 ts_tablet_manager.cc:1916] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.520001 16899 raft_consensus.cc:1064] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:28.523159 16899 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.526690 16942 ts_tablet_manager.cc:1929] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.527261 16942 log.cc:1199] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/57eafeb5dcb749c7be00fa4c5e0eae26
I20260709 13:06:28.529634 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 57eafeb5dcb749c7be00fa4c5e0eae26 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:28.530591 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.542841 16277 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.544656 15578 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.553228 15650 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.555302 16905 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.559039 16905 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.561286 16946 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.579922 16884 raft_consensus.cc:1064] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:28.584146 16884 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.600317 16944 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.604393 15650 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.616340 15723 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.616887 16277 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.618252 16896 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.619809 16730 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.642078 15578 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.644693 16789 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.660575 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:28.661280 15573 raft_consensus.cc:606] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:28.669837 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:28.670742 15649 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:28.683085 15723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:28.683692 15723 raft_consensus.cc:606] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:28.694629 16804 raft_consensus.cc:993] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:28.695323 16909 raft_consensus.cc:1081] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:28.699429 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:28.700336 15649 raft_consensus.cc:606] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:28.702198 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:28.703999 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:28.710984 15649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:06:28.714546 16884 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.718449 16956 raft_consensus.cc:993] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:28.716437 16277 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.723598 15728 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.717898 16276 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.721319 15649 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.728984 15573 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.730296 15649 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.732070 16896 raft_consensus.cc:1081] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:28.723598 15478 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.734077 16278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:06:28.734584 16278 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.734916 16278 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.747504 15477 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.750711 16278 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.763520 16899 raft_consensus.cc:993] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:28.770931 16899 raft_consensus.cc:1081] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:28.771871 16278 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:28.772956 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:28.774128 15578 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.774507 15572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:41382
I20260709 13:06:28.775017 15572 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.775317 15572 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.773236 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:28.776502 15650 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.776787 15650 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:28.777518 15650 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.778515 15650 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.787168 15650 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:28.789189 15575 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.797806 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:28.798394 15572 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.798743 16835 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.799299 16835 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:28.800099 16835 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.795229 15578 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:28.801553 15649 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.804345 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:28.816783 15723 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.817118 15723 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:28.817830 15723 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.818899 15723 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.825716 15723 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:28.811817 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:28.833703 15648 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.840806 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:28.841393 15728 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.843511 15650 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.805017 15572 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:28.828883 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:28.848651 15648 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:28.850469 15728 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:28.850970 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:28.851460 15575 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.851796 15575 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:28.852068 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:28.852356 16908 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.852523 15575 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.852908 16908 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:28.853588 15575 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.854014 16884 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.853962 16908 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.854700 16884 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:28.857024 16884 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:28.851015 15649 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:28.860450 15723 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.871408 15575 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:28.871438 16277 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.875254 16899 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.875039 15478 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.880575 15575 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.884678 16899 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.883828 16884 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:28.888108 15649 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.887990 15477 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.889480 16947 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.890838 16277 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.894326 16884 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.895184 15649 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.901762 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7a0379477ed4600a60cd9fde8f2867a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.905573 16896 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.907984 15475 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.913213 16278 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.925014 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c3913ed9e5b4674a9091483756deadf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.927362 15575 raft_consensus.cc:2955] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.951393 15473 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.951922 16278 raft_consensus.cc:2955] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.953059 15472 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:28.959311 16956 raft_consensus.cc:1064] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:28.961879 16956 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:28.983214 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet a7a0379477ed4600a60cd9fde8f2867a with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:28.987535 15575 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:28.995741 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c3913ed9e5b4674a9091483756deadf with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:28.997798 16942 tablet_replica.cc:333] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:28.998950 16942 raft_consensus.cc:2243] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.999691 16942 raft_consensus.cc:2272] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.001256 16730 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.006655 16942 ts_tablet_manager.cc:1916] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.015502 15723 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.034905 16278 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:29.038007 16963 tablet_replica.cc:333] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:29.040668 16963 raft_consensus.cc:2243] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.041389 16789 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:29.041708 16963 raft_consensus.cc:2272] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.043931 16896 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.045885 16963 ts_tablet_manager.cc:1916] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.070254 16942 ts_tablet_manager.cc:1929] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.070762 16942 log.cc:1199] T 1c3913ed9e5b4674a9091483756deadf P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/1c3913ed9e5b4674a9091483756deadf
I20260709 13:06:29.074802 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 1c3913ed9e5b4674a9091483756deadf (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:29.078119 16963 ts_tablet_manager.cc:1929] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.078680 16963 log.cc:1199] T a7a0379477ed4600a60cd9fde8f2867a P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/a7a0379477ed4600a60cd9fde8f2867a
I20260709 13:06:29.077819 16730 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.082518 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet a7a0379477ed4600a60cd9fde8f2867a (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:29.091384 15578 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.100342 16278 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.104182 15722 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.114660 15472 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.133817 16789 raft_consensus.cc:993] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:29.134352 16789 raft_consensus.cc:1081] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:29.136340 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:29.136842 15723 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:29.137180 15723 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.138792 15649 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:29.143532 15723 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:29.147625 16278 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.149181 16960 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.153177 15575 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:29.154739 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:29.155282 15575 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.155516 16960 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.155843 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:29.156396 15650 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.156674 15650 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:29.158483 16896 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.159626 16278 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.162966 15650 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:29.163964 15650 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.165948 15578 raft_consensus.cc:2955] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.178772 15473 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:29.188092 15575 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:29.189738 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:29.191758 15723 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:29.191956 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1059a62c94747b0b296ee50ba126991 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:29.193337 16947 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:29.194706 16947 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:29.195778 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet b1059a62c94747b0b296ee50ba126991 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:29.196678 16947 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:29.197481 16942 tablet_replica.cc:333] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:29.198369 15650 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:29.198655 16942 raft_consensus.cc:2243] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:29.199384 16942 raft_consensus.cc:2272] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:29.208392 16942 ts_tablet_manager.cc:1916] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:29.240628 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.242671 16942 ts_tablet_manager.cc:1929] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:29.243108 16942 log.cc:1199] T b1059a62c94747b0b296ee50ba126991 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/b1059a62c94747b0b296ee50ba126991
I20260709 13:06:29.244374 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet b1059a62c94747b0b296ee50ba126991 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:29.260310 15575 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.261683 16835 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:29.263902 15649 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.265377 16835 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:29.318156 15578 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.319275 16789 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.328382 15723 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.330312 16789 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.394987 15723 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.396256 16901 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.405107 15649 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.406636 16908 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.611740 15578 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.613013 16947 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.623076 15649 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:29.626375 16944 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.704990 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.788789 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:29.831386 15723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:29.831979 15723 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:29.835464 15722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:29.836105 15722 raft_consensus.cc:606] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:29.838610 15648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:29.839205 15648 raft_consensus.cc:606] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:29.843472 15578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da1e42035c3d46ac90631305fec02672"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:29.843916 15578 raft_consensus.cc:606] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:29.844985 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:29.846006 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:30.127012 16899 raft_consensus.cc:993] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:30.127550 16944 raft_consensus.cc:1081] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Signalling peer 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:30.129007 15578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:41382
I20260709 13:06:30.129546 15578 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.129830 15578 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.134658 15578 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.136019 15578 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:30.136814 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:30.137084 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:30.137382 15649 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.137600 15723 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.137893 15723 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:30.138652 15723 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.139782 15723 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.143826 15649 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:30.145052 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:30.145701 16981 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:30.145952 15723 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:30.146236 16981 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:30.147557 16981 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.157145 15472 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 3 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.205873 16981 raft_consensus.cc:993] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:30.206441 16982 raft_consensus.cc:1081] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:30.207968 15649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da1e42035c3d46ac90631305fec02672"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:06:30.208520 15649 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.208804 15649 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.217281 15649 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.219691 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:30.219727 15649 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:30.220340 15578 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.220678 15578 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:30.220795 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:30.221315 15723 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.221421 15578 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.222743 15578 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.229537 15578 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:30.230592 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:30.231703 16956 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.232209 16956 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:30.233039 16956 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.238010 15723 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:30.241724 16899 raft_consensus.cc:993] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:30.242295 16899 raft_consensus.cc:1081] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:30.245433 15649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:30.246060 15649 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.246423 15649 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.255841 15649 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.258751 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:30.259327 15723 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:30.259629 15723 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:30.260433 15723 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.261425 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:30.262045 15575 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.268244 15472 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.278051 15723 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:30.284925 15575 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:30.286216 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:30.287094 16956 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:30.287586 16956 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:30.288384 16956 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.295410 15723 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:30.296115 15649 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:30.299609 15728 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:30.307855 15649 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:30.309021 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 233f2755fc484e7fb202702622c7b652. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.310707 16944 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.312551 15575 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.314648 16987 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.315739 16956 raft_consensus.cc:993] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:30.316222 16956 raft_consensus.cc:1081] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:30.309165 15472 catalog_manager.cc:5697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.318076 15728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:30.318593 15728 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:30.318898 15728 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.336381 15728 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.339639 15728 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:30.340085 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:30.340909 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:30.340920 15578 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.341635 15648 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:30.342113 15648 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:30.343118 15648 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.344552 15648 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.357573 15578 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:30.359543 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:30.363435 16987 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.365470 16987 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:30.366874 16987 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:30.365494 15648 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:30.378309 16899 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.382102 15648 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.393023 15575 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.393491 15472 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.397910 15474 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.406477 15723 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:30.419169 15648 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:30.420473 16899 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:30.421525 15692 consensus_peers.cc:597] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab663998de28482d8438f0c594104dd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.422569 15575 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:30.423872 16899 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.428637 16987 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.430433 15648 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.435299 15575 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.441812 15578 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:30.458736 15474 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.463066 15723 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:06:30.463883 15543 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83d7922f778044c7b5600f9d4024c1b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.464732 16981 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.468124 15650 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:30.470566 16981 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.480895 16988 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.484385 15723 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.484560 15648 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.496188 15650 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:30.501991 15475 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 3, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.512622 15722 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.514340 16996 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:30.520015 15618 consensus_peers.cc:597] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e1128bef1224facb3c1a31e94fb0379. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:30.523568 15578 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:30.525388 16956 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.526769 16789 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.529127 15722 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.538766 15578 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:30.545876 15475 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:30.608096 15650 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:30.609360 16981 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:30.620834 15722 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:30.623144 16988 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:30.639895 15723 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.641805 16956 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.659436 15578 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.660931 16996 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.824396 15722 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.825847 16956 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.836830 15575 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:30.838596 16956 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:30.846818 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.887071 17015 ts_tablet_manager.cc:933] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:30.898625 17015 tablet_copy_client.cc:323] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:30.901397 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet ab663998de28482d8438f0c594104dd5 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:30.902057 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet ab663998de28482d8438f0c594104dd5 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-ab663998de28482d8438f0c594104dd5
I20260709 13:06:30.906795 17017 ts_tablet_manager.cc:933] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:30.912731 15575 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:30.914350 16944 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:30.932983 15650 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:30.937181 16899 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:30.951063 17021 ts_tablet_manager.cc:933] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:30.952183 15738 tablet_copy_source_session.cc:215] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.960523 17015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab663998de28482d8438f0c594104dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.961802 17021 tablet_copy_client.cc:323] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:30.964282 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 233f2755fc484e7fb202702622c7b652 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:30.964789 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 233f2755fc484e7fb202702622c7b652 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-233f2755fc484e7fb202702622c7b652
I20260709 13:06:30.981374 17017 tablet_copy_client.cc:323] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:30.983255 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 83d7922f778044c7b5600f9d4024c1b5 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:30.983803 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 83d7922f778044c7b5600f9d4024c1b5 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-83d7922f778044c7b5600f9d4024c1b5
I20260709 13:06:30.988286 17015 tablet_copy_client.cc:806] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:30.988950 17015 tablet_copy_client.cc:670] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:30.991149 15590 tablet_copy_source_session.cc:215] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:30.992825 17015 tablet_copy_client.cc:538] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:30.994781 17017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d7922f778044c7b5600f9d4024c1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:30.998116 15738 tablet_copy_source_session.cc:215] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.001261 17021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f2755fc484e7fb202702622c7b652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.002184 17015 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:31.027957 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.088945 17015 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:31.089927 17015 tablet_bootstrap.cc:492] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:31.092624 17015 ts_tablet_manager.cc:1403] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.091s	user 0.031s	sys 0.029s
I20260709 13:06:31.097640 17015 raft_consensus.cc:359] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.099334 17015 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
W20260709 13:06:31.096872 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 60376.2us
I20260709 13:06:31.100036 17015 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.102634 17015 ts_tablet_manager.cc:1434] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:06:31.119468 17025 ts_tablet_manager.cc:933] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:31.121492 17017 tablet_copy_client.cc:806] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:31.122380 17017 tablet_copy_client.cc:670] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:31.128048 17017 tablet_copy_client.cc:538] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:31.141749 17017 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:31.153640 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-ab663998de28482d8438f0c594104dd5 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:31.154300 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-ab663998de28482d8438f0c594104dd5 on tablet ab663998de28482d8438f0c594104dd5 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:31.164880 17025 tablet_copy_client.cc:323] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:31.172278 17021 tablet_copy_client.cc:806] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:31.173899 17021 tablet_copy_client.cc:670] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:31.188728 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 9e1128bef1224facb3c1a31e94fb0379 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:31.189322 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 9e1128bef1224facb3c1a31e94fb0379 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-9e1128bef1224facb3c1a31e94fb0379
I20260709 13:06:31.194989 17021 tablet_copy_client.cc:538] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:31.199822 17017 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:31.196981 15664 tablet_copy_source_session.cc:215] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.200736 17017 tablet_bootstrap.cc:492] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:31.201467 17017 ts_tablet_manager.cc:1403] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.060s	user 0.030s	sys 0.002s
I20260709 13:06:31.203449 17025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1128bef1224facb3c1a31e94fb0379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:31.204412 17017 raft_consensus.cc:359] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.205214 17017 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:31.205863 17017 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.207491 17021 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:31.218266 17017 ts_tablet_manager.cc:1434] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:06:31.219916 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-83d7922f778044c7b5600f9d4024c1b5 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:31.220355 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-83d7922f778044c7b5600f9d4024c1b5 on tablet 83d7922f778044c7b5600f9d4024c1b5 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:31.238572 17025 tablet_copy_client.cc:806] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:31.239157 17025 tablet_copy_client.cc:670] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:31.243105 17025 tablet_copy_client.cc:538] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:31.262301 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:31.262928 15650 raft_consensus.cc:606] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:31.264174 17021 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:31.265086 17021 tablet_bootstrap.cc:492] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:31.265730 17021 ts_tablet_manager.cc:1403] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.009s
I20260709 13:06:31.266610 17025 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:31.268695 17021 raft_consensus.cc:359] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.269490 17021 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:31.270139 17021 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.272826 17021 ts_tablet_manager.cc:1434] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:31.274739 15722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:31.275302 15722 raft_consensus.cc:606] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:31.276188 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-233f2755fc484e7fb202702622c7b652 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:31.276614 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-233f2755fc484e7fb202702622c7b652 on tablet 233f2755fc484e7fb202702622c7b652 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:31.280478 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:31.281005 15650 raft_consensus.cc:606] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:31.283548 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:31.284068 15575 raft_consensus.cc:606] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:31.285368 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:31.290211 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:31.290488 17025 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:31.291422 17025 tablet_bootstrap.cc:492] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:31.292101 17025 ts_tablet_manager.cc:1403] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:06:31.295902 17025 raft_consensus.cc:359] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.296727 17025 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:31.297370 17025 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:31.301056 17025 ts_tablet_manager.cc:1434] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:31.302609 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9e1128bef1224facb3c1a31e94fb0379 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:31.302989 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9e1128bef1224facb3c1a31e94fb0379 on tablet 9e1128bef1224facb3c1a31e94fb0379 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:31.310670 16278 raft_consensus.cc:1217] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:31.388940 16278 raft_consensus.cc:1217] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:31.403702 16278 raft_consensus.cc:1217] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:31.421342 16899 raft_consensus.cc:993] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:31.421880 17020 raft_consensus.cc:1081] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:06:31.423280 15575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:41382
I20260709 13:06:31.423802 15575 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.424132 15575 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.432245 15575 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:31.434872 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:31.435454 15650 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.436084 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:31.436738 15722 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:31.437019 15722 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:31.437878 15722 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:31.438957 15722 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.442874 15650 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:31.443820 15575 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:31.444154 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:31.444981 16982 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:31.445444 16982 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:31.446316 16982 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:31.448833 15722 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:31.457592 15474 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.474372 16982 raft_consensus.cc:993] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:31.474864 16982 raft_consensus.cc:1081] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:31.476475 15722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:31.476994 15722 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.477326 15722 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.483850 15722 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.486469 16956 raft_consensus.cc:993] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:31.486980 16956 raft_consensus.cc:1081] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:31.486923 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:31.487149 15722 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:31.487583 15575 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.487902 15575 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:31.488595 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:31.489163 16278 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.489391 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:06:31.489856 16276 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.490150 16276 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.497486 16278 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:31.499455 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:31.500237 16899 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.500738 16899 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:31.501653 16899 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.488626 15575 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.502661 16278 raft_consensus.cc:1217] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:31.510221 16789 raft_consensus.cc:993] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:31.510619 16789 raft_consensus.cc:1081] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:31.511914 15575 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.514525 15728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:31.515113 15728 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:31.515455 15728 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.521793 16276 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.538429 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:31.538923 16276 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:31.539047 15572 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.555980 15728 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.558080 15728 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:31.559051 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:31.559661 16278 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.536172 15575 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:31.567415 15473 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.572347 16278 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:31.573555 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:31.571992 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:31.574542 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:31.574791 17020 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.575194 15651 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.575361 17020 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:31.575551 15651 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:31.576480 15651 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.576802 17020 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.577841 15651 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.574604 15648 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:31.583168 15648 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:31.585937 15651 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:31.586383 15648 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.587846 15648 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.597078 15572 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:31.598359 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:31.599905 15648 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:31.601257 17029 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:31.602375 17029 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:31.603233 17029 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.604791 15473 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.619328 15473 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:31.798832 17020 raft_consensus.cc:1064] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:31.800941 17020 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.813476 16278 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.813675 15651 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.815361 16987 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.819080 16987 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.834067 16944 raft_consensus.cc:1064] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:31.836629 16944 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.841485 15578 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:31.843595 16988 raft_consensus.cc:1064] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:31.846300 15728 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:31.846189 16988 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:31.847975 16981 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.856891 17020 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:31.868356 16276 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:31.869444 15729 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:31.870704 15651 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:31.869901 16988 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:31.880638 16981 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:31.889007 16982 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:31.934224 15648 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:06:31.956139 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48159.1us
I20260709 13:06:31.943635 16987 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:06:31.973922 15578 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:31.977568 16278 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:32.014671 16278 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:31.942603 16899 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.020778 17020 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:32.029793 15474 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.048465 15572 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:32.075562 17053 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:32.077279 15572 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.083271 15650 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.086222 17053 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.087041 16987 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.100448 16278 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.101562 17026 raft_consensus.cc:1064] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:32.107337 17026 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:32.115221 16277 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.116545 17053 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.119782 16277 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.118091 15651 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.131620 16899 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:32.143913 15572 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.155190 15648 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:32.160321 15648 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.182018 15650 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.181962 17029 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:32.186830 17054 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:32.193011 15729 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:32.206739 15578 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.208331 17029 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.213528 16277 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:32.203197 15473 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.214823 15578 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:32.215514 17056 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:06:32.242488 16988 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:32.253773 17067 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:06:32.264786 16981 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.285409 15729 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:32.292150 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.294219 15723 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:32.297482 16956 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:32.298660 16277 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:32.304140 16996 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:32.262223 17056 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:06:32.322322 16274 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.321050 17053 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.328750 15650 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.334474 16274 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.335294 15729 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.339607 16899 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.376835 15578 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:32.370011 16987 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:32.370241 16276 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.433738 15472 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.437386 17050 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.442287 16789 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:32.440703 16272 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.489657 15573 raft_consensus.cc:2955] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.493366 15650 raft_consensus.cc:2955] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.502205 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 233f2755fc484e7fb202702622c7b652 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:32.503391 15655 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.524384 15472 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:32.575395 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44985us
W20260709 13:06:32.577421 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 49765.2us
I20260709 13:06:32.575454 15474 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 4 to 5, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.618714 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab663998de28482d8438f0c594104dd5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:06:32.653429 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 197216us
I20260709 13:06:32.658555 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 233f2755fc484e7fb202702622c7b652 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
W20260709 13:06:32.674935 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 79955.2us
W20260709 13:06:32.676524 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 222374us
I20260709 13:06:32.717280 16789 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.736863 15729 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.723245 16272 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.804648 17089 tablet_replica.cc:333] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:32.823650 15572 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.855899 17089 raft_consensus.cc:2243] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:32.854730 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 265896us
I20260709 13:06:32.860908 17089 raft_consensus.cc:2272] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.867566 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.893756 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet ab663998de28482d8438f0c594104dd5 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:32.899502 15473 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.922958 17092 tablet_replica.cc:333] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:32.924707 17092 raft_consensus.cc:2243] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.929499 17092 raft_consensus.cc:2272] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.936980 15573 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:32.939278 17089 ts_tablet_manager.cc:1916] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:32.945466 16277 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.946475 17092 ts_tablet_manager.cc:1916] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:32.947535 17048 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:32.954469 15650 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:32.956229 17083 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:32.967756 15655 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.973539 16277 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:06:32.982442 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 81326.5us
I20260709 13:06:32.992326 17048 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:32.996086 16278 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:33.000162 17092 ts_tablet_manager.cc:1929] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:33.005810 17092 log.cc:1199] T ab663998de28482d8438f0c594104dd5 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/ab663998de28482d8438f0c594104dd5
I20260709 13:06:33.009490 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet ab663998de28482d8438f0c594104dd5 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:33.010470 16956 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:33.013358 15655 raft_consensus.cc:2955] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.030370 17089 ts_tablet_manager.cc:1929] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:33.035772 16996 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.044682 17089 log.cc:1199] T 233f2755fc484e7fb202702622c7b652 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/233f2755fc484e7fb202702622c7b652
I20260709 13:06:33.039541 15472 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 4 to 5, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.041121 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83d7922f778044c7b5600f9d4024c1b5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:33.046833 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 233f2755fc484e7fb202702622c7b652 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:33.042299 16278 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.056048 15729 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:33.057842 17090 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:33.063073 15729 raft_consensus.cc:2955] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.076617 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e1128bef1224facb3c1a31e94fb0379 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:33.086411 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 83d7922f778044c7b5600f9d4024c1b5 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:33.096779 15476 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:33.126338 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1128bef1224facb3c1a31e94fb0379 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:33.127776 17092 tablet_replica.cc:333] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:33.135878 17093 tablet_replica.cc:333] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:33.138928 17093 raft_consensus.cc:2243] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.139704 17093 raft_consensus.cc:2272] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.140833 17092 raft_consensus.cc:2243] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.141670 17092 raft_consensus.cc:2272] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.143627 17093 ts_tablet_manager.cc:1916] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:33.152398 17092 ts_tablet_manager.cc:1916] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:33.158730 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:33.159361 15729 raft_consensus.cc:606] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:33.161875 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:33.162411 15573 raft_consensus.cc:606] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:33.169366 15726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:33.169921 15726 raft_consensus.cc:606] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:33.171074 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:33.172254 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:33.170451 17093 ts_tablet_manager.cc:1929] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:33.172451 17092 ts_tablet_manager.cc:1929] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:33.172940 17093 log.cc:1199] T 83d7922f778044c7b5600f9d4024c1b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/83d7922f778044c7b5600f9d4024c1b5
I20260709 13:06:33.173049 17092 log.cc:1199] T 9e1128bef1224facb3c1a31e94fb0379 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/9e1128bef1224facb3c1a31e94fb0379
I20260709 13:06:33.175115 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet 9e1128bef1224facb3c1a31e94fb0379 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:33.176192 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 83d7922f778044c7b5600f9d4024c1b5 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:33.395130 17054 raft_consensus.cc:993] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:33.395620 17056 raft_consensus.cc:1081] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:33.397347 15649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:33.397889 15649 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:33.398250 15649 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.405869 15649 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.407650 15649 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:33.409075 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:33.409662 15572 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.414407 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:33.414954 15729 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.415257 15729 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:33.415957 15572 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:33.415895 15729 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.417083 15729 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.417120 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:33.417951 16789 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.418395 16789 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:33.419091 16789 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.422351 15729 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:33.428689 15473 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.493185 17083 raft_consensus.cc:993] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:33.493697 16988 raft_consensus.cc:1081] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:33.495112 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:06:33.495523 15729 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:33.495746 15729 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.500147 15729 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.501572 15729 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:33.502297 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:33.502645 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:33.502949 15572 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.503201 15649 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.503324 15572 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:33.504185 15572 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.505282 15572 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.508260 15649 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:33.509315 15693 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:33.510097 17056 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.510599 17056 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:33.510314 15572 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:33.511435 17056 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:33.521526 15473 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.527462 17054 raft_consensus.cc:993] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:33.528012 17056 raft_consensus.cc:1081] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:33.529459 16278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:33.529989 16278 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:33.530331 16278 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.535529 16278 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:33.537166 16278 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:33.538002 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:33.538656 15572 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.539382 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:33.539863 15729 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.540109 15729 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:33.540709 15729 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:33.541563 15729 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.544274 15572 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:33.545308 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:33.545979 17081 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.546473 17081 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:33.546779 15729 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:33.547283 17081 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:33.555671 15473 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 3 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.813535 15729 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:33.814812 16789 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:33.823844 15578 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:33.825186 16789 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:33.981519 15722 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:33.982797 17081 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.985721 15649 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:33.987133 17056 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.004841 15578 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:34.009692 15578 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.018422 17054 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.020357 17060 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:34.173151 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.193647 15722 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.210512 15572 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:34.213101 15692 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9aaafafa2c8f482d8b66bb15c3b1b088. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.213869 17054 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.210613 15649 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.215853 17056 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:34.231354 17054 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.232640 15649 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.237303 15572 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.249398 15578 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.254679 15476 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:34.262733 15543 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9377274f9c9482a924840f15b616a13. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.263904 15722 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.264294 15649 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.265341 17084 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.268093 17084 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.280429 17084 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.285322 15649 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.287614 15729 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.303114 15722 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.303716 15473 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
W20260709 13:06:34.325073 15692 consensus_peers.cc:597] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd80b5819c634a02a3dd8e2d112db507. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.327153 15649 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.327667 15578 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.328967 17054 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.329933 17120 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.337340 17110 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.339327 15655 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.343642 15578 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.357191 15473 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.366609 15572 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:34.378443 15543 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 836934bdc16146549eca0b7b8b6f3bbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:34.379374 15655 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.380779 17083 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.381429 15729 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:34.383102 17083 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.389770 16988 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.392979 15655 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.398087 15722 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:34.406399 15472 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.480931 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.534179 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:34.534718 15729 raft_consensus.cc:606] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:34.537511 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:34.538089 15655 raft_consensus.cc:606] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:34.539418 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:34.540658 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.615082 17120 raft_consensus.cc:993] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:34.615729 17110 raft_consensus.cc:1081] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:34.617328 15649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:34.617888 15649 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.618278 15649 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.623793 15649 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:34.626271 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:34.626886 15729 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.627580 15729 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:34.628537 15729 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:34.629608 15729 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.630422 15649 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:34.632313 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:34.632854 16278 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.637015 15729 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:34.638218 15619 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:34.638923 16996 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.639372 16996 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:34.640062 16996 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:34.643235 16278 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:34.651575 17127 ts_tablet_manager.cc:933] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:34.659885 17127 tablet_copy_client.cc:323] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:34.661461 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet f9377274f9c9482a924840f15b616a13 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:34.661123 15472 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.662007 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet f9377274f9c9482a924840f15b616a13 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-f9377274f9c9482a924840f15b616a13
I20260709 13:06:34.669436 15590 tablet_copy_source_session.cc:215] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:34.672236 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9377274f9c9482a924840f15b616a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.684492 17127 tablet_copy_client.cc:806] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:34.685089 17127 tablet_copy_client.cc:670] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:34.695077 17127 tablet_copy_client.cc:538] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.704648 17127 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:34.725165 17127 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.726114 17127 tablet_bootstrap.cc:492] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:34.726791 17127 ts_tablet_manager.cc:1403] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 13:06:34.729728 17127 raft_consensus.cc:359] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.730640 17127 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:34.731326 17127 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.733501 17127 ts_tablet_manager.cc:1434] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:34.735767 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-f9377274f9c9482a924840f15b616a13 received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:34.736160 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-f9377274f9c9482a924840f15b616a13 on tablet f9377274f9c9482a924840f15b616a13 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:34.776022 17127 ts_tablet_manager.cc:933] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:34.777742 17127 tablet_copy_client.cc:323] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:34.779251 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:34.779807 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet 9aaafafa2c8f482d8b66bb15c3b1b088 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-9aaafafa2c8f482d8b66bb15c3b1b088
I20260709 13:06:34.786907 15738 tablet_copy_source_session.cc:215] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:34.790241 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aaafafa2c8f482d8b66bb15c3b1b088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.804786 17127 tablet_copy_client.cc:806] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:34.805366 17127 tablet_copy_client.cc:670] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:34.813237 17127 tablet_copy_client.cc:538] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.822351 17127 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:34.846074 17127 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.847057 17127 tablet_bootstrap.cc:492] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:34.847769 17127 ts_tablet_manager.cc:1403] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 13:06:34.850613 17127 raft_consensus.cc:359] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.851419 17127 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:34.852049 17127 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.854539 17127 ts_tablet_manager.cc:1434] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:06:34.856395 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9aaafafa2c8f482d8b66bb15c3b1b088 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:34.856778 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-9aaafafa2c8f482d8b66bb15c3b1b088 on tablet 9aaafafa2c8f482d8b66bb15c3b1b088 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:34.885428 17127 ts_tablet_manager.cc:933] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:34.887228 17127 tablet_copy_client.cc:323] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:34.888741 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 836934bdc16146549eca0b7b8b6f3bbe from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:34.889190 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 836934bdc16146549eca0b7b8b6f3bbe from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-836934bdc16146549eca0b7b8b6f3bbe
I20260709 13:06:34.893711 15590 tablet_copy_source_session.cc:215] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:34.896178 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836934bdc16146549eca0b7b8b6f3bbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.908699 17127 tablet_copy_client.cc:806] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:34.909304 17127 tablet_copy_client.cc:670] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:34.909624 17134 ts_tablet_manager.cc:933] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:34.912698 17134 tablet_copy_client.cc:323] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:34.913184 17127 tablet_copy_client.cc:538] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.918259 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet dd80b5819c634a02a3dd8e2d112db507 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:34.918922 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet dd80b5819c634a02a3dd8e2d112db507 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-dd80b5819c634a02a3dd8e2d112db507
I20260709 13:06:34.921411 17127 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:34.927016 15738 tablet_copy_source_session.cc:215] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:34.930632 17134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd80b5819c634a02a3dd8e2d112db507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.938318 17127 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.939060 17127 tablet_bootstrap.cc:492] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:34.939569 17127 ts_tablet_manager.cc:1403] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 13:06:34.941612 17127 raft_consensus.cc:359] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.942257 17127 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:34.942728 17127 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:34.948383 17134 tablet_copy_client.cc:806] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:34.949105 17134 tablet_copy_client.cc:670] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:34.955444 17127 ts_tablet_manager.cc:1434] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:06:34.957700 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-836934bdc16146549eca0b7b8b6f3bbe received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:34.958135 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-836934bdc16146549eca0b7b8b6f3bbe on tablet 836934bdc16146549eca0b7b8b6f3bbe with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:34.959095 17134 tablet_copy_client.cc:538] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.974042 17134 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:35.049661 17134 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:35.050980 17134 tablet_bootstrap.cc:492] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:35.051837 17134 ts_tablet_manager.cc:1403] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.078s	user 0.025s	sys 0.008s
I20260709 13:06:35.065477 17134 raft_consensus.cc:359] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:35.066483 17134 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:35.067238 17134 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:35.069720 16996 raft_consensus.cc:993] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:35.078799 17140 raft_consensus.cc:1081] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:35.081367 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:35.081944 15729 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.082355 15729 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.086385 17134 ts_tablet_manager.cc:1434] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:06:35.088339 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-dd80b5819c634a02a3dd8e2d112db507 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:35.088764 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-dd80b5819c634a02a3dd8e2d112db507 on tablet dd80b5819c634a02a3dd8e2d112db507 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:35.097810 15729 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.101073 15729 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:35.102532 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:35.103159 15649 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:35.103434 15649 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:35.104154 15649 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.105362 15649 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.112968 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:35.113865 16277 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.115490 16278 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:35.117985 16789 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.118774 15729 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:35.120359 16789 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.180140 15649 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:35.181577 15693 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:35.182363 17110 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:35.182813 16277 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:35.182855 17110 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:35.184974 17110 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.205120 16277 raft_consensus.cc:1217] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:35.223644 15476 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.238839 16277 raft_consensus.cc:1217] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:35.373925 16277 raft_consensus.cc:1217] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:35.458685 16277 raft_consensus.cc:1217] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:35.541481 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.573037 17120 raft_consensus.cc:1064] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:35.577293 17120 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.578620 15649 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:35.581743 17138 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.599198 16278 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.599403 15655 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.601208 17138 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.603067 17138 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.607316 15578 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.611594 17138 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.657542 17138 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.662912 15578 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.673373 16278 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.682945 15472 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.693286 15650 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.713388 16278 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:35.714910 17139 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.718978 15729 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.724462 16277 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.726400 17139 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.728129 15578 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:35.729544 17139 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:35.737782 17110 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.739675 15578 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.743721 16272 raft_consensus.cc:2955] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.754736 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:35.771311 15474 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.783885 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aaafafa2c8f482d8b66bb15c3b1b088 with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:35.788029 17147 raft_consensus.cc:1064] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:35.796166 17163 tablet_replica.cc:333] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:35.797230 17163 raft_consensus.cc:2243] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:35.797997 17163 raft_consensus.cc:2272] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:35.803912 17147 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.813246 17163 ts_tablet_manager.cc:1916] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:35.825596 17155 raft_consensus.cc:1064] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:35.828397 17155 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.832371 16277 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.833849 17084 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.836496 15729 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.841842 17147 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.837958 15655 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.846483 17147 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.858987 15649 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.863054 17147 raft_consensus.cc:1064] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:35.864737 15572 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.866647 16278 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.866371 17147 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:35.868224 17155 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:35.880798 17138 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.898203 17110 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:35.902181 17163 ts_tablet_manager.cc:1929] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:35.909943 17163 log.cc:1199] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/9aaafafa2c8f482d8b66bb15c3b1b088
I20260709 13:06:35.914613 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 9aaafafa2c8f482d8b66bb15c3b1b088 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:35.918393 16277 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:35.921541 17126 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.924541 17126 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.927774 15655 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:06:35.942576 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64993.9us
I20260709 13:06:35.959628 15729 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.964010 15473 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:35.987604 15726 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:36.011382 17178 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.033681 16272 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.058526 17155 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.074476 15649 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.091089 15655 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:36.095299 17175 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.099798 17126 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.104460 16272 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.105755 15473 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.115679 15650 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.128963 15578 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.132753 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.139602 15726 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.131242 15474 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.171386 16277 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.206363 15722 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.211606 15572 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.217916 15649 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.216938 15578 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.220408 17170 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.223271 15650 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.223634 16278 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.223634 16272 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.226765 17176 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.228744 17176 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.233325 17170 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.233937 15722 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.234941 17175 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.241905 17147 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:36.243968 16276 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.246235 16277 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:36.247984 17147 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.248740 15650 raft_consensus.cc:2955] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.249291 15649 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.256625 17120 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.257835 17126 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.262871 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9377274f9c9482a924840f15b616a13 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:36.263530 15722 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.272075 15476 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.273988 16275 raft_consensus.cc:2955] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.288187 16278 raft_consensus.cc:2955] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.299692 15473 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 3 to 4, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.302109 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet f9377274f9c9482a924840f15b616a13 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48742
I20260709 13:06:36.314917 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 836934bdc16146549eca0b7b8b6f3bbe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:36.313171 15472 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 3 to 4, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:06:36.332302 15561 tablet_service.cc:1558] Processing DeleteTablet for tablet dd80b5819c634a02a3dd8e2d112db507 with delete_type TABLET_DATA_TOMBSTONED (TS 8995ef9978c446769377fc0e9a0cb9c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54000
I20260709 13:06:36.343357 17188 tablet_replica.cc:333] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:06:36.344074 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 836934bdc16146549eca0b7b8b6f3bbe with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58900
I20260709 13:06:36.341902 17189 tablet_replica.cc:333] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:06:36.344944 17163 tablet_replica.cc:333] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:06:36.345923 17163 raft_consensus.cc:2243] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.346788 17163 raft_consensus.cc:2272] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.348184 17189 raft_consensus.cc:2243] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.349728 17189 raft_consensus.cc:2272] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.348941 17188 raft_consensus.cc:2243] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:36.354254 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd80b5819c634a02a3dd8e2d112db507 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:36.357146 17189 ts_tablet_manager.cc:1916] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:36.357963 17188 raft_consensus.cc:2272] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:36.361294 17188 ts_tablet_manager.cc:1916] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:36.354287 17163 ts_tablet_manager.cc:1916] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:36.381351 17188 ts_tablet_manager.cc:1929] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.381943 17188 log.cc:1199] T f9377274f9c9482a924840f15b616a13 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/f9377274f9c9482a924840f15b616a13
I20260709 13:06:36.383200 17189 ts_tablet_manager.cc:1929] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.383601 17189 log.cc:1199] T dd80b5819c634a02a3dd8e2d112db507 P 8995ef9978c446769377fc0e9a0cb9c1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/wals/dd80b5819c634a02a3dd8e2d112db507
I20260709 13:06:36.385197 15462 catalog_manager.cc:5028] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): tablet dd80b5819c634a02a3dd8e2d112db507 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:36.385272 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet f9377274f9c9482a924840f15b616a13 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:36.395685 15648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:06:36.396253 15648 raft_consensus.cc:606] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:36.399436 15726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:36.400038 15726 raft_consensus.cc:606] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:36.401993 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:36.402343 17187 raft_consensus.cc:993] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:36.402853 17141 raft_consensus.cc:1081] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:06:36.404069 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:36.404361 15726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:06:36.407732 15726 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.408123 15726 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.408885 17163 ts_tablet_manager.cc:1929] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:36.409389 17163 log.cc:1199] T 836934bdc16146549eca0b7b8b6f3bbe P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/836934bdc16146549eca0b7b8b6f3bbe
I20260709 13:06:36.411038 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 836934bdc16146549eca0b7b8b6f3bbe (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:06:36.413321 15726 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.415180 15726 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:36.415632 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:36.416172 15649 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.416388 15649 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:36.416419 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:36.416853 16278 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.416980 15649 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.417882 15649 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.421193 16278 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:36.421834 15649 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:36.422317 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:36.423023 17120 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.423478 17120 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:36.424302 17120 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.434986 15472 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 4, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 4 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.553670 17186 raft_consensus.cc:993] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:36.554373 17186 raft_consensus.cc:1081] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:06:36.556049 16278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:06:36.556562 16278 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:36.556938 16278 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.561367 16278 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.562857 16278 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:36.564056 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:36.564119 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:36.565029 15726 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:36.565393 15572 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.565488 15726 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:36.566530 15726 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.567975 15726 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.572841 15572 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:36.574162 16235 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:36.574265 15726 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:36.575052 17106 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.575659 17106 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:36.577183 17106 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:36.587340 15472 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 3 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.885603 16276 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:36.887073 17120 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.900715 15648 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:36.902432 17120 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:36.996414 15578 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:36.997839 17106 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.008014 15722 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:37.009469 17106 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.408108 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.424851 15578 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:37.435820 15543 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 554babfb4498479a98f58801621b0dac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.442750 15649 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:37.444819 17175 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.447256 15726 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:37.451260 17175 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:37.475980 17126 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.477437 15722 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.484109 15649 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.501816 15722 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:37.501665 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 5, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.529284 15649 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.532910 17204 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:37.534865 15692 consensus_peers.cc:597] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3f2e1d93d5244bb997f6e208e9bbc20. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.543403 15578 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.547068 17203 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:37.559940 17120 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.561916 15649 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.581995 15572 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.582499 15474 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.589929 15578 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:37.600108 15722 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:37.601415 15543 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 361bd26d633f474ba34078d9cf76f22f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.601975 17202 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:37.608438 15649 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.610399 17202 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:37.613405 17126 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.615206 15722 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.620316 15649 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.628285 15650 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:37.633543 15474 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.657882 15722 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:37.661121 17140 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:37.661926 15578 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:37.662599 15618 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d5d462c9e4427f934553b90818efd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.664687 17187 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:37.687265 17140 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.689214 15578 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.690686 15722 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.713236 15472 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 1 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:06:37.899369 17222 ts_tablet_manager.cc:933] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:37.901309 17222 tablet_copy_client.cc:323] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:37.903103 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 554babfb4498479a98f58801621b0dac from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:37.903584 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 554babfb4498479a98f58801621b0dac from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-554babfb4498479a98f58801621b0dac
I20260709 13:06:37.910620 15590 tablet_copy_source_session.cc:215] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.913539 17224 ts_tablet_manager.cc:933] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:37.916661 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554babfb4498479a98f58801621b0dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.918864 17224 tablet_copy_client.cc:323] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:06:37.920955 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet f3f2e1d93d5244bb997f6e208e9bbc20 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:06:37.921523 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet f3f2e1d93d5244bb997f6e208e9bbc20 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-f3f2e1d93d5244bb997f6e208e9bbc20
I20260709 13:06:37.930161 15738 tablet_copy_source_session.cc:215] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.935344 17224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f2e1d93d5244bb997f6e208e9bbc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.943425 17222 tablet_copy_client.cc:806] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.944180 17222 tablet_copy_client.cc:670] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.948974 17222 tablet_copy_client.cc:538] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.955163 17224 tablet_copy_client.cc:806] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.955917 17224 tablet_copy_client.cc:670] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.957603 17222 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:37.962409 17224 tablet_copy_client.cc:538] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.975383 17224 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:38.006148 17222 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.008073 17222 tablet_bootstrap.cc:492] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:38.013679 17222 ts_tablet_manager.cc:1403] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.056s	user 0.029s	sys 0.010s
I20260709 13:06:38.017903 17222 raft_consensus.cc:359] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.019467 17222 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:38.020218 17222 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.023037 17222 ts_tablet_manager.cc:1434] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:06:38.025359 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-554babfb4498479a98f58801621b0dac received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:38.025811 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-554babfb4498479a98f58801621b0dac on tablet 554babfb4498479a98f58801621b0dac with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:38.026643 17224 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.027937 17224 tablet_bootstrap.cc:492] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:38.028707 17224 ts_tablet_manager.cc:1403] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.009s
I20260709 13:06:38.031848 17224 raft_consensus.cc:359] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.032680 17224 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:38.033321 17224 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.035991 17224 ts_tablet_manager.cc:1434] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:06:38.036299 17222 ts_tablet_manager.cc:933] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:38.037585 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-f3f2e1d93d5244bb997f6e208e9bbc20 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:06:38.038061 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-f3f2e1d93d5244bb997f6e208e9bbc20 on tablet f3f2e1d93d5244bb997f6e208e9bbc20 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:38.059320 17222 tablet_copy_client.cc:323] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.129:45045
I20260709 13:06:38.061785 15590 tablet_copy_service.cc:140] P 8995ef9978c446769377fc0e9a0cb9c1: Received BeginTabletCopySession request for tablet 361bd26d633f474ba34078d9cf76f22f from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:35226)
I20260709 13:06:38.062322 15590 tablet_copy_service.cc:161] P 8995ef9978c446769377fc0e9a0cb9c1: Beginning new tablet copy session on tablet 361bd26d633f474ba34078d9cf76f22f from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:35226: session id = 681370bcf39d46b189ec8e9a5957f93d-361bd26d633f474ba34078d9cf76f22f
I20260709 13:06:38.069537 15590 tablet_copy_source_session.cc:215] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:38.072980 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361bd26d633f474ba34078d9cf76f22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:38.091950 17222 tablet_copy_client.cc:806] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:38.092842 17222 tablet_copy_client.cc:670] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:38.098788 17222 tablet_copy_client.cc:538] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:38.106182 17222 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:38.124816 17222 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.125753 17222 tablet_bootstrap.cc:492] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:38.126571 17222 ts_tablet_manager.cc:1403] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.021s	user 0.023s	sys 0.000s
I20260709 13:06:38.129171 17222 raft_consensus.cc:359] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.129796 17222 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:38.130336 17222 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:38.132743 17222 ts_tablet_manager.cc:1434] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:38.134656 15590 tablet_copy_service.cc:342] P 8995ef9978c446769377fc0e9a0cb9c1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-361bd26d633f474ba34078d9cf76f22f received from {username='slave'} at 127.0.0.1:35226
I20260709 13:06:38.135046 15590 tablet_copy_service.cc:434] P 8995ef9978c446769377fc0e9a0cb9c1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-361bd26d633f474ba34078d9cf76f22f on tablet 361bd26d633f474ba34078d9cf76f22f with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:38.494320 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:39.010452 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.005s	sys 0.004s
W20260709 13:06:39.011108 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.005s	sys 0.005s
I20260709 13:06:39.405789 17239 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.406839 17239 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.439165 17242 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.491395 17237 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.492240 17237 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.499205 17237 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.519971 17243 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.520926 17243 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.524051 17243 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.411407 17239 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.440112 17242 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.564222 17242 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.555919 17237 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.585664 17237 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.587819 17237 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.588295 17237 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.588745 17237 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.558693 17236 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.590440 17236 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:39.592638 17236 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.593864 17236 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.594429 17236 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:39.568459 15620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.006s	sys 0.005s
I20260709 13:06:39.570603 17246 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:39.595338 15620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.008s	sys 0.005s
I20260709 13:06:39.595649 17246 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.598875 17246 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.577073 17247 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.601465 17247 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.604488 17247 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.605124 17234 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.605222 17247 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.578758 17249 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.605772 17235 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.605707 17234 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.606384 17235 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.606245 17249 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.608311 17234 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.608433 17235 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.609277 17249 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.610117 17237 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.580014 17250 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.583281 17244 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.555266 17241 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:39.573426 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.001s
W20260709 13:06:39.612463 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.005s	sys 0.001s
I20260709 13:06:39.611999 17244 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.609985 17249 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.612097 17241 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.614264 17247 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:39.615222 17240 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.615749 17240 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.617204 17247 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.617535 17241 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.614756 17244 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.611958 17250 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.613855 17249 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.619187 17236 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.619907 17250 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.620189 17240 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.620741 17249 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.620790 17240 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.621871 17240 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.624958 17235 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.627419 17250 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.627969 17235 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.628084 17250 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:39.624552 17240 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.625864 17234 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.677377 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.678337 17239 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.678956 17235 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.679531 17235 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.679117 17239 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.680065 17235 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.681705 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.682379 15729 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:39.657655 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.683769 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.684219 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.684803 15729 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.685349 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.685974 15728 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:39.658488 17250 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.659006 17247 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.644966 17236 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.689716 17242 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.657900 17245 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.689785 17236 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.690446 17242 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.690925 17239 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.657652 17256 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.692015 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.673807 17240 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.693099 17234 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.696471 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.697255 17236 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.695290 17243 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.698634 17234 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.698976 17235 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.699445 17230 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.698946 17243 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.690582 17245 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.702596 17242 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.702967 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.703696 17258 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.704672 17254 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.706166 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.706856 15726 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.706959 17259 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.699976 17230 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.704921 17243 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.709115 17247 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.705703 17254 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.712107 17247 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.713088 17254 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.714704 17230 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.714865 17249 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.708353 17256 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.718926 17242 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.704263 17258 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.720567 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.720109 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.728762 17256 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.723692 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.707646 17259 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.717535 17254 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.720331 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.727502 15655 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:39.722738 17243 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.728195 15650 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
W20260709 13:06:39.736753 15621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.005s	sys 0.009s
I20260709 13:06:39.736905 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.737252 17257 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.737064 17243 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.728685 17239 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.728613 17242 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.729676 17247 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.741612 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.742306 17243 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.742622 17242 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.726004 17249 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.742894 17239 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.732407 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.695859 17240 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.747192 15652 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.744740 17247 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.748535 17249 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.748852 17240 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.737815 17257 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.733846 17259 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.750737 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.751085 17257 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.751545 15722 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.734156 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.752671 17247 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:39.737114 15621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.005s	sys 0.009s
I20260709 13:06:39.738642 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.739282 17230 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.753813 17256 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.754312 17230 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.754436 17256 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.739745 17254 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.741632 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.744081 15575 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:39.752765 15726 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:39.729692 15647 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:39.745927 17258 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.746763 17239 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.709295 17245 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.759559 17234 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.759563 17236 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.764678 17251 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.761281 17236 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.761133 17234 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.757591 17256 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.756533 17243 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.771319 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.773205 17254 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.773231 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.774178 15728 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:39.775326 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.775627 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.775957 15728 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.776165 15726 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:39.776584 17234 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.765726 17258 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.782848 17235 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.785205 17252 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.769928 17256 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.785815 17252 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.788780 17250 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.765275 17251 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:39.771234 17243 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:39.790056 17250 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.793982 17253 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.795723 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:39.796538 15729 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:39.788997 17235 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:39.792608 17249 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:39.788770 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48171.6us
I20260709 13:06:39.801285 17250 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.801911 17248 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.808341 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.808940 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.810643 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.812502 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.813295 17242 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.813912 17242 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:39.814463 17242 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.815613 17243 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.816856 17243 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.817306 17243 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:39.818288 15694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.333s	user 0.005s	sys 0.014s
W20260709 13:06:39.818751 15694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.006s	sys 0.014s
I20260709 13:06:39.819736 17235 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.822052 17251 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:39.823182 17236 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:39.813623 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.794711 17253 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.817757 17243 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.802663 17248 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.787508 17258 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.801323 17249 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.793462 17256 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.841840 17252 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.843500 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.844208 15576 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:39.850697 16235 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.855855 17256 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.857036 17248 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:39.857146 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.412s	user 0.004s	sys 0.004s
W20260709 13:06:39.862514 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.417s	user 0.005s	sys 0.004s
I20260709 13:06:39.858948 17253 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.832333 17230 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:39.870520 16237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.556s	user 0.005s	sys 0.021s
W20260709 13:06:39.879995 16237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.570s	user 0.006s	sys 0.022s
I20260709 13:06:39.874446 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.877576 17243 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.879117 17258 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:39.887382 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.440s	user 0.006s	sys 0.010s
W20260709 13:06:39.890012 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.006s	sys 0.010s
I20260709 13:06:39.891215 17183 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:39.895748 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 82218.8us
I20260709 13:06:39.902477 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.889015 17235 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.913820 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:39.926991 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:39.899653 17248 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.904019 17256 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.931902 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.932073 17256 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.083321 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.131012 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:39.981957 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55025.9us
I20260709 13:06:40.153456 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.133177 17268 ts_tablet_manager.cc:933] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.154151 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.092629 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.933563 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.078655 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:39.911363 17183 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.913025 17260 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:39.931788 17261 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.156570 15729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:06:39.926586 17245 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:40.236030 16238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.642s	user 0.006s	sys 0.009s
I20260709 13:06:39.934284 17255 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:39.971266 17246 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.292484 17246 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.286700 15653 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:40.289392 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.290941 17245 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.291108 17231 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:40.291325 16238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.050s	user 0.012s	sys 0.013s
I20260709 13:06:39.971313 17263 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.278479 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.314380 15576 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:39.964370 17251 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.979290 17238 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.151499 17256 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.996690 17241 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.180285 17236 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.083455 17249 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:39.996464 17262 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.261008 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.312538 17245 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.253753 17243 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.313275 17269 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.256145 17266 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.250844 17267 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.218557 17265 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.218451 17240 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.230551 17237 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.218516 17232 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.095167 17242 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.290352 17183 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.323661 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.318753 17263 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.292326 17255 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.331161 17269 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.346271 15650 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:40.325196 17236 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.326308 17251 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.324522 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.330189 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.320734 17241 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.325215 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.179800 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.332257 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.256301 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.095329 17230 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.326915 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.354858 17241 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.345358 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.344942 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.366618 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.151825 17248 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:39.961254 17257 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.354523 15578 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.336169 17266 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.095494 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.349064 17267 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.284798 17261 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:39.938040 17259 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:40.367676 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 187962us
I20260709 13:06:39.929152 17235 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:40.376886 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.382800 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.338533 17240 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.385027 15654 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:40.370071 17243 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.369159 17248 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.326397 17231 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.348490 17237 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.409165 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.357097 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.331774 17262 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.327181 17238 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.411051 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.370273 17266 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.090008 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.349185 17265 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.348194 17232 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.408389 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.371014 17230 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.372574 17257 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.348716 17260 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.356890 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.539551 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.539768 16276 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:40.538841 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.427834 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.543107 15649 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
W20260709 13:06:40.543326 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 132351us
I20260709 13:06:40.544409 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.413858 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.547309 17236 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.547549 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.548022 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.548801 17242 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.483660 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.554386 17235 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.554983 15571 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:40.556488 17257 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.412463 17249 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.558048 16274 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:40.558133 17249 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.558636 17249 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.474479 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.561265 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.562280 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.562443 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.520380 17268 tablet_copy_client.cc:323] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.130:44871
I20260709 13:06:40.562891 16272 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:40.550495 15654 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:40.562460 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.564520 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.564822 15655 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:40.541690 17232 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.395231 17243 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.566123 17243 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.566730 15729 raft_consensus.cc:606] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:40.571393 17249 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.565882 17183 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.573704 16278 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.574150 17249 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.386039 17259 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:40.588857 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44537.4us
I20260709 13:06:40.588541 17235 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.618280 17260 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.539073 17256 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.550658 17254 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.576309 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.593876 17249 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.524266 17267 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.619222 17237 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.545661 17255 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.683082 17243 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.688973 15573 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:40.691763 17243 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.694325 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.691979 17245 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.695497 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:40.659628 17265 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.696760 17262 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.663313 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.627450 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.685032 15577 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.662549 17261 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.663667 17240 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.685632 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.622990 17269 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.686278 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.686331 17249 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.686297 15693 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:40.669016 17231 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.635988 17246 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.703905 15652 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:40.600035 17235 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:40.687954 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 92626us
I20260709 13:06:40.685680 17230 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.669462 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.705997 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.620807 17241 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.707422 17235 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.708555 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:40.708719 17241 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:40.575110 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed020 after lost signal to thread 14477
W20260709 13:06:40.710044 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed700 after lost signal to thread 15512
I20260709 13:06:40.710916 17238 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.697115 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.628407 17256 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:40.700508 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 73154.7us
I20260709 13:06:40.711814 15648 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:40.701259 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.685564 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.714334 17252 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.716262 17252 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.716646 17252 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.679394 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.624294 17254 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.717168 17254 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.717257 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.717552 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.717985 15574 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:40.701411 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.701627 17262 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.704094 17249 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.687301 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.706844 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.736037 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.736160 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:40.708861 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.696780 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:40.711194 16299 debug-util.cc:398] Leaking SignalData structure 0x7b0800164ba0 after lost signal to thread 15604
I20260709 13:06:40.659700 17251 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.716282 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.739346 15572 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:40.720996 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:40.740067 16299 debug-util.cc:398] Leaking SignalData structure 0x7b080032f6e0 after lost signal to thread 15679
I20260709 13:06:40.721094 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.740382 17249 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.721288 15580 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.722234 17263 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.741606 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.731273 17262 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:40.743176 17262 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.729240 17252 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.729573 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.750424 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.751060 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.751725 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.752291 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.752560 15579 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.742537 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.714444 17246 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.745584 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.753907 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.752349 16272 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:40.727067 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.755869 17236 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.755743 16271 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:40.756651 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.757376 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.732661 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:40.754397 17246 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.765996 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.767822 17259 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.758098 17245 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.764971 17271 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.765447 15646 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:40.768925 17244 raft_consensus.cc:993] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:40.769454 17244 raft_consensus.cc:1081] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:06:40.766242 17246 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.770145 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.764973 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.757812 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.774430 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.777195 17237 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.777653 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.778251 15726 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:40.778959 17265 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.779210 16235 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.779373 17265 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.779808 17265 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.780076 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.782598 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.785157 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.787673 17256 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.787714 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:40.789441 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 96368us
I20260709 13:06:40.792912 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.794780 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.794883 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:40.796026 15723 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.796147 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:40.796732 15728 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.797291 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:40.741618 16299 debug-util.cc:398] Leaking SignalData structure 0x7b0800226a60 after lost signal to thread 15753
I20260709 13:06:40.799250 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.802206 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.803316 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:40.803915 15724 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.804841 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:40.802439 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:40.808046 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.800762 17259 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.831213 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.797670 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.832376 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:40.845855 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.846720 15723 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:40.847018 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:40.847388 15722 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.785583 17246 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.834285 17242 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.837108 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.833904 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.838544 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.838696 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.839905 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:40.839213 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.840730 15724 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:40.843130 15664 tablet_copy_service.cc:140] P 680390d3f0884c91bf1f22ba914b438a: Received BeginTabletCopySession request for tablet 78d5d462c9e4427f934553b90818efd6 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:46002)
I20260709 13:06:40.843344 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.749720 17238 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:06:40.844316 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.848315 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:40.848304 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45931.2us
I20260709 13:06:40.849526 17241 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.849584 17278 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.850890 17243 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.851300 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:06:40.830843 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.852917 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.882481 15722 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:40.883114 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.883275 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.882892 17262 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.884207 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.849774 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.885645 17262 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:40.858047 15726 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:40.863154 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:40.887285 17235 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.887539 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:40.887666 17235 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.887687 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:40.888191 17235 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.888886 17256 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.863613 17241 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.866159 17276 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.858139 17242 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.869228 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.851689 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:40.866961 17243 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.866796 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.897208 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.863397 15727 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:40.870955 17273 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.871016 17183 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.871362 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:40.871893 16299 debug-util.cc:398] Leaking SignalData structure 0x7b0800336300 after lost signal to thread 16302
I20260709 13:06:40.874236 15664 tablet_copy_service.cc:161] P 680390d3f0884c91bf1f22ba914b438a: Beginning new tablet copy session on tablet 78d5d462c9e4427f934553b90818efd6 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:46002: session id = 681370bcf39d46b189ec8e9a5957f93d-78d5d462c9e4427f934553b90818efd6
I20260709 13:06:40.877089 17254 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.853372 17269 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.877786 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.856680 17261 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.878355 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:40.878625 17231 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:40.914162 17261 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.914752 17231 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:40.915087 17261 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.915683 17231 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.916878 17231 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.832657 17259 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.865270 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.889371 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.889249 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:40.894814 15728 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:40.919680 17259 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.895320 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:40.896138 16238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.012s
I20260709 13:06:40.868476 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:40.898320 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 187117us
I20260709 13:06:40.904011 17255 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.904765 17276 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.911100 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.889233 17256 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.897881 17241 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.909891 17273 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.897472 17243 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.897784 17242 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.921026 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:40.920809 16238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.012s
W20260709 13:06:40.921844 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 73807.2us
I20260709 13:06:40.924589 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.923821 17256 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.922490 17255 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.918783 17250 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.896610 17265 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.924902 15693 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:40.928715 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.929090 15693 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.929791 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.931401 17249 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.932118 17276 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:40.932960 17271 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.933131 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:40.933377 17271 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.933815 17271 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.934851 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:40.936167 17273 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.937484 17237 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.925859 17230 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.939944 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.940189 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:40.940727 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 89210.1us
I20260709 13:06:40.942561 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:40.941751 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:40.927416 17255 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.925978 15571 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.927603 15721 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.945374 17244 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.947649 17250 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.948002 17277 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.955482 17244 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.948453 17246 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.937915 17237 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.917667 17269 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.950138 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:40.951048 17243 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:40.951702 17265 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.934317 17236 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.944871 17245 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.943714 17263 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.945308 17183 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.911198 17266 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:40.946633 17253 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.981706 17183 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.966758 17240 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.967685 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.973500 17269 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.971156 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:40.963276 17244 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.970654 17237 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.984242 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.963541 17273 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:40.956821 17252 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:40.989652 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.974648 17249 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.992563 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:40.989194 17273 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:40.980546 17245 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:40.983764 17263 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:40.974189 17280 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:40.996273 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:40.994657 17269 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.994863 17230 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.994464 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:40.995330 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 97065us
I20260709 13:06:40.987824 17238 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.987715 17251 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.011399 17266 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.008581 17245 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.012012 17263 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.017138 17243 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:40.991813 17240 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.991719 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:41.021339 17231 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.994287 17249 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:41.022413 16276 raft_consensus.cc:1217] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:41.024950 17279 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:41.025602 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.026386 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.026990 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.028566 17256 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.043056 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.040665 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.042829 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.052457 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:41.082932 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:41.059417 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.059980 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.053731 17183 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:41.049209 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:41.078976 16278 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:41.086866 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.034718 17254 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.035035 17251 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.025463 17271 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.101480 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.049213 17261 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.071062 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.071390 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.035352 17242 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.033991 17241 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.035545 17280 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.044027 16270 raft_consensus.cc:1217] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:06:41.062336 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.061474 15664 tablet_copy_source_session.cc:215] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:41.088078 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.089011 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.089336 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:41.089453 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 134585us
W20260709 13:06:41.109423 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 166928us
I20260709 13:06:41.049723 17273 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.094635 17279 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.095320 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.095678 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.055851 17259 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.114909 17265 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:41.097865 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:41.098054 17282 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.098731 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.121178 15572 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.063961 17249 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.100899 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.103787 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.103812 16274 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:41.104373 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.078461 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.113444 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:41.114358 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.096308 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.127693 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.101653 17251 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.116046 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.130088 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:41.116537 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 181235us
I20260709 13:06:41.101459 17234 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.104948 17266 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:41.099637 17256 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.134984 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.119163 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.106984 17280 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:41.107909 17254 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:41.132997 17278 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:41.143923 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57131us
I20260709 13:06:41.136788 15693 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:41.146425 17267 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.146838 17267 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.147035 17261 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.147220 17267 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.147329 17271 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.134675 17232 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.132898 17234 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:41.150736 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.144093 17256 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.155500 17256 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.155910 17256 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.146430 17283 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.158367 17283 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.158751 17283 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.145903 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.138885 17254 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:41.181982 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50850us
I20260709 13:06:41.183643 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.184525 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:41.159956 17234 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.187799 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.190207 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.141431 17266 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.191608 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.192651 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.193658 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:41.187650 17248 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.005s
I20260709 13:06:41.180012 17265 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.185105 17259 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.186511 17252 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.187183 17241 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.189127 17243 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.198122 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.202708 17242 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.203279 17242 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.194607 15646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:06:41.204142 15646 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:41.204514 15646 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.194721 17246 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.197438 17265 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.211009 17287 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.198499 17252 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.201819 17243 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.198235 17248 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.209700 17286 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.213958 17236 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.230015 16277 raft_consensus.cc:1217] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:41.214951 17265 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.221060 17252 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.236750 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5d462c9e4427f934553b90818efd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.223692 17243 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.227408 17277 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.221992 17245 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.266767 17269 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:41.277838 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.278607 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 139796us
I20260709 13:06:41.202284 17280 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.284109 17266 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.267529 17259 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:41.317322 17284 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:41.277972 17281 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.322263 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.281754 17235 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.327466 17248 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.328348 17235 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.330224 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.331277 17281 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:41.333120 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.334432 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.321568 15580 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.337617 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.342674 17249 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.344434 17245 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.320480 17259 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.350965 16269 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:41.351653 17249 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.352016 17259 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:41.354600 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:41.352036 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.358338 16277 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:41.367671 17252 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.370905 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:41.373615 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.374837 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.374930 17269 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.375743 17259 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.376210 17249 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.344275 17255 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.378252 17255 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.378479 15543 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.379027 17252 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.380154 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.381093 17249 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.382207 17248 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.334729 17280 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.381446 17267 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:41.386746 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 193129us
I20260709 13:06:41.394325 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:41.390169 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 202418us
I20260709 13:06:41.319690 17256 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.336778 17254 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.318764 17287 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 13:06:41.396826 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 204233us
I20260709 13:06:41.397167 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.384956 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.398195 17236 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.400111 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.400872 17240 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.401965 15543 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.402936 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.404428 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.406406 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:41.407100 17263 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.410609 17263 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.412479 17244 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:41.413023 17287 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.413439 17287 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:41.414114 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.414450 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.403995 15544 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.415454 17255 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:41.414577 15572 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.417672 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.418229 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.416232 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.415491 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.412375 17249 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.407527 17238 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.425148 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.401217 17269 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.425966 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.430131 15576 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.430631 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.430886 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.431789 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.431983 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.407116 17248 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.407655 17245 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:41.407372 17183 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.434549 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.435984 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.438148 17275 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.438196 17272 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.439100 17272 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.441232 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.442895 17237 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.444516 17237 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.406584 15646 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.398911 17234 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.432188 15721 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.425814 17254 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.447291 17235 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:41.458969 17277 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.459316 17277 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:41.433966 17255 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.452256 15720 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.433570 15571 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.450618 17248 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:41.467306 17292 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:41.453912 17290 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.454375 15725 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.455515 17282 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.458091 17254 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:41.447784 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.436640 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.437053 17245 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:41.336247 17284 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.467710 17248 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.469726 17291 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.415565 17281 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.471870 17234 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:41.511567 15578 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.476737 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.429454 17265 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.481153 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.514937 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.484508 17254 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.464862 17255 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:41.517452 15579 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.487417 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.472433 17283 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.445369 17294 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:06:41.520964 17267 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.521286 17294 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.521729 17294 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:41.464017 17277 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.459759 17251 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:41.492841 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45973.3us
I20260709 13:06:41.481519 17282 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:41.509115 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.513059 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.484090 17245 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.516366 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.516486 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.516624 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.487793 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.485706 17235 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.488019 17244 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:41.496831 17292 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:41.522745 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.525841 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.534869 17284 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.522706 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.518515 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.526538 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:41.532711 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.519043 17255 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.479270 17246 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:06:41.547191 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 120980us
I20260709 13:06:41.550755 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.552346 17277 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.516438 17295 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:41.556512 15648 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.557163 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.537735 15646 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.558526 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:41.559991 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:41.538793 17256 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.566574 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:41.569461 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 137737us
I20260709 13:06:41.570688 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.572067 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:41.573156 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:41.574535 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.574644 17276 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.574586 17230 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.574167 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.574733 17240 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.577927 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.579726 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.566435 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.569804 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.578321 17270 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:41.568774 17295 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:41.578506 17240 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.581856 15655 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.581450 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:41.589601 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.572731 17260 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.582837 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:41.584614 15647 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.585038 17230 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.539197 17294 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.579480 17283 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.593842 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.594107 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.570101 17282 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.588147 17240 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:41.603000 17265 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.606000 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.607894 16278 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.609381 16275 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.610308 17282 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.610661 17243 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:41.715174 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.714825 17265 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:41.703250 17294 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.624883 17276 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:41.736886 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.727702 17243 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.742497 15723 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.736084 17235 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:41.750322 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.756713 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.733166 17265 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.735128 17240 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.744359 17276 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.841198 17302 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:41.826278 17279 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.842598 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.848026 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.848691 15725 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.849067 15725 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:41.840549 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.851590 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:41.857606 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.758505 17295 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.849998 15725 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.864190 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:41.865291 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 314915us
I20260709 13:06:41.867885 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.868889 17299 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.834678 17235 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.875240 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:41.888437 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.889273 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.868938 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.886519 15725 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.868656 15720 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.923473 17293 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.923976 17293 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:41.886559 17299 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.906996 17245 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.909116 17265 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.910522 17235 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:41.910392 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:41.959722 16278 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.912667 17287 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.915234 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:06:41.902487 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 157915us
I20260709 13:06:41.931954 17297 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.942016 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:41.924962 17293 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:41.887130 17252 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.897626 17270 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:41.971503 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 80782.5us
I20260709 13:06:41.975224 17302 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:41.937723 17255 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:41.975576 17297 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:41.975476 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:41.981771 17236 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.993036 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:41.993427 15572 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:41.992705 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 254086us
W20260709 13:06:42.012810 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.991101 17286 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:42.024673 17286 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.025142 17286 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:42.015368 17255 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:42.019814 17276 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:42.029788 17293 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.052814 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.022174 17245 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:42.058106 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:42.062403 15578 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.062618 15576 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.062561 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.066980 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.080323 17307 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.080533 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:42.081547 17280 consensus_meta.cc:287] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.697s	user 0.013s	sys 0.000s
I20260709 13:06:42.082178 17285 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:06:42.083122 15573 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.083214 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:42.038529 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:42.084913 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.044253 17282 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:06:42.037549 17286 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.093582 17280 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.099371 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:42.039184 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 1944) took 1001 ms. Trace:
W20260709 13:06:42.111831 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.028879 17297 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.088867 17307 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:42.107331 17306 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:06:42.114871 16278 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:42.114732 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:42.123096 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.029s	sys 0.019s
I20260709 13:06:42.097889 17280 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:42.124114 15722 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:42.117354 17297 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.141106 17305 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:42.127028 17286 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.144620 17300 raft_consensus.cc:1064] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:42.147794 17240 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.151051 17278 raft_consensus.cc:1064] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:42.151787 17291 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.119323 17306 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.119624 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.143788 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 250) took 1155 ms. Trace:
I20260709 13:06:42.154296 15580 rpcz_store.cc:276] 0709 13:06:40.982081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.982232 (+   151us) service_pool.cc:224] Handling call
0709 13:06:40.982550 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.337236 (+354686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.123908 (+786672us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400109854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:42.137825 (+ 13917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707953920}
I20260709 13:06:42.098505 17277 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:42.123028 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.124393 15725 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:42.153632 17306 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:42.155398 16272 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:42.113088 15721 rpcz_store.cc:276] 0709 13:06:41.037330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.037482 (+   152us) service_pool.cc:224] Handling call
0709 13:06:41.037829 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.465756 (+427927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.038917 (+573161us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400398854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:42.039122 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870288128}
I20260709 13:06:42.152160 17291 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:06:42.164094 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.164911 15619 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:42.154712 17278 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.161269 17276 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:42.174791 17269 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.167670 17277 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.175194 17269 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.175498 17277 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:42.176206 17269 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.176399 17277 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.177704 17269 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.155241 17280 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.186286 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:42.191365 17292 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.191797 17292 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:06:42.192003 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.196610 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.197084 17292 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.199014 17292 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.173292 17306 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.204383 17306 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.171360 17291 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.206758 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.209527 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:06:42.123692 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.029s	sys 0.019s
W20260709 13:06:42.234284 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74623.9us
I20260709 13:06:42.237950 15579 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.147202 17300 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.243363 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.244596 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.246750 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.241968 17268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39946 (request call id 508) took 2321 ms. Trace:
I20260709 13:06:42.253214 17268 rpcz_store.cc:276] 0709 13:06:39.892913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.899133 (+  6220us) service_pool.cc:224] Handling call
0709 13:06:40.346815 (+447682us) ts_tablet_manager.cc:934] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
0709 13:06:41.141121 (+794306us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:41.374483 (+233362us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.374596 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:41.715655 (+341059us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:41.738525 (+ 22870us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:42.213784 (+475259us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:42.213867 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4312,"tablet-copy.queue_time_us":233264,"thread_start_us":363253,"threads_started":2}
I20260709 13:06:42.255347 17268 tablet_copy_client.cc:806] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.256036 17268 tablet_copy_client.cc:670] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.257980 15580 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.258888 17265 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:42.259483 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.028s	sys 0.104s
W20260709 13:06:42.259878 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.028s	sys 0.104s
I20260709 13:06:42.262287 15651 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.263002 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.264078 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.265136 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.266600 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:42.267688 15648 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:42.268628 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 262974us
I20260709 13:06:42.275628 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.276556 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:42.277063 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.277168 15652 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.280421 15653 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.281432 17266 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.214497 17303 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.282732 17303 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:42.250891 17307 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.259325 17265 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:42.291785 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.275770 17249 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.281468 17243 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.292730 15724 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.249294 17238 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:42.285054 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.298517 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.298172 16275 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.285089 15574 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.278384 17295 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.323946 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.284348 17279 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.326983 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.274137 17260 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:06:42.325758 17242 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.329308 15580 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.329816 15721 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.334311 17242 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.334524 17253 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:42.335366 17260 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.335178 17253 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.335804 17260 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.273873 17231 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:42.336704 17260 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.337438 17231 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.337539 17253 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:42.337924 17260 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.299417 17263 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.338570 15654 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.321045 17254 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.345217 17263 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.346938 15726 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.346729 17240 consensus_queue.cc:1059] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:42.347442 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:42.324332 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:42.347684 17183 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.344564 17253 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.337838 17231 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.364977 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:42.367712 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:42.368815 15654 raft_consensus.cc:2393] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:42.372611 15722 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:42.378139 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.379770 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.380983 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.382337 17249 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.382781 17251 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:42.384228 15647 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.386822 15728 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.357384 17183 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.393009 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.283792 17303 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.323474 17290 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:42.391039 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:42.376490 17243 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:42.401376 17290 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.400924 17231 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.401783 17290 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:42.402943 17290 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.394129 17309 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.418787 17286 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:42.419245 17243 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.349985 17265 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.404552 17290 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.399334 17249 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.422636 17242 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.423048 15729 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
W20260709 13:06:42.423629 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.429113 17280 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.426750 15727 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
W20260709 13:06:42.434762 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 188081us
I20260709 13:06:42.435771 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.433003 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.438455 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.438844 17283 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.439700 17295 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.440197 17295 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:42.440446 17292 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.440632 17287 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.441809 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.420032 17231 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.445525 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 143636us
I20260709 13:06:42.420825 17243 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:42.443913 17183 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.443974 17279 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.450496 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:42.535149 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 84726us
I20260709 13:06:42.535938 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.536985 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.537413 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 319) took 1103 ms. Trace:
I20260709 13:06:42.452817 17266 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:42.453486 17255 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.538692 17255 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.538964 17283 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.539058 17306 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.537955 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.540335 17306 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.541379 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.459861 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.542064 17306 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.461155 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:42.461196 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.461687 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.462179 17249 consensus_queue.cc:1059] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:42.441111 17295 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.545748 17295 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.546765 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.547883 17302 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.537940 15727 rpcz_store.cc:276] 0709 13:06:41.434215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.436521 (+  2306us) service_pool.cc:224] Handling call
0709 13:06:42.038371 (+601850us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:42.537162 (+498791us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54000e4f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:42.537306 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743007360}
I20260709 13:06:42.549625 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.463352 17265 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.550376 17302 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.551515 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.552415 17302 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.553560 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.464322 17243 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.554261 17302 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.554764 17243 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.555529 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.556236 17302 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.465086 17297 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:42.557770 17302 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:42.558429 17297 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.558965 17283 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.559358 17283 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:42.560137 17283 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.560624 17297 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:42.465880 15725 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:42.527179 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 53862us
I20260709 13:06:42.541719 17238 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.561645 17238 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.562686 17238 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.564051 17238 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.564683 17281 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.561652 17283 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:42.570777 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 98342.9us
I20260709 13:06:42.571702 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:42.419781 17286 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:42.586882 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 127096us
I20260709 13:06:42.472532 17268 tablet_copy_client.cc:538] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.469630 17301 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:42.593529 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:42.594125 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:42.593080 17240 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.600322 15649 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:42.603643 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 142030us
I20260709 13:06:42.590873 17183 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.593341 17263 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.593226 17244 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.591372 17242 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:42.616833 17288 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.610767 17265 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:42.639482 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.640432 15579 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:42.611644 17269 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:42.612145 17270 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:42.651659 15579 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.656311 17289 raft_consensus.cc:1064] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:42.624951 17244 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.670080 17310 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:06:42.677330 17298 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.636247 17265 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.693128 17234 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:42.693812 17234 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.695796 17248 raft_consensus.cc:3055] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.696318 17248 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:42.697019 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.697932 15571 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:42.682757 17272 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.672253 15727 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.670256 17297 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:42.701690 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:42.658188 17243 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:42.709537 17291 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.712087 17255 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.727993 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 440669us
I20260709 13:06:42.744959 17244 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:42.746335 15724 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:42.751541 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.732707 17310 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.724681 17248 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.759268 17248 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.771358 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:42.772318 15727 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:42.773052 17265 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:42.775679 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.738130 17234 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:42.776953 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:42.789840 17271 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.790417 17271 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:42.791491 17271 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.792866 17271 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.769277 17310 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.802973 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:42.805002 15653 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
W20260709 13:06:42.800498 16270 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.001s
I20260709 13:06:42.805562 16270 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:42.806527 16269 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.803974 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:42.810132 17261 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:42.814311 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.815281 15571 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:42.816609 17266 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.817045 17266 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:42.817909 17266 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.823170 17303 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:42.823900 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.827435 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:42.839542 16271 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:42.841717 17292 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.842303 17292 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:42.844880 16272 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:42.846498 15648 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.849125 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.835055 17240 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:06:42.582551 17275 consensus_queue.cc:1175] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "680390d3f0884c91bf1f22ba914b438a" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:42.853808 17256 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.858310 17240 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.867359 17310 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.873689 15725 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:42.876125 17286 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:42.882606 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.860862 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.856369 17263 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:42.888535 15579 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.884091 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.888693 17287 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.891028 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:42.891165 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:42.892715 15724 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:42.865698 17282 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:42.891616 17287 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:42.886504 17292 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:42.905968 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 311970us
I20260709 13:06:42.907732 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.903856 15619 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:42.892694 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:42.896144 17293 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.935813 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:42.905230 17310 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.918226 17287 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.919685 17282 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:42.936642 15574 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:42.932303 17281 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:42.943431 17236 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.942801 15652 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:42.966403 17262 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.966892 17262 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:42.951607 17282 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.970378 17282 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.978792 17268 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:06:42.947065 17259 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:42.985038 15473 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.932331 17280 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:42.990131 17238 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.002991 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:42.940124 17293 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:42.961624 17281 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:43.015970 16278 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:06:42.991525 16270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 385) took 1574 ms (client timeout 1943 ms). Trace:
I20260709 13:06:42.998055 17238 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.049168 17244 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.045372 17300 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:43.046556 17280 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.048455 17265 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:43.066287 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 429691us
I20260709 13:06:43.048617 17234 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:43.083830 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:43.071615 17280 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:43.081332 17319 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:06:43.075738 17267 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.095280 17308 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:43.049042 16270 rpcz_store.cc:269] 0709 13:06:41.417080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.419315 (+  2235us) service_pool.cc:224] Handling call
0709 13:06:42.206607 (+787292us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:42.991277 (+784670us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b540044d9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:42.991409 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213099136}
W20260709 13:06:43.104983 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.085812 17293 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.082129 17316 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:43.076886 17265 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.091010 17320 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.074599 17300 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.091882 17280 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.078678 17234 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.129694 17324 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:43.151394 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.170351 17255 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.151902 17320 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.171260 17255 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.172684 17320 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.173223 15646 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:43.173504 17255 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:43.175915 17290 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.002s
I20260709 13:06:43.166596 17316 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.114251 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.097249 17256 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.087173 17245 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:43.127329 17267 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.113771 17292 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.149240 17238 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:43.183187 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 84014.8us
I20260709 13:06:43.187409 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:43.188412 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.183548 17282 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.190300 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.170397 17234 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.190876 15572 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.191094 15724 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:43.093982 17281 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.182006 17306 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.196950 17328 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:43.184983 17236 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.192497 17295 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.191283 17292 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.186329 17249 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:43.207103 17292 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.207926 17244 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.208402 17244 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.208892 17236 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.212638 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.213384 17282 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.205017 17295 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:43.214411 15721 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.215211 17295 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.216681 17267 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:43.217216 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.217067 17289 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.218865 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.223148 15648 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:43.224143 15693 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:43.224336 17276 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.224344 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.225265 17253 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.225332 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.225755 17253 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.226207 15725 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:43.226219 17253 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:43.232362 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.232777 17316 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.235545 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:43.236585 15728 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.202919 17308 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:43.224728 17276 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:43.242513 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:43.248566 17276 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.249946 17276 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.218918 17306 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.259804 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.259876 15650 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.260547 15648 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:43.263751 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.246757 17331 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.265208 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:43.266327 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.267081 15655 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.266860 17322 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:43.267472 17266 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.267889 17322 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.268033 17293 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.268311 17322 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.268692 17322 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.268610 17293 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.271262 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.274324 17293 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.277837 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.247484 17270 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.279759 17252 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.264277 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.278234 17320 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:43.290478 17291 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260709 13:06:43.263317 17280 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.291108 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.280261 17270 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:43.281388 17331 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:43.305254 17306 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.307399 15649 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:43.325165 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.358657 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.359515 15722 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:43.325093 17251 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.321298 15646 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:43.369753 15729 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.370116 15648 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.368976 15728 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:06:43.363787 17336 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 13:06:43.373049 15653 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.373874 15655 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:43.360357 17300 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.364048 17252 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:43.319362 17308 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.391637 17265 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.396871 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.397099 17236 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.397957 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.398157 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.399168 15571 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.399207 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.399987 15572 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.400734 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.402382 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.402745 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.403009 15576 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:43.403451 16274 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:43.359861 17279 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:43.385258 16278 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:43.353298 17287 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.409143 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:43.416323 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.417929 15693 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.422459 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.422899 17287 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.423090 15576 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:43.423594 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.424605 17307 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.426110 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.381678 17297 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.434552 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.435483 15572 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.437707 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.368773 17251 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.381083 17331 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.476230 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:43.481304 17252 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.407074 17300 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:06:43.368983 17270 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.429121 17299 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.467945 17237 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.430187 17253 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.467147 17292 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:43.544381 17329 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.396s	user 0.004s	sys 0.001s
I20260709 13:06:43.544977 15574 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.485846 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.547276 15572 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.469889 17310 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.538332 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 100689us
I20260709 13:06:43.542580 17253 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.542351 17286 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:43.557507 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.558291 15576 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:43.553892 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:43.559762 15650 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.555899 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.564095 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.571151 16278 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:43.483036 17332 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:06:43.580152 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.534320 17299 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.538837 17237 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.587138 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:43.588407 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.555248 17259 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.467486 17326 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:06:43.577752 17280 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.583693 17265 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.588944 17299 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.588944 17283 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.591105 17237 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.562086 17310 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.598733 17265 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.598956 17320 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.617870 17283 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:43.598310 17322 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.596869 17259 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.625775 17265 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.600441 17262 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.637238 15650 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:43.620061 17244 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.642409 17283 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.652206 15722 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.638480 17320 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.639618 17287 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.673558 17238 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.681109 17244 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.678887 17320 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.684141 17259 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.684700 17237 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.685976 17244 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.686537 17244 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.689759 17244 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.680644 17251 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.694886 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.699406 15653 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:43.701453 17322 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.712644 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.713357 15576 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.715413 17237 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.718863 16278 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:43.678506 17238 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.724824 17238 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.725378 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.735242 17260 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.737368 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.743542 15724 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:43.738348 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.747718 15619 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.748723 15576 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:43.675890 17262 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.756362 15576 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.761164 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.758785 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.762454 15572 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:43.761947 15579 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:43.725401 17238 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.764772 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.736137 17293 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.743251 17307 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.768687 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.743968 17252 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.768676 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.754999 17306 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.767526 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.756067 16271 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:43.768888 15725 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.784762 15576 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.775604 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.773882 17259 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.771823 17291 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:43.765542 17236 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:06:43.772198 17238 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.789842 17289 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.774164 17293 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.805399 15728 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:43.787708 17341 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:43.793450 17259 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:43.779170 17252 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.797518 15574 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:43.800509 17292 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.798372 17322 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.799782 15727 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:43.813732 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55945.1us
I20260709 13:06:43.827955 17238 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.821130 17341 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:43.830634 17341 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.817488 17259 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.847936 17265 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.850775 17265 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.855350 17259 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.856197 17306 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.856026 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.819403 17322 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.924157 15580 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:43.924268 17322 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.925403 17259 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.808495 17289 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.930794 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.932173 17341 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.932894 17341 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.934940 17341 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.936704 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.937304 15576 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
W20260709 13:06:43.859150 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.932334 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.938542 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.938941 15580 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:43.939404 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:43.940161 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.940403 17244 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.859829 17252 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.940865 17244 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.931980 15646 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:43.941320 17244 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.941412 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.865058 15721 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:43.942382 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:43.942999 15646 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.867009 15727 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:43.867566 17310 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:43.944232 15473 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 346) took 1151 ms. Trace:
I20260709 13:06:43.944381 17310 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.868484 15724 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:06:43.869277 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.944633 15473 rpcz_store.cc:276] 0709 13:06:42.792794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.792972 (+   178us) service_pool.cc:224] Handling call
0709 13:06:43.944153 (+1151181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.237540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:43.280244 (+ 42704us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:43.283505 (+  3261us) write_op.cc:435] Acquired schema lock
0709 13:06:43.290733 (+  7228us) tablet.cc:662] Decoding operations
0709 13:06:43.366123 (+ 75390us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:43.368714 (+  2591us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:43.373578 (+  4864us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:43.386622 (+ 13044us) tablet.cc:701] Row locks acquired
0709 13:06:43.407397 (+ 20775us) write_op.cc:260] PREPARE: finished
0709 13:06:43.424439 (+ 17042us) write_op.cc:270] Start()
0709 13:06:43.424600 (+   161us) write_op.cc:276] Timestamp: P: 1783602403424397 usec, L: 0
0709 13:06:43.424622 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:43.555685 (+131063us) log.cc:844] Serialized 536 byte log entry
0709 13:06:43.857245 (+301560us) op_driver.cc:464] REPLICATION: finished
0709 13:06:43.924523 (+ 67278us) write_op.cc:301] APPLY: starting
0709 13:06:43.924606 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:43.924707 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:43.924830 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:43.928580 (+  3750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:43.928741 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:43.928786 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:43.928986 (+   200us) log.cc:844] Serialized 23 byte log entry
0709 13:06:43.929145 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.929234 (+    89us) write_op.cc:454] Released schema lock
0709 13:06:43.929271 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:43.931410 (+  2139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.931442 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":66998,"apply.run_cpu_time_us":1672,"apply.run_wall_time_us":5145,"num_ops":1,"prepare.queue_time_us":233707,"prepare.run_cpu_time_us":19470,"prepare.run_wall_time_us":397571,"raft.queue_time_us":174548,"raft.run_cpu_time_us":6604,"raft.run_wall_time_us":69147,"replication_time_us":432478,"thread_start_us":407070,"threads_started":4,"wal-append.queue_time_us":93996}]]}
I20260709 13:06:43.871877 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.948661 17308 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:43.872923 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 105469us
I20260709 13:06:43.949733 17242 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.950426 17242 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:43.951232 17242 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.951797 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:43.952271 17310 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.953696 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.953948 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.954327 15579 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:43.956632 17322 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.959300 15474 catalog_manager.cc:5697] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.960516 17308 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.873067 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:43.873967 17286 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:43.960894 15474 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.978863 17358 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:43.978863 15474 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 3, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.980729 15474 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 3, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.883737 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.982894 15727 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:43.886373 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:43.983804 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 97528.9us
I20260709 13:06:43.983927 15474 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.985262 15693 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.892287 17320 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:43.893988 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 146412us
I20260709 13:06:43.986567 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:43.985970 15474 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.987178 17297 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.987632 17297 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:43.987794 17256 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.988040 17297 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.988196 17256 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:43.988648 17256 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.989461 17267 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:43.991958 17267 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:43.992914 17267 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:43.897955 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.996706 17306 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.996585 17256 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.997318 17306 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.904429 16276 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:43.905086 15655 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:43.906137 15648 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:43.999580 15543 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:43.908946 17241 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.909344 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.910531 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:43.911123 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:43.912130 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:44.005649 15650 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:43.912424 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:43.915400 17268 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:43.916044 17290 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.009279 17268 tablet_bootstrap.cc:492] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:06:44.009788 17320 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.010136 17268 ts_tablet_manager.cc:1403] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 1.032s	user 0.029s	sys 0.006s
I20260709 13:06:43.931208 17289 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:43.931331 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:43.940542 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:06:44.011173 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 70696.4us
I20260709 13:06:43.940117 17341 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.851378 17293 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.861586 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:43.833474 17299 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.806286 17291 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:43.942103 17262 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.866320 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.874660 17266 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.961558 17286 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.962932 17288 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.964164 15646 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:43.964985 17242 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.966091 17322 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:43.967218 15578 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:43.968034 17308 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.975390 17332 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.976001 17359 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.976922 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:06:44.046684 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 69849.2us
I20260709 13:06:44.047365 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:44.048439 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:43.979597 17358 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:43.880389 17254 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:44.055225 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:43.884496 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:43.896147 17270 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.991202 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:44.042798 17317 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.002497 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:44.003595 15647 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:44.004634 17241 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.005129 17245 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.008919 17290 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:43.918104 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:44.014580 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:44.010283 17251 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:44.043154 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:44.043092 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:44.043926 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:44.041957 17289 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.983024 15572 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:44.015121 15652 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.000737 15653 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:44.015352 17341 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.042871 17266 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:44.044401 17288 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:44.015261 17335 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:44.010344 17320 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.260937 15724 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.018666 17252 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:44.057965 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 66804.6us
I20260709 13:06:44.057683 15573 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:44.262007 15648 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:44.050151 17359 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.045147 17271 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.301374 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:44.304057 15651 raft_consensus.cc:2368] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:44.270802 15650 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:44.138593 17365 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:06:44.255584 17350 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:06:44.313812 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:44.321448 15724 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:06:44.311316 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.060355 17238 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:44.055971 17276 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.172330 17282 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.196713 17300 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:44.269764 17341 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.322727 15655 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:06:44.105695 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:44.188053 17313 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.090618 17356 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.269436 17241 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:44.266208 17322 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.266517 17363 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.326313 17236 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.306442 17271 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:44.314845 17280 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:44.311299 17279 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:44.327670 17288 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.307106 17259 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:44.327670 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:44.330801 17251 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:44.333030 17287 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.278822 17283 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.082700 17265 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.392675 15574 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 2: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:44.392818 17265 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.393361 17374 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.055828 17310 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:44.394214 17310 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:44.394785 17310 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.394152 17374 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:44.397135 15652 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:44.397197 17374 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.245126 17299 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:44.398520 15654 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:44.075362 17253 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.399066 17288 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.399474 17253 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:44.400506 17253 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.287415 17358 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.282670 17252 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.325230 15648 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:44.402338 17252 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.052027 17332 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.052160 17308 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.333614 17237 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.281397 17289 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.110044 17331 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.225s
I20260709 13:06:44.336561 17306 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.232403 17291 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.342070 17242 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.145529 17244 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.282289 17359 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.355196 15650 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:44.281567 17317 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.120788 17297 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.349298 17238 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:44.348582 17276 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:44.374091 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:44.368448 17260 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.370083 15571 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.406840 17287 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.355929 17300 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.417506 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:44.372264 17322 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.427951 17242 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.415657 17237 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:44.386186 17259 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.391109 17251 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.372129 17363 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.375916 17280 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.354071 17282 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.369608 17313 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:44.370204 17356 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:44.536226 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 162246us
I20260709 13:06:44.545790 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:44.476475 15576 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:06:44.530236 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 204668us
I20260709 13:06:44.568074 15572 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:44.568594 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:44.578135 15724 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:44.422559 17306 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.567145 17236 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.582662 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:44.535368 17237 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.580180 16276 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:44.543285 17370 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.583534 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:44.648388 15729 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:44.409274 17283 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.490643 17320 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.476675 17286 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.437266 17317 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.492566 17332 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.529990 17256 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.483520 17374 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.438658 17271 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:44.538559 17276 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.658339 17262 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.704705 17366 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:06:44.645356 17377 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.619382 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:44.674113 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:44.712287 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:44.543885 17260 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.623991 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:44.683369 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:44.576849 17268 raft_consensus.cc:359] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:44.491103 17249 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:06:44.701866 17251 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.657785 17236 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.658006 17281 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:44.704335 17262 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.577139 17290 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.717119 15577 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:44.689797 17244 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.657121 17306 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.690375 17238 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.722312 15720 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:44.711961 17356 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.718765 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:44.716032 17308 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.719638 17322 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.720817 17260 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.916616 17287 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.719390 15580 raft_consensus.cc:2393] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:44.917166 17322 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.719090 17268 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:06:44.722129 17236 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.822186 16269 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:44.832852 17313 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:44.722646 17373 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.833143 17262 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:45.021067 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.018s	sys 0.021s
I20260709 13:06:44.700625 17265 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:44.807866 17282 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.915294 17300 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.917200 17260 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:44.926019 17280 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:44.721076 17281 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.717582 17320 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.931528 17356 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.717061 17377 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.024861 17259 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:44.713701 17310 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.698230 17374 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:45.042634 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.020s	sys 0.028s
I20260709 13:06:45.014523 17322 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:44.834695 17341 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.055001 17300 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:45.074059 17300 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.054658 17268 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:45.014182 17287 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.078094 17287 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.078459 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.079864 15727 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:45.080819 17287 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.020606 17331 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:45.081804 17331 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:45.084676 17331 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.085294 17331 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.060220 15693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.012s	sys 0.024s
W20260709 13:06:45.086541 15693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.024s
W20260709 13:06:45.086937 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 761548us
I20260709 13:06:45.042865 17262 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:45.090114 17262 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.052083 17373 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:45.092041 17341 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.092437 17262 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.093457 17262 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.067204 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.094288 15728 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:45.070619 15724 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.094787 15722 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:45.071096 17251 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.071213 17288 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.071269 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.057016 17260 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.091677 17373 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.053319 17363 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.102929 15726 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:45.065634 17283 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.104297 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.076700 17300 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.093922 17262 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.085891 17331 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.107161 17382 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.111186 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.111222 17288 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.095738 17251 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:45.051851 15546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.011s
W20260709 13:06:45.172049 15546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.002s	sys 0.011s
I20260709 13:06:45.108822 17292 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.167944 15728 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:45.151571 15724 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.062625 17356 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.174424 17331 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.167088 17283 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.175488 17379 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:06:45.176929 17377 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.177066 17268 ts_tablet_manager.cc:1434] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 1.167s	user 0.009s	sys 0.015s
W20260709 13:06:45.244639 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.024s	sys 0.072s
W20260709 13:06:45.284714 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.024s	sys 0.077s
I20260709 13:06:45.276711 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 1985) took 1417 ms. Trace:
I20260709 13:06:45.285451 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:45.210041 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.288858 15654 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:45.291232 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.292420 15648 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:45.292615 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.292936 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.293731 15653 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.294417 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.294819 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.294970 15655 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.295473 15653 raft_consensus.cc:2368] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3.
I20260709 13:06:45.295925 15654 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:06:45.287933 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 213595us
I20260709 13:06:45.299541 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.299821 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.300622 15650 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:45.292073 15577 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:45.285374 15722 rpcz_store.cc:276] 0709 13:06:43.859536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.861304 (+  1768us) service_pool.cc:224] Handling call
0709 13:06:45.095940 (+1234636us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001fcf54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:45.276610 (+180670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480961280}
I20260709 13:06:45.322781 15654 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:45.323873 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.324684 16277 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:45.324898 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.325743 15577 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:45.326928 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.327628 15577 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:45.324585 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.319528 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:45.331887 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.332119 15654 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:45.332656 15647 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:45.333161 17363 raft_consensus.cc:476] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:45.333550 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.146350 17370 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:45.242802 17371 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.265028 17288 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.335513 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.181382 17281 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.328961 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.329007 17320 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:45.337672 15653 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:45.334133 15648 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:45.297132 17259 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:45.284509 17268 ts_tablet_manager.cc:1467] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Tablet startup took 1274ms
W20260709 13:06:45.247088 17276 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:06:45.247253 17374 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.337067 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.283753 17306 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.330193 17244 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.340390 15721 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:45.344645 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.324056 17316 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.345207 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.305173 17270 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.334089 17356 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.348066 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.299232 17283 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.331171 17385 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:45.337702 17375 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.376230 15653 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:45.338621 17393 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.323223 17236 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:45.341187 17380 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.343926 17388 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.298105 17292 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.377650 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.390412 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.390683 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 282) took 1336 ms. Trace:
I20260709 13:06:45.376878 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.379887 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.345387 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.378916 15654 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:45.383433 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.347048 17288 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.348480 17363 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.380992 17251 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.406603 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.406607 17363 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.407435 17363 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.408159 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.408761 15654 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:45.409871 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.379300 17290 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.380259 17310 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.379257 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:45.371661 15577 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:45.391021 15578 rpcz_store.cc:276] 0709 13:06:44.053975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.054145 (+   170us) service_pool.cc:224] Handling call
0709 13:06:44.054450 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.412611 (+358161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.412657 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.413303 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.677878 (+264575us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:44.677950 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.095266 (+417316us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400292554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:45.095317 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.390419 (+295102us) raft_consensus.cc:1685] finished
0709 13:06:45.390439 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.390618 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35565,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":552520448,"thread_start_us":264730,"threads_started":2,"wal-append.queue_time_us":417791}
I20260709 13:06:45.413829 15648 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.342338 17371 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.389667 17236 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.416679 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.405843 15647 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:45.384246 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.370790 17259 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.387992 17393 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:45.412959 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 88698.7us
I20260709 13:06:45.345173 17369 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:45.405515 17288 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.405943 17374 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.432139 17251 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.420775 15646 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:45.433211 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.378507 17244 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.402308 17394 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.466177 15693 leader_election.cc:400] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:45.386636 17375 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.410677 17306 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.411530 17331 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.410408 17290 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.389966 17322 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.403649 17262 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.403457 17377 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.391129 17383 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.392515 17385 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:45.387991 17380 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.447793 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.448040 15544 leader_election.cc:400] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3.
I20260709 13:06:45.527354 15544 leader_election.cc:403] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.439149 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:45.528188 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 124350us
I20260709 13:06:45.527365 15654 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.446554 15648 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:45.453862 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.380053 17316 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.531561 15650 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:45.466663 15693 leader_election.cc:403] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:45.437669 17237 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.000s
I20260709 13:06:45.383306 17270 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.522809 17390 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.341183 17266 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:45.442898 15571 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.000s
I20260709 13:06:45.412626 17260 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:45.444661 17259 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.434346 17356 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.445701 17393 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:45.441215 17359 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.000s
I20260709 13:06:45.436233 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.445588 17288 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.411037 17370 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.529904 15577 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:45.531597 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.559029 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:45.560348 17300 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.538729 17383 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.560807 17300 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.561249 17300 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.561622 17374 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.562098 17374 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.562462 17374 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.562578 17383 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:45.532653 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 84999.3us
I20260709 13:06:45.439512 17292 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.511726 17335 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.377708 17276 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.464849 16269 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:45.543045 15571 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:45.521282 17306 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.541821 17236 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.523175 17310 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:45.523373 17290 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.617100 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.547868 17356 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.524920 17369 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:45.533766 17249 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.533921 17262 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.548609 15646 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:45.536885 17237 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.527012 17377 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.533617 17380 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.526918 15649 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:45.553874 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.555307 17270 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:45.556546 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.557147 17244 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.646064 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.551636 17390 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.568545 17384 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.569329 16275 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:45.675922 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:45.570262 17375 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.570645 17299 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:45.571372 17313 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.571770 17283 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.572424 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.573439 17316 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.799383 15579 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:45.574368 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.575003 17371 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.575671 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.800666 16277 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:45.575798 17266 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.801661 17390 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:45.547498 17252 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.145s	user 0.008s	sys 0.003s
I20260709 13:06:45.802791 17252 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.576469 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.514984 17394 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.805555 17252 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.577601 15693 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:45.806718 15573 raft_consensus.cc:606] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:45.807309 15573 raft_consensus.cc:614] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:45.807068 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 229538us
I20260709 13:06:45.807957 17394 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.517374 17331 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.808190 15693 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:45.808693 17331 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.809128 15693 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:45.809407 17316 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.810375 17313 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.810209 17316 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.593009 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.592919 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:45.812374 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 219556us
I20260709 13:06:45.813186 17316 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.607880 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.395043 17388 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.445977 17251 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.813903 17316 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.815513 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 741) took 1042 ms. Trace:
I20260709 13:06:45.815856 17388 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.815445 17316 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.565081 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.816175 16269 rpcz_store.cc:276] 0709 13:06:44.773314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.814492 (+1041178us) service_pool.cc:224] Handling call
0709 13:06:45.814878 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.815092 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.815134 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.815187 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.815227 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.815305 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.815452 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:45.816854 15655 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:45.621587 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.605522 17241 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.817873 15723 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.539222 17363 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.818323 17241 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.818897 17316 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.820284 17363 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.606832 17341 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.821202 17244 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.821065 17341 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.617822 15726 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:45.821768 17244 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.625082 17356 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.822355 17244 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.535303 17395 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:45.446187 17320 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.826691 17299 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:45.827309 17299 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:45.827728 17404 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.828271 17299 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.606611 17335 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.830950 17335 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.831362 17341 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.829792 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.832638 15655 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:45.836081 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.836627 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:45.837318 17370 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.837525 17395 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.837877 17370 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.838176 17395 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.838680 17395 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.840546 17363 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.841696 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.842069 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.838498 17370 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.841144 17363 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.846577 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.846650 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.847385 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.847627 15577 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:45.847860 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:45.848052 15651 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:45.849337 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.850152 15577 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:45.845846 17363 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.852807 15577 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:45.853394 15577 pending_rounds.cc:85] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 1
I20260709 13:06:45.853094 17356 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.853928 15577 pending_rounds.cc:107] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:45.854451 15577 raft_consensus.cc:2889] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.856853 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.859835 17331 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.868876 15573 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:45.869259 17331 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.643554 17262 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.869750 17371 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.870461 17371 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.871577 17262 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.783185 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.872529 15722 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.783381 17401 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.783253 16271 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:45.873658 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 425) took 1320 ms. Trace:
I20260709 13:06:45.873520 17401 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.874265 16271 rpcz_store.cc:276] 0709 13:06:44.553474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.566967 (+ 13493us) service_pool.cc:224] Handling call
0709 13:06:45.553706 (+986739us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:45.873582 (+319876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9724288}
I20260709 13:06:45.876389 17401 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.876699 16271 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:45.877223 15574 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:45.785389 17237 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.785043 17384 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.786206 17276 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:45.788352 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 737) took 1143 ms. Trace:
I20260709 13:06:45.881855 15655 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:45.890923 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.618909 17310 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.901861 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:45.902807 15577 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.903040 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.903550 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:45.903496 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.904614 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:45.565068 17359 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.907053 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:45.793797 17242 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.541354 17385 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.620251 17287 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.801628 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.810889 17313 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.815732 17251 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.610652 17279 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.605588 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.608103 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:45.608458 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 283) took 1554 ms. Trace:
I20260709 13:06:45.908540 17388 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:45.862149 17316 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.643857 17377 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.644093 17369 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.894816 15655 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:45.895740 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.908341 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:45.908928 17363 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:45.909554 17396 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:06:45.909400 17375 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:45.909554 17395 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.883636 17404 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:45.345929 17268 ts_tablet_manager.cc:1469] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Trace:
0709 13:06:39.892913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.899133 (+  6220us) service_pool.cc:224] Handling call
0709 13:06:40.346815 (+447682us) ts_tablet_manager.cc:934] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
0709 13:06:41.141121 (+794306us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:41.374483 (+233362us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.374596 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:41.715655 (+341059us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:41.738525 (+ 22870us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:42.213784 (+475259us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:42.213867 (+    83us) inbound_call.cc:177] Queueing success response
0709 13:06:42.978323 (+764456us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:44.010514 (+1032191us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:44.014779 (+  4265us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:44.018067 (+  3288us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":4312,"mutex_wait_us":191708,"raft.queue_time_us":15772,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"tablet-copy.queue_time_us":233264,"tablet-download-pool.queue_time_us":164,"tablet-download-pool.run_cpu_time_us":1425,"tablet-download-pool.run_wall_time_us":212524,"thread_start_us":363253,"threads_started":2}
I20260709 13:06:45.914955 17310 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.889394 17276 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.916090 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.788965 17306 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.916733 17313 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.896977 17401 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.901448 17390 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:45.658443 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.912777 17292 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.907567 17394 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:45.915864 17259 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.923933 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:45.928900 17393 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.920342 17287 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.917572 17283 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:45.921378 17279 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.110319 16277 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:46.124660 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:06:46.019279 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.921111 17262 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:46.110723 15576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1391) took 2055 ms (client timeout 1926 ms). Trace:
I20260709 13:06:45.922967 15727 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:45.968732 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1966) took 2060 ms. Trace:
I20260709 13:06:46.132905 15649 rpcz_store.cc:276] 0709 13:06:43.908113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.908225 (+   112us) service_pool.cc:224] Handling call
0709 13:06:43.908545 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.646270 (+1737725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.968414 (+322144us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400085054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:45.968639 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3719668608}
I20260709 13:06:46.135154 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.136689 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:46.102340 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.982175 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.100788 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:45.975872 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 736) took 1331 ms. Trace:
I20260709 13:06:46.101907 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.154089 15722 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:46.154996 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.156157 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.129611 15655 raft_consensus.cc:2368] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:46.156181 15577 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:46.157421 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.157702 15729 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:46.153151 15723 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:46.158432 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.159061 15655 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:46.159168 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.159826 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:46.069001 15618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.926s (SENT) [suppressed 5 similar messages]
I20260709 13:06:46.160386 15655 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:46.161338 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:46.161182 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.161872 15724 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.162639 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.163419 15655 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:46.163815 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:46.164328 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:45.929754 17281 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:45.922812 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:46.131582 15576 rpcz_store.cc:269] 0709 13:06:44.054860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.055009 (+   149us) service_pool.cc:224] Handling call
0709 13:06:46.110451 (+2055442us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540026c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:46.110653 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965758848}
I20260709 13:06:46.137760 17276 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.140828 17390 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.141678 17394 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.142763 17279 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:46.017143 17244 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.017990 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 336) took 1871 ms. Trace:
I20260709 13:06:45.922845 17356 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.926777 17363 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.926527 17388 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:45.933955 16272 raft_consensus.cc:2368] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:46.145468 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.146966 17404 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.148322 17297 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:46.148712 17374 consensus_meta.cc:287] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260709 13:06:46.149485 17380 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:45.976778 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.979983 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.164497 15578 raft_consensus.cc:2368] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:46.164932 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:45.883231 16275 rpcz_store.cc:276] 0709 13:06:44.645218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.645365 (+   147us) service_pool.cc:224] Handling call
0709 13:06:45.568755 (+923390us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:45.568964 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.696807 (+127843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.788254 (+ 91447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4539648}
I20260709 13:06:46.168490 15724 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:46.153720 16274 rpcz_store.cc:276] 0709 13:06:44.644722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.644857 (+   135us) service_pool.cc:224] Handling call
0709 13:06:45.969942 (+1325085us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:45.975194 (+  5252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.975417 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.975454 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.975523 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.975565 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.975637 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.975801 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978496}
I20260709 13:06:46.174604 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.175252 17359 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.110785 17292 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.126436 17259 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.111014 17389 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:46.129858 17263 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:45.957062 17383 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:46.180435 17384 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:45.964903 17288 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:46.171103 17320 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.181274 17281 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.050647 17237 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:46.192706 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 339) took 1624 ms (client timeout 1975 ms). Trace:
I20260709 13:06:46.127416 17306 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.017421 17249 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3.
I20260709 13:06:46.139271 17262 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.195456 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:45.967531 17289 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:46.016213 17369 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:46.131994 17393 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.024397 16271 raft_consensus.cc:1217] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:46.067269 17300 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:46.198886 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.200242 17395 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:45.927603 17316 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:46.111348 17290 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:46.099337 17370 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.895054 17416 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:46.895963 17416 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.824390 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 570) took 1525 ms. Trace:
I20260709 13:06:46.897570 16277 rpcz_store.cc:276] 0709 13:06:45.298572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.801359 (+502787us) service_pool.cc:224] Handling call
0709 13:06:46.824131 (+1022772us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400639f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:46.824309 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444989184}
I20260709 13:06:46.783932 17260 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:46.917639 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.917681 17260 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.916007 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.924736 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:46.926242 15576 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:46.928531 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:46.898763 17416 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:46.623234 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 554229us
W20260709 13:06:46.342707 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 203405us
I20260709 13:06:46.442334 17245 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.901108 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:46.900141 17374 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:46.332227 17251 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.902627 17276 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.902768 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.205214 15727 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:46.781577 17377 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.851s	user 0.000s	sys 0.009s
I20260709 13:06:46.791730 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 1996) took 2435 ms. Trace:
I20260709 13:06:46.903857 17262 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.903964 16276 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:46.904570 17263 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.904860 17281 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.905314 17389 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.171208 17310 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:46.905905 15653 raft_consensus.cc:2368] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:46.906450 17404 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.908366 17388 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:46.425976 17382 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.908748 17380 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.297892 17407 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:46.695133 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1414) took 1233 ms. Trace:
I20260709 13:06:46.909933 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.910727 15728 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:46.158381 17401 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.822993 15473 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.297186 17371 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.537755 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:46.911640 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:46.992928 15723 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:46.911701 17393 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.894263 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.993814 15577 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:46.204727 17363 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.912825 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:46.996340 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1452) took 1017 ms. Trace:
I20260709 13:06:46.996742 15729 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.200338 15721 rpcz_store.cc:276] 0709 13:06:44.146516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.170878 (+ 24362us) service_pool.cc:224] Handling call
0709 13:06:45.290378 (+1119500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.376864 (+ 86486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.017754 (+640890us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001fcf50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:46.017904 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347247360}
I20260709 13:06:46.913729 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.009923 15726 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:47.010371 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.010905 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:47.011461 15726 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.011711 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.012394 15721 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
W20260709 13:06:47.013093 17313 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.000s
I20260709 13:06:47.014160 17260 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.015899 17389 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.016073 17289 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:47.016649 17289 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.017373 17290 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.913465 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:47.018888 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:47.019157 17401 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.968907 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 568) took 1672 ms. Trace:
I20260709 13:06:45.921680 15571 rpcz_store.cc:276] 0709 13:06:44.054405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.055515 (+  1110us) service_pool.cc:224] Handling call
0709 13:06:45.608372 (+1552857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.960654 17307 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.612990 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.611980 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.916046 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:47.021718 15572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1396) took 1840 ms (client timeout 1535 ms). Trace:
I20260709 13:06:47.021816 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.984069 17310 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:47.022186 15572 rpcz_store.cc:269] 0709 13:06:45.180945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.182763 (+  1818us) service_pool.cc:224] Handling call
0709 13:06:46.611821 (+1429058us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:47.021654 (+409833us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6573440}
I20260709 13:06:46.899006 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.935601 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:47.023164 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.023983 17310 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.024240 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:47.024369 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.924461 16274 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:47.025013 16275 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
W20260709 13:06:46.914165 15720 rpcz_store.cc:269] 0709 13:06:44.568244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.568357 (+   113us) service_pool.cc:224] Handling call
0709 13:06:46.192422 (+1624065us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540039a154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:46.192621 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352058240}
I20260709 13:06:47.025789 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.951157 17377 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.026392 16274 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
W20260709 13:06:46.934620 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.926132 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:46.944640 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 130803us
I20260709 13:06:46.901486 17288 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.945708 15651 raft_consensus.cc:2368] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
W20260709 13:06:46.945367 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 333473us
I20260709 13:06:46.783584 17390 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.901863 17292 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.899433 17287 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.946944 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.204430 17244 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:46.340193 16273 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:46.485997 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 285) took 1262 ms. Trace:
I20260709 13:06:46.888795 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 572) took 1587 ms. Trace:
I20260709 13:06:46.914465 17241 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:46.921759 17259 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.950225 17251 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.944478 17245 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.911497 17359 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:46.936863 17395 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:46.960593 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:46.901839 17320 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.900394 17383 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:46.965433 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 64408.4us
I20260709 13:06:46.922623 17306 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:46.899394 17237 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:46.986419 15650 rpcz_store.cc:276] 0709 13:06:45.379537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.379650 (+   113us) service_pool.cc:224] Handling call
0709 13:06:46.612878 (+1233228us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002e2554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:46.613036 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319417088}
I20260709 13:06:47.002619 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:47.002667 17413 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.019609 17263 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.019748 15578 raft_consensus.cc:2410] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:46.602752 15474 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 363) took 2677 ms. Trace:
I20260709 13:06:47.020722 17370 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:46.786430 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 734) took 2133 ms. Trace:
I20260709 13:06:47.021378 17307 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:46.938966 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.977272 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.013509 17313 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:47.027638 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 101658us
I20260709 13:06:47.342487 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:46.996852 15728 rpcz_store.cc:276] 0709 13:06:45.979382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.979674 (+   292us) service_pool.cc:224] Handling call
0709 13:06:46.996281 (+1016607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:46.999965 15473 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.020460 15726 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:47.391760 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.159353 15729 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:06:47.068692 15653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1415) took 1685 ms (client timeout 2117 ms). Trace:
I20260709 13:06:47.360226 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:47.400681 15576 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:47.024786 15655 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.038615 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.401666 17297 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:47.402053 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 363481us
I20260709 13:06:47.402292 17297 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.403285 17308 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.403570 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.403709 17308 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.404184 17308 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.404361 17297 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:47.400669 15653 rpcz_store.cc:269] 0709 13:06:45.383095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.383215 (+   120us) service_pool.cc:224] Handling call
0709 13:06:47.068428 (+1685213us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540024b3d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.068619 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3456423808}
I20260709 13:06:47.399302 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 297) took 1222 ms. Trace:
W20260709 13:06:47.399847 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 397275us
I20260709 13:06:47.227201 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:47.411226 15572 raft_consensus.cc:2368] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:47.413312 15655 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:46.987041 17246 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.420055 15693 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:47.442675 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 466044us
I20260709 13:06:47.413615 16278 rpcz_store.cc:276] 0709 13:06:44.623714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.642671 (+ 18957us) service_pool.cc:224] Handling call
0709 13:06:45.567646 (+924975us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:45.567834 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.800357 (+232523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.800387 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:45.800430 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.800461 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.757002 (+956541us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54005393d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:46.757078 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.757247 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539697792}
I20260709 13:06:47.485472 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.445688 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:47.442893 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:47.421286 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.486673 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:47.453680 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.487274 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:47.495955 15651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 298) took 1598 ms (client timeout 2082 ms). Trace:
I20260709 13:06:47.509473 16274 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:47.509614 15576 raft_consensus.cc:2368] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:47.510344 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1418) took 1036 ms. Trace:
I20260709 13:06:47.488296 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:47.407894 15577 rpcz_store.cc:276] 0709 13:06:46.176938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.195985 (+1019047us) service_pool.cc:224] Handling call
0709 13:06:47.399240 (+203255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.511844 15573 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:47.512858 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:47.425957 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:47.514611 15575 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:47.514416 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 747) took 1376 ms. Trace:
I20260709 13:06:47.514598 15650 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:47.513641 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 93663.2us
I20260709 13:06:47.515395 16274 rpcz_store.cc:276] 0709 13:06:46.138391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.421040 (+1282649us) service_pool.cc:224] Handling call
0709 13:06:47.514359 (+ 93319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.511191 15576 rpcz_store.cc:276] 0709 13:06:46.473931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.486409 (+1012478us) service_pool.cc:224] Handling call
0709 13:06:47.510272 (+ 23863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.517277 16277 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
W20260709 13:06:47.513725 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 70917.4us
I20260709 13:06:47.225061 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1985) took 1660 ms. Trace:
I20260709 13:06:47.054761 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1417) took 1209 ms. Trace:
I20260709 13:06:47.047281 17380 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.486111 17246 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.390874 17377 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.519651 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 574) took 1051 ms. Trace:
I20260709 13:06:47.220997 17291 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.074657 17316 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.180349 17427 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:47.521090 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 111616us
I20260709 13:06:47.522611 15650 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:47.405390 17283 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.354089 17384 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:47.228247 16270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 740) took 2519 ms (client timeout 2102 ms). Trace:
I20260709 13:06:47.386684 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1424) took 1539 ms. Trace:
I20260709 13:06:47.046970 17416 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:47.014204 17394 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:47.509910 15651 rpcz_store.cc:269] 0709 13:06:45.897603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.902810 (+  5207us) service_pool.cc:224] Handling call
0709 13:06:47.495676 (+1592866us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540017cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.495871 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396284288}
W20260709 13:06:47.191591 16272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 426) took 2636 ms (client timeout 1619 ms). Trace:
I20260709 13:06:47.064867 17374 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.528456 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1457) took 1517 ms. Trace:
I20260709 13:06:47.529253 16277 rpcz_store.cc:276] 0709 13:06:46.468283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.898759 (+430476us) service_pool.cc:224] Handling call
0709 13:06:47.519489 (+620730us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.519596 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135812480}
I20260709 13:06:47.448800 16235 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.560918 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.529608 17289 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.487167 17297 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.486145 17389 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.090018 17414 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.570361 17414 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.570847 17307 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.400843 16269 rpcz_store.cc:276] 0709 13:06:45.301102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.023751 (+722649us) service_pool.cc:224] Handling call
0709 13:06:46.887578 (+863827us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eeeee 0000000000375939 00007f2d9a9621e0 00007f2d9aa2b0c4 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:46.887838 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.888152 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.888198 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.888261 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:46.888312 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.888395 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.888550 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13508736}
I20260709 13:06:47.572240 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.572947 16269 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:47.572850 17389 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.573549 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 577) took 1104 ms. Trace:
W20260709 13:06:47.573772 17363 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.523s	user 0.000s	sys 0.007s
I20260709 13:06:47.573959 16269 rpcz_store.cc:276] 0709 13:06:46.469291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.571951 (+1102660us) service_pool.cc:224] Handling call
0709 13:06:47.573486 (+  1535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.574232 17363 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.575042 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:47.575615 16269 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.536135 17246 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.419319 17241 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.576326 17363 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.552721 17291 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.538111 17392 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:47.578420 17237 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.578512 17392 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.577821 17241 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.579205 17392 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.020006 16271 rpcz_store.cc:276] 0709 13:06:45.296629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.023379 (+726750us) service_pool.cc:224] Handling call
0709 13:06:46.024238 (+   859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.938503 (+914265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.943812 (+  5309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.944474 (+   662us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:46.948680 (+  4206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.953088 (+  4408us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.964918 (+ 11830us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51953,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":13683,"spinlock_wait_cycles":38272,"thread_start_us":20746,"threads_started":1}
I20260709 13:06:47.582630 17259 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.583006 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.576347 17246 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:47.583988 16271 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:47.578691 17291 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.543119 17385 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:47.519227 17244 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.998122 17407 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.520073 17300 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.557457 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:47.442447 17359 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.442278 17395 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.525398 17380 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.558349 16276 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:47.049108 17404 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.561712 16277 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 1.
I20260709 13:06:47.419571 17413 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:47.564123 17393 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:06:47.566313 17320 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.552860 17368 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:47.566504 17297 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.552699 17426 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:06:47.555380 17430 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.552242 17429 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:47.567775 17262 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:06:47.558388 17384 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.563865 17390 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.569698 17245 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.678076 17359 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.597414 17368 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:47.651332 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 243480us
W20260709 13:06:47.490049 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.652182 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:47.486977 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 81284.3us
I20260709 13:06:47.400779 15474 rpcz_store.cc:276] 0709 13:06:43.865636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.865786 (+   150us) service_pool.cc:224] Handling call
0709 13:06:43.935029 (+ 69243us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:46.542988 (+2607959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.998263 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.001003 (+  2740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.001038 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:44.001058 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:44.003925 (+  2867us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.003981 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.004008 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:44.004513 (+   505us) tablet.cc:701] Row locks acquired
0709 13:06:44.004537 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:06:44.004679 (+   142us) write_op.cc:270] Start()
0709 13:06:44.004785 (+   106us) write_op.cc:276] Timestamp: P: 1783602404004636 usec, L: 0
0709 13:06:44.004811 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.008802 (+  3991us) log.cc:844] Serialized 2463 byte log entry
0709 13:06:44.416728 (+407926us) op_driver.cc:464] REPLICATION: finished
0709 13:06:44.424752 (+  8024us) write_op.cc:301] APPLY: starting
0709 13:06:44.424866 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:44.425041 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:44.425153 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:44.425924 (+   771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:44.426152 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:44.426193 (+    41us) write_op.cc:312] APPLY: finished
0709 13:06:44.426452 (+   259us) log.cc:844] Serialized 53 byte log entry
0709 13:06:44.426612 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:44.426714 (+   102us) write_op.cc:454] Released schema lock
0709 13:06:44.426757 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":7222,"reported_tablets":10,"spinlock_wait_cycles":151570816,"child_traces":[["op",{"apply.queue_time_us":2829,"apply.run_cpu_time_us":2293,"apply.run_wall_time_us":2293,"num_ops":6,"prepare.queue_time_us":6872,"prepare.run_cpu_time_us":3587,"prepare.run_wall_time_us":10810,"replication_time_us":400454}]]}
I20260709 13:06:47.657012 15573 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:47.689733 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1421) took 1087 ms. Trace:
I20260709 13:06:47.046751 15574 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.693114 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.660090 15649 raft_consensus.cc:2368] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:47.603129 17262 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.659969 15578 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:47.697149 17404 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:47.542369 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56976.1us
I20260709 13:06:47.699702 17404 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.699791 17384 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.700239 17404 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.700331 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.700738 17404 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.554154 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:47.703078 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 148940us
I20260709 13:06:47.705075 17368 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.662812 15648 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.405570 15580 rpcz_store.cc:276] 0709 13:06:45.223979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.227300 (+  3321us) service_pool.cc:224] Handling call
0709 13:06:45.556632 (+329332us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:45.556865 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.009202 (+452337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.009238 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.009291 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.009323 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.485614 (+476291us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000d4dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:46.485693 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.485910 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966356224}
I20260709 13:06:47.706406 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:06:47.708432 15575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 287) took 2456 ms (client timeout 1931 ms). Trace:
I20260709 13:06:47.708592 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:47.708926 15575 rpcz_store.cc:269] 0709 13:06:45.251969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.253454 (+  1485us) service_pool.cc:224] Handling call
0709 13:06:45.972886 (+719432us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:47.707956 (+1735070us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.708194 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392280704}
I20260709 13:06:47.709414 16278 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:47.658316 15579 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:47.710645 17291 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:47.711231 17291 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:47.711349 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 298) took 1534 ms. Trace:
I20260709 13:06:47.711778 17291 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.518952 15647 rpcz_store.cc:276] 0709 13:06:45.564478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.568638 (+  4160us) service_pool.cc:224] Handling call
0709 13:06:46.694625 (+1125987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.703245 (+  8620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.703293 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.703958 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.944837 (+240879us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.948398 (+  3561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.953064 (+  4666us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.008846 (+ 55782us) raft_consensus.cc:1685] finished
0709 13:06:47.008881 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.192660 (+183779us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002e2550. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.224953 (+ 32293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34021,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":123289,"spinlock_wait_cycles":2423150976,"thread_start_us":34240,"threads_started":1,"wal-append.queue_time_us":274745}
W20260709 13:06:47.664664 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 144346us
I20260709 13:06:47.716183 17297 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.560482 15722 rpcz_store.cc:276] 0709 13:06:46.010722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.173566 (+162844us) service_pool.cc:224] Handling call
0709 13:06:46.173918 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.517625 (+1343707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.517653 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.517690 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.517717 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.528252 (+ 10535us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540011b2d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:47.528306 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.528405 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089895680}
I20260709 13:06:46.950775 15725 rpcz_store.cc:276] 0709 13:06:44.356782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.365951 (+  9169us) service_pool.cc:224] Handling call
0709 13:06:44.418488 (+ 52537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.681481 (+262993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.696569 (+ 15088us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.807375 (+110806us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.347809 (+540434us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:45.376128 (+ 28319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.694799 (+1318671us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003becd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:46.704306 (+  9507us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.732600 (+ 28294us) raft_consensus.cc:1685] finished
0709 13:06:46.740263 (+  7663us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.791611 (+ 51348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21176,"raft.queue_time_us":27159,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14719,"spinlock_wait_cycles":381825792,"thread_start_us":412237,"threads_started":1,"wal-append.queue_time_us":585667,"wal-append.run_cpu_time_us":2001,"wal-append.run_wall_time_us":1116876}
I20260709 13:06:47.728848 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 576) took 1259 ms. Trace:
W20260709 13:06:47.561249 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 112568us
I20260709 13:06:47.733208 16235 leader_election.cc:400] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:47.733585 16235 leader_election.cc:403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.736088 17306 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:47.670578 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 153862us
I20260709 13:06:47.737828 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:47.738436 15649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 304) took 1819 ms (client timeout 1838 ms). Trace:
W20260709 13:06:47.738942 15649 rpcz_store.cc:269] 0709 13:06:45.919055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.136383 (+217328us) service_pool.cc:224] Handling call
0709 13:06:47.738144 (+1601761us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540015a4d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.738339 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3460609408}
I20260709 13:06:47.739859 15693 leader_election.cc:400] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:47.740247 15693 leader_election.cc:403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.523254 15652 rpcz_store.cc:276] 0709 13:06:45.844925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.889896 (+ 44971us) service_pool.cc:224] Handling call
0709 13:06:45.915743 (+ 25847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.174152 (+258409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.174185 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.174231 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:46.174264 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.054426 (+880162us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400368154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:47.054491 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.054682 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590208384}
W20260709 13:06:47.554853 16270 rpcz_store.cc:269] 0709 13:06:44.709040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.711328 (+  2288us) service_pool.cc:224] Handling call
0709 13:06:47.221802 (+2510474us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400770e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.228159 (+  6357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384249216}
I20260709 13:06:47.247818 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.742394 16275 raft_consensus.cc:2393] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:47.742970 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 752) took 1567 ms. Trace:
I20260709 13:06:47.743340 16275 rpcz_store.cc:276] 0709 13:06:46.175813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.025844 (+850031us) service_pool.cc:224] Handling call
0709 13:06:47.742888 (+717044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.592171 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:47.673785 15576 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:47.745276 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 293) took 1581 ms. Trace:
I20260709 13:06:47.745345 17434 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:47.745671 15576 rpcz_store.cc:276] 0709 13:06:46.163481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.672354 (+1508873us) service_pool.cc:224] Handling call
0709 13:06:47.673208 (+   854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.744950 (+ 71742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.745194 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.588305 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.748488 17436 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:47.562700 16272 rpcz_store.cc:269] 0709 13:06:44.555595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.566695 (+ 11100us) service_pool.cc:224] Handling call
0709 13:06:47.191235 (+2624540us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400542754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.191468 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772419840}
I20260709 13:06:47.586673 17244 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.750314 17244 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.750510 17433 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:47.751435 15578 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:47.751904 15578 pending_rounds.cc:85] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 2
I20260709 13:06:47.547022 17251 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.726197 17262 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.557736 15646 rpcz_store.cc:276] 0709 13:06:45.847023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.863741 (+ 16718us) service_pool.cc:224] Handling call
0709 13:06:45.864077 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.905018 (+1040941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.905059 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.905587 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.954245 (+ 48658us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.959476 (+  5231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.377045 (+417569us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540035c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:47.377122 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.377193 (+    71us) raft_consensus.cc:1685] finished
0709 13:06:47.377212 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.386573 (+  9361us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":2393017600,"thread_start_us":41168,"threads_started":1,"wal-append.queue_time_us":97258}
I20260709 13:06:47.583031 17292 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.583343 17313 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.767123 17313 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:47.571743 17308 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.601577 17259 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:46.991094 17382 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.772893 17308 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.575492 17389 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.773411 17382 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.593818 17393 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.752198 15578 pending_rounds.cc:107] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:47.778316 15578 raft_consensus.cc:2917] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
W20260709 13:06:47.778483 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57688.6us
I20260709 13:06:47.066442 17371 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:47.779049 15578 raft_consensus.cc:2889] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.601181 17380 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.587647 17383 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.781189 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:47.585716 17385 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:47.782006 16277 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:47.782855 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.783169 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:47.783840 16278 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:47.784092 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.783699 17385 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.784811 16277 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:47.602555 17390 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.786530 17390 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.786760 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 744) took 1658 ms. Trace:
I20260709 13:06:47.786419 17371 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.780074 17434 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:47.787148 16278 rpcz_store.cc:276] 0709 13:06:46.128377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.785229 (+1656852us) service_pool.cc:224] Handling call
0709 13:06:47.785738 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.786295 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.786328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.786386 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.786457 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.786552 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.786670 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.788295 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.608827 17395 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.779083 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:47.787168 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 62851.9us
I20260709 13:06:47.597807 17413 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.572420 17414 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.608559 17416 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.790429 17384 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:47.791666 17416 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:47.792522 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:47.793351 16271 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.606637 17427 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:47.598616 17429 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.799547 17383 raft_consensus.cc:2764] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:47.799901 17429 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.597263 17430 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:47.678249 15653 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:47.656875 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:47.802582 17430 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.804214 15577 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:47.719403 15573 rpcz_store.cc:276] 0709 13:06:46.602469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.688017 (+1085548us) service_pool.cc:224] Handling call
0709 13:06:47.688662 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.689096 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.689136 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.689224 (+    88us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.689316 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.689423 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.689607 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:47.727910 16273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 564) took 2432 ms (client timeout 3074 ms). Trace:
I20260709 13:06:47.711802 15579 rpcz_store.cc:276] 0709 13:06:46.177262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.946724 (+769462us) service_pool.cc:224] Handling call
0709 13:06:47.711094 (+764370us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54003f8ed4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.711259 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591543680}
I20260709 13:06:47.729353 16276 rpcz_store.cc:276] 0709 13:06:46.468992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.960362 (+491370us) service_pool.cc:224] Handling call
0709 13:06:47.728436 (+768074us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54007701d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.728656 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364854016}
I20260709 13:06:47.757231 15575 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.758733 17245 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.759615 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.759646 17426 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:47.765678 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:47.778650 17393 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.376658 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:47.779407 15572 raft_consensus.cc:2368] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:47.789299 16270 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:47.815528 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1422) took 1207 ms. Trace:
I20260709 13:06:47.816110 15571 rpcz_store.cc:276] 0709 13:06:46.607719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.376295 (+768576us) service_pool.cc:224] Handling call
0709 13:06:47.815288 (+438993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.817070 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 748) took 1664 ms. Trace:
I20260709 13:06:47.788421 17434 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.610262 17407 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:47.818387 17245 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.781798 15619 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:47.770344 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:47.796406 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63634.7us
I20260709 13:06:47.765830 17292 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.810392 16274 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.823166 17427 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.826961 17426 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.827533 15574 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:06:47.807885 16273 rpcz_store.cc:269] 0709 13:06:45.295632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.607875 (+312243us) service_pool.cc:224] Handling call
0709 13:06:47.727282 (+2119407us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54004efcd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.727621 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864343936}
I20260709 13:06:47.829018 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1410) took 1949 ms. Trace:
I20260709 13:06:47.829597 17430 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.830621 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 753) took 1630 ms. Trace:
I20260709 13:06:47.831130 16273 rpcz_store.cc:276] 0709 13:06:46.200541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.829471 (+1628930us) service_pool.cc:224] Handling call
0709 13:06:47.829873 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.830207 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.830247 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.830326 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:47.830369 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.830438 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.830559 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.813460 17384 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:47.833554 17384 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.835566 17430 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.817631 16270 rpcz_store.cc:276] 0709 13:06:46.153045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.815783 (+1662738us) service_pool.cc:224] Handling call
0709 13:06:47.816253 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.816584 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.816627 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.816707 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.816764 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.816850 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.817006 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.830307 17380 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.823477 16275 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:47.843935 17407 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.844615 17407 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.844996 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.846443 15727 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:47.846728 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.847957 17262 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:47.848564 17262 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:47.795430 16272 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:47.840500 17380 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.839239 15693 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:47.829846 17426 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:47.859421 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.821579 17245 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.864739 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 754) took 1123 ms. Trace:
I20260709 13:06:47.865061 17437 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.865726 17437 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.865867 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.866330 17437 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:47.866816 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 105293us
I20260709 13:06:47.872928 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 750) took 1693 ms. Trace:
I20260709 13:06:47.862169 17380 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.876272 16272 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:47.829435 15574 rpcz_store.cc:276] 0709 13:06:45.879880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.905498 (+ 25618us) service_pool.cc:224] Handling call
0709 13:06:47.828728 (+1923230us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000c7bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:47.828933 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938651904}
I20260709 13:06:47.882752 16274 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
W20260709 13:06:47.875152 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92090.1us
W20260709 13:06:47.877349 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 95666.3us
I20260709 13:06:47.875898 16276 rpcz_store.cc:276] 0709 13:06:46.175268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.839699 (+1664431us) service_pool.cc:224] Handling call
0709 13:06:47.865523 (+ 25824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.865897 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.865938 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.865986 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.867960 (+  1974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.868025 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.868132 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:47.888185 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91329.2us
I20260709 13:06:47.894873 17413 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.895604 17413 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:47.896943 17413 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:47.878664 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:47.858762 17262 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.902994 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:47.911573 17241 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.912407 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.913451 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:47.910451 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:47.892900 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 223667us
I20260709 13:06:47.927449 15575 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:47.913893 16235 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:47.926486 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:47.933156 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:47.899458 17371 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:47.934064 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:47.943840 17426 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:47.944361 17426 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:47.944753 17426 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.866822 16275 rpcz_store.cc:276] 0709 13:06:46.740314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.843072 (+1102758us) service_pool.cc:224] Handling call
0709 13:06:47.843519 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.843931 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.843960 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.844029 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.844087 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.850275 (+  6188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.862043 (+ 11768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:47.956096 17245 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:47.964040 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57323.8us
I20260709 13:06:47.938477 17436 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.958524 17241 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.959517 16269 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:47.986971 17392 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:47.990257 15724 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:47.993112 17395 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:47.995760 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.998155 17393 raft_consensus.cc:2764] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:47.915336 17394 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:06:48.005808 17394 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.006268 17394 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:48.006625 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.007393 17394 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.008961 17394 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.963599 16272 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 1.
I20260709 13:06:47.998500 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:47.999742 15722 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:48.001387 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 88141us
W20260709 13:06:48.000649 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 102401us
I20260709 13:06:48.004408 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.004702 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.019290 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.025035 17414 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.023337 17244 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.025913 17414 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.028450 17414 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:48.029356 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 137728us
W20260709 13:06:48.103142 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 59535.8us
I20260709 13:06:48.035446 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1416) took 1085 ms. Trace:
I20260709 13:06:48.092206 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:47.991039 17292 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.101821 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.045637 15728 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:48.099121 17244 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:48.127548 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103350us
I20260709 13:06:48.040877 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:48.200398 15576 rpcz_store.cc:276] 0709 13:06:46.949970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.746902 (+796932us) service_pool.cc:224] Handling call
0709 13:06:47.747527 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.797406 (+ 49879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.797440 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.858649 (+ 61209us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.941037 (+ 82388us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.941106 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.941368 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.026111 (+ 84743us) raft_consensus.cc:1685] finished
0709 13:06:48.026136 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.035336 (+  9200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8420,"raft.queue_time_us":43385,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":73093,"threads_started":1,"wal-append.queue_time_us":102040}
I20260709 13:06:48.017222 17395 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:48.039965 15578 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:48.042409 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.041275 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:48.100023 17390 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.040452 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:48.043468 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:48.043987 17441 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:06:48.217151 17291 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:06:48.242820 17291 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.244637 15664 tablet_copy_service.cc:342] P 680390d3f0884c91bf1f22ba914b438a: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78d5d462c9e4427f934553b90818efd6 received from {username='slave'} at 127.0.0.1:46002
I20260709 13:06:48.245344 17291 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.248873 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.249220 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.249783 15655 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:48.232597 15579 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
W20260709 13:06:48.217988 17404 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.002s
I20260709 13:06:48.237425 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:48.239344 17245 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:48.239593 17390 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.240293 17413 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.243114 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.038007 17425 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.194162 17392 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.194257 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 575) took 1725 ms. Trace:
I20260709 13:06:48.041802 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:48.255671 15693 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.039048 15574 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:48.256575 17245 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.121795 17429 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.041860 17416 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.254499 17385 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.263490 15575 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.265816 15692 leader_election.cc:400] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:48.250422 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1414) took 1309 ms. Trace:
I20260709 13:06:48.268035 15653 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:48.269065 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.245406 15664 tablet_copy_service.cc:434] P 680390d3f0884c91bf1f22ba914b438a: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-78d5d462c9e4427f934553b90818efd6 on tablet 78d5d462c9e4427f934553b90818efd6 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:48.276968 17407 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.268600 15580 rpcz_store.cc:276] 0709 13:06:46.940573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.707243 (+766670us) service_pool.cc:224] Handling call
0709 13:06:47.707914 (+   671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.708622 (+   708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.708660 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.709416 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.773734 (+ 64318us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.795953 (+ 22219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.798084 (+  2131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.250092 (+452008us) raft_consensus.cc:1685] finished
0709 13:06:48.250109 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.250251 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5668,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":213,"thread_start_us":44587,"threads_started":1,"wal-append.queue_time_us":153289}
I20260709 13:06:48.091786 17436 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.257448 17404 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.288612 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.289547 17313 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.296150 17385 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:48.269757 15571 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:48.285192 17291 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:06:48.291100 15727 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.268113 17413 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.294785 15654 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:48.300666 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63593.2us
I20260709 13:06:48.295516 15653 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:48.284857 17292 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.310540 17262 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:48.302335 16271 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.006s
I20260709 13:06:48.314304 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:48.311486 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53325.8us
W20260709 13:06:48.308305 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3902904209999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 13:06:48.302632 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.322080 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.313632 17313 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:48.327627 17426 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.328310 17425 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:48.328742 17425 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.330469 17313 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.331964 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.333673 17427 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.334204 17427 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:48.335108 17427 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:48.337353 17451 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
I20260709 13:06:48.341886 15655 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:48.318586 17385 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.316262 16271 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:48.329806 17426 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.357936 17404 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.358089 17259 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.359540 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.360203 15654 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.324944 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:48.356477 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.362411 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.363300 15648 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:48.262990 16270 rpcz_store.cc:276] 0709 13:06:46.468689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.842393 (+1373704us) service_pool.cc:224] Handling call
0709 13:06:47.862065 (+ 19672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.891354 (+ 29289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.893552 (+  2198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:47.906066 (+ 12514us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:47.931536 (+ 25470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.937267 (+  5731us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.193973 (+256706us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54005424d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:48.194154 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40660864}
I20260709 13:06:48.323176 17377 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.366266 15651 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:48.353137 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:48.421267 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71333.1us
W20260709 13:06:48.423890 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 99169.2us
I20260709 13:06:48.426141 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.428431 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:48.430167 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.430181 17390 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:48.432000 17390 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.432180 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.432391 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.433068 15655 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.433409 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.436187 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 428) took 1019 ms. Trace:
I20260709 13:06:48.448843 15575 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:06:48.455060 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 145336us
I20260709 13:06:48.436548 16274 rpcz_store.cc:276] 0709 13:06:47.416651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.102267 (+685616us) service_pool.cc:224] Handling call
0709 13:06:48.102719 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.268180 (+165461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.268210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.268272 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:48.268325 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.435990 (+167665us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54006982d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:48.436031 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.436136 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362039552}
I20260709 13:06:48.321503 17380 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:48.458887 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 92244.7us
I20260709 13:06:48.461020 15692 leader_election.cc:400] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:48.462421 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.357285 17430 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.457870 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 146003us
I20260709 13:06:48.357300 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.463913 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.419706 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 583) took 1465 ms. Trace:
I20260709 13:06:48.351567 17292 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:06:48.432425 17390 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:48.421119 15646 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:48.462652 17429 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.484370 16236 leader_election.cc:400] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.484939 15575 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:48.483340 15543 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.457180 17395 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.495293 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.496217 15574 raft_consensus.cc:2368] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.502475 15580 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:48.479012 17390 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.503567 17430 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.478796 17416 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.514855 15655 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:06:48.517084 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 88835.2us
I20260709 13:06:48.470485 16271 rpcz_store.cc:276] 0709 13:06:46.900839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.792057 (+891218us) service_pool.cc:224] Handling call
0709 13:06:48.366392 (+574335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:48.508198 17455 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.267s	user 0.003s	sys 0.000s
I20260709 13:06:48.472801 17385 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:48.528437 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:48.534336 16274 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:06:48.535805 17452 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:06:48.536388 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:48.537091 16269 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.537495 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 746) took 2408 ms. Trace:
I20260709 13:06:48.537585 17456 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.537870 16277 rpcz_store.cc:276] 0709 13:06:46.128862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.785514 (+1656652us) service_pool.cc:224] Handling call
0709 13:06:47.795858 (+ 10344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.874738 (+ 78880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.874770 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.894315 (+ 19545us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.053544 (+159229us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:48.053603 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.053700 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.537258 (+483558us) raft_consensus.cc:1685] finished
0709 13:06:48.537278 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.537404 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821,"raft.queue_time_us":6394,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10577,"thread_start_us":119501,"threads_started":1,"wal-append.queue_time_us":332013}
I20260709 13:06:48.514246 17377 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.519201 17429 raft_consensus.cc:2764] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:06:48.531234 17437 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.001s
W20260709 13:06:48.516826 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 70278.7us
I20260709 13:06:48.540858 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:48.549266 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:48.552810 16276 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:48.554158 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:48.551255 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 87400.8us
I20260709 13:06:48.556731 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.543632 17456 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.542536 17436 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.550096 17377 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:48.553176 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:48.566219 17456 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.592867 17245 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:48.593974 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51456.9us
I20260709 13:06:48.594916 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:48.596166 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:48.596916 17262 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.597376 17262 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:48.597597 17453 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:06:48.597779 17262 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.598296 17425 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.600600 17425 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:48.600893 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 537104us
I20260709 13:06:48.601233 17425 raft_consensus.cc:2764] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:48.602474 17430 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:48.607014 17445 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:06:48.607141 15577 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:48.580560 17377 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.582754 17288 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.586586 17462 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.587584 17380 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.588786 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.591076 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.591483 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.564106 17244 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:48.594046 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.606835 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:48.582126 17458 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:06:48.584717 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51826.8us
I20260709 13:06:48.624503 15692 leader_election.cc:400] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:06:48.585948 17463 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.615715 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.617226 15650 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:48.620630 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:48.622853 15654 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:48.564574 17413 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.611595 17288 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.630858 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:48.631981 15653 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.633293 17251 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:48.633432 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.634326 15722 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:48.634840 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:48.635047 15650 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:48.635582 15649 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.636123 17466 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:48.621923 15646 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.638250 17394 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.639298 17447 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.463s	user 0.000s	sys 0.003s
I20260709 13:06:48.639839 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:48.642421 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.557363 17437 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:48.650339 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43602.8us
W20260709 13:06:48.654695 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 75309us
I20260709 13:06:48.657912 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:48.643371 17291 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:48.658738 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.655679 17390 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.650535 17251 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.662405 15723 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:48.663863 17450 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.465s	user 0.001s	sys 0.001s
I20260709 13:06:48.669420 17427 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:48.685171 15726 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:48.674435 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.675051 16236 leader_election.cc:400] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.674819 17462 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:48.675659 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51391.4us
I20260709 13:06:48.674000 15651 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:48.678435 17262 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.688848 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:48.690701 17262 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.681630 17456 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.653016 17288 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.692345 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.693011 17456 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.693409 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.693929 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.694142 15727 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:48.693974 17404 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.694784 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.695973 15721 raft_consensus.cc:2368] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.697039 15651 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.697675 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.674007 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:48.688453 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.698444 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.695035 17404 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:48.699303 17404 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.628391 17463 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:48.700106 17463 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.647634 17245 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.691016 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:48.694346 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.706360 16236 leader_election.cc:400] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.710060 17251 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.711288 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.701581 17462 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:48.700102 17384 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.713330 17427 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:48.725373 15729 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:48.713716 16269 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:48.715806 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:48.707733 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:48.721863 16277 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:48.724116 16235 leader_election.cc:400] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:48.732930 16235 leader_election.cc:403] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.687311 17425 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.730738 16270 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:48.731042 17245 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.731961 15649 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:48.725172 17394 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:48.736161 17244 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:48.738754 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.725028 17462 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.725240 17384 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:48.738003 17395 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:48.746292 17246 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:48.731743 17385 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.724000 17413 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:48.752799 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.729393 17262 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:48.759012 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:48.751149 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:48.770399 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 79486.8us
I20260709 13:06:48.757354 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.736894 16272 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:48.737874 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.772318 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.754136 17434 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:48.754422 17393 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
W20260709 13:06:48.776798 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 102911us
I20260709 13:06:48.747501 17259 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.781951 17434 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:48.782454 17434 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:48.782637 17393 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:48.783367 17434 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.784791 17434 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.785403 17390 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.786711 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:48.787401 15724 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.789772 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:48.790287 15726 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:48.793304 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.796756 17426 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.755681 17368 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.753782 17425 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:48.773542 17385 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:48.797214 17426 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:48.817704 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:48.818503 15647 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:48.818080 17426 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:48.822830 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:48.823139 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 68233.1us
I20260709 13:06:48.826184 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.826936 15729 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:48.826957 15580 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.793555 17384 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.828769 17384 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.834604 17437 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.819693 17368 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:48.835769 17462 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.836020 17368 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.836925 17404 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.837419 15580 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:48.819617 17385 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:48.838439 17462 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.839154 15724 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:48.839445 17288 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.807067 17390 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.845633 15543 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.854861 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:48.863147 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 109555us
I20260709 13:06:48.825219 17426 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.840036 15646 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:48.821445 15727 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:48.867367 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:48.868768 17289 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.882571 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:48.864915 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:48.871081 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 101973us
I20260709 13:06:48.833817 17463 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.885069 17241 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.901139 17241 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:48.901675 17241 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:48.902336 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 80931.6us
W20260709 13:06:48.911724 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 86648.8us
I20260709 13:06:48.904342 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:48.920238 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:48.893790 17245 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.922777 16276 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:48.922749 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.925879 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:48.844440 17380 consensus_queue.cc:1175] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: [3.3-3.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:48.893637 17289 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:48.877471 17377 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.901960 17359 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:48.930718 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:48.935141 17463 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.922852 17245 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.943302 17245 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.932325 17288 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.943164 17463 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.903857 17390 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:48.936892 17289 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:48.944169 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:48.955905 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:48.959717 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47201.1us
I20260709 13:06:48.960597 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:48.958685 15693 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.967422 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.930059 17437 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.935559 17377 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:48.980383 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:48.958329 17404 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:48.979737 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.004505 17394 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.008095 17241 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.009027 17245 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.009712 15693 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:48.924170 17425 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:48.973492 17289 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:48.964027 17407 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:48.976133 17463 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.040025 15573 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.021137 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:48.974862 17437 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:49.023104 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:48.985231 17413 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.040809 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:49.024438 17313 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.020716 17394 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:49.062211 15655 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.063318 15649 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:49.070276 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.047222 17437 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.081101 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.044147 17262 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:49.056219 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.072665 17384 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.073738 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:49.074122 17241 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:49.074409 17473 raft_consensus.cc:2764] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:49.074784 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.069661 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.075294 17251 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:49.075448 17480 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:06:49.076157 17482 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:49.052757 17313 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.076654 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.111907 17251 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:49.114085 17313 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.058581 17394 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.051366 17430 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.082424 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.047557 17413 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:49.116407 17413 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.051296 17463 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:49.053671 17477 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.088703 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.081600 17385 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.090621 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.091331 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.083606 17262 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:49.124297 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.126150 15653 raft_consensus.cc:2368] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:49.096364 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.126444 17430 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:49.127878 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.128578 15721 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.129427 17481 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:49.106523 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.087163 17462 raft_consensus.cc:2764] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:49.094427 15646 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:49.076699 17245 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:49.077540 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 60273.6us
I20260709 13:06:49.086138 17384 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:49.138491 15655 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.127525 17430 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:49.128858 17463 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.083904 17289 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:49.137688 15724 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:49.134243 17244 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:49.140053 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.140986 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.125839 17477 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:49.144466 17384 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.165045 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.126456 17262 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.187080 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.187912 15724 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:49.172067 17385 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:49.173230 17245 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:49.192634 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 107604us
I20260709 13:06:49.198226 17251 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:49.199273 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:49.200255 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.201587 15577 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.202422 16271 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.202812 15651 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.202294 17477 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.204497 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.208670 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.194258 17262 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.216387 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.216825 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.215865 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.212930 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.193892 17245 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.217171 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.216259 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.222936 15726 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:49.223345 15579 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.222535 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.224592 15651 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:49.226262 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.226950 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:49.227756 17425 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.228567 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:49.230285 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 59572.1us
I20260709 13:06:49.228159 16236 leader_election.cc:400] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:49.209980 17289 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:49.229800 15655 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:49.222698 17245 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.260226 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.223088 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.262519 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:49.266204 17487 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:06:49.261787 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.268013 15654 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:49.267244 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.267426 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.270831 16272 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:49.271248 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.271564 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.271939 15580 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:49.272795 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.272873 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.273161 15473 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 250) took 4944 ms. Trace:
I20260709 13:06:49.274477 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.274595 17394 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.275177 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.276121 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.276335 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.276643 17394 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:49.276818 16276 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.278527 15654 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.273850 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.267982 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.279637 15575 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:49.276896 15653 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.286329 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.285873 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:49.301198 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.299444 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.305572 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.306488 15571 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:49.307731 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.307848 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:49.309571 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.283349 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:49.312598 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.314160 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.314891 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.315760 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.316491 15654 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:49.317255 15655 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.317164 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.314963 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.319605 15575 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:49.325305 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.324947 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.332063 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.279544 15473 rpcz_store.cc:276] 0709 13:06:44.328209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.328359 (+   150us) service_pool.cc:224] Handling call
0709 13:06:49.272996 (+4944637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:47.885876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:47.999001 (+113125us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:47.999057 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:06:47.999086 (+    29us) tablet.cc:662] Decoding operations
0709 13:06:47.999597 (+   511us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:47.999715 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:47.999744 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:48.137758 (+138014us) tablet.cc:701] Row locks acquired
0709 13:06:48.137830 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:06:48.138067 (+   237us) write_op.cc:270] Start()
0709 13:06:48.138246 (+   179us) write_op.cc:276] Timestamp: P: 1783602408137984 usec, L: 0
0709 13:06:48.138294 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:06:48.150243 (+ 11949us) log.cc:844] Serialized 919 byte log entry
0709 13:06:48.478844 (+328601us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:06:48.717097 (+238253us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.869923 (+152826us) write_op.cc:301] APPLY: starting
0709 13:06:48.884075 (+ 14152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.898703 (+ 14628us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.898758 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.935438 (+ 36680us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.935757 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:48.935824 (+    67us) write_op.cc:312] APPLY: finished
0709 13:06:48.936110 (+   286us) log.cc:844] Serialized 29 byte log entry
0709 13:06:48.936323 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.936428 (+   105us) write_op.cc:454] Released schema lock
0709 13:06:48.936486 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.936856 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.936884 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":99671,"apply.run_cpu_time_us":2797,"apply.run_wall_time_us":89844,"num_ops":2,"prepare.queue_time_us":178110,"prepare.run_cpu_time_us":22030,"prepare.run_wall_time_us":392136,"raft.queue_time_us":110350,"raft.run_cpu_time_us":20531,"raft.run_wall_time_us":50870,"replication_time_us":578645,"spinlock_wait_cycles":99513728,"thread_start_us":243837,"threads_started":4,"wal-append.queue_time_us":90046}]]}
I20260709 13:06:49.337426 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.340356 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:49.343042 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.355155 15655 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:49.343853 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.346155 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.350040 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.355139 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.355402 15653 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:49.343587 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:49.359110 17394 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:49.359436 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.359620 17394 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:49.355247 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.360906 15575 raft_consensus.cc:2368] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:49.360293 16276 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:49.283396 17437 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.383104 15724 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:49.383306 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.388909 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.383733 15579 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:49.389302 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.391033 16277 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:49.392829 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.394662 15577 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.394832 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.397531 15575 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:49.401156 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.394480 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.412711 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.413627 16274 raft_consensus.cc:2368] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:49.353844 17262 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:49.418653 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.424533 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.424533 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.425072 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.415619 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:49.392776 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.428625 15573 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.429731 16277 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.428081 15729 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.435079 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.437979 15575 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:49.443840 15578 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.444732 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.449335 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:49.450409 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.451781 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.451938 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.452401 16269 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.416548 15721 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:06:49.457088 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:49.458650 17507 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:06:49.460079 17394 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.461125 16271 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:06:49.461099 17437 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:49.463028 17245 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:49.454684 17292 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.488933 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.489558 17292 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:49.490041 17292 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.490172 15721 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:49.467077 15654 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:49.465848 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55617.5us
I20260709 13:06:49.428071 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:49.472848 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.474974 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.439688 17241 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:06:49.476401 17392 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:49.471662 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.480194 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.447311 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.477432 17313 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:49.510447 15578 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.515048 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.473277 16271 pending_rounds.cc:85] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 2
I20260709 13:06:49.518010 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.518532 15577 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.518702 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.519456 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.524420 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.527859 15472 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 3, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.528848 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.530468 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.530855 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:49.531055 15573 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.531338 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.531622 15579 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:49.532088 15725 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:49.529742 15472 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.537420 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:49.537700 15576 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:49.509469 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:49.540809 16277 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:49.538189 15472 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.541988 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.542927 15726 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:49.543435 15572 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:06:49.546506 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 74952.2us
I20260709 13:06:49.547658 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:49.551332 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 356832us
I20260709 13:06:49.554884 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.550398 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:49.539026 16271 pending_rounds.cc:107] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:06:49.561615 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.542659 15472 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.489056 17498 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 13:06:49.579175 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.580407 17392 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:49.580789 15572 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.528868 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:49.550112 17481 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:49.592453 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45311.9us
I20260709 13:06:49.593253 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:49.593851 15726 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.560899 16271 raft_consensus.cc:2917] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:49.571100 17313 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:49.603953 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.604841 17292 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:49.540375 17462 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:06:49.606220 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54078.7us
I20260709 13:06:49.607820 15575 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.621299 17245 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:49.592139 17392 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:06:49.623728 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 76795.1us
I20260709 13:06:49.637619 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:49.617419 17413 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:06:49.602104 16272 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.592566 17481 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:49.618505 16271 raft_consensus.cc:2889] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.673332 17479 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.687700 15729 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:49.695760 15576 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:49.678601 17392 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:49.572255 15472 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.714666 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:49.715564 15653 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.701845 17429 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.655526 17413 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.733134 15576 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:49.758841 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 357087us
W20260709 13:06:49.768996 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3998709569999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:06:49.769477 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3791709569999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:06:49.773765 15648 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.792194 16269 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:49.790448 17407 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:49.798194 17407 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:49.799293 17407 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.801139 17407 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.790285 17416 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.719004 17481 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:49.805132 15649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.028s	sys 0.056s
W20260709 13:06:49.806131 15649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.029s	sys 0.056s
I20260709 13:06:49.774570 17390 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.821645 15726 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:06:49.823707 15574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.005s	sys 0.029s
W20260709 13:06:49.824158 15574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.005s	sys 0.029s
I20260709 13:06:49.825047 17377 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:49.825749 17377 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:49.769806 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2603709569999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:06:49.740036 17429 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:49.818897 17292 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:49.851631 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0560709569999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:06:49.867471 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0398709569999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:06:49.833693 15653 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:49.878412 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:49.827306 17289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.074s
W20260709 13:06:49.884594 17289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.019s	sys 0.074s
I20260709 13:06:49.885177 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:49.866616 17429 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.856276 17390 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.907750 15728 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:49.886247 17504 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.906220 17251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.003s	sys 0.035s
W20260709 13:06:49.916204 17510 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:49.899312 17511 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.910954 17262 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:49.939489 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54436.7us
I20260709 13:06:49.944000 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:49.945637 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:49.947461 16272 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:06:49.916702 17251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.003s	sys 0.035s
I20260709 13:06:49.913630 17359 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.955859 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 418518us
I20260709 13:06:49.946924 17244 raft_consensus.cc:2764] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:49.957067 17496 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.967262 15573 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
W20260709 13:06:49.968240 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 364365us
I20260709 13:06:49.969122 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:49.964779 17246 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.970420 17246 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:49.970829 17246 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.973059 17519 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.974602 17413 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:49.982399 15575 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:49.982826 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 468423us
I20260709 13:06:49.986189 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:49.994170 15543 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:49.999408 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:50.003479 17404 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.004470 17404 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:06:50.006402 17520 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:06:50.010133 17384 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.000s
I20260709 13:06:50.010645 17384 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.013224 17384 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:50.014110 15650 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:49.964094 17359 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:49.937638 17504 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:50.032011 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50062us
I20260709 13:06:50.035473 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:50.036252 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 487966us
W20260709 13:06:50.036849 17395 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.028s	sys 0.022s
W20260709 13:06:50.128044 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 92686.1us
I20260709 13:06:50.129163 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:50.028056 17245 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:50.133315 15577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.016s	sys 0.012s
W20260709 13:06:50.153553 15577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.012s
W20260709 13:06:50.136466 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 95432.9us
W20260709 13:06:50.123493 17395 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.028s	sys 0.022s
W20260709 13:06:50.151921 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 149737us
I20260709 13:06:50.041422 17288 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.005645 17404 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.266065 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:50.266640 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 111052us
I20260709 13:06:50.268687 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:50.269690 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.008s	sys 0.058s
W20260709 13:06:50.270080 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.058s
I20260709 13:06:50.269737 15651 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:50.270287 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:50.271155 16274 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:50.270473 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 646817us
W20260709 13:06:50.292403 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 654851us
I20260709 13:06:50.293408 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.216341 17241 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:50.302263 16276 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:50.308831 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:50.277714 17251 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.272617 17245 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:06:50.320510 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 256229us
W20260709 13:06:50.289322 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.025s
W20260709 13:06:50.344579 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.300424 17530 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.381717 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.335424 17262 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.378717 17430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.020s	sys 0.070s
I20260709 13:06:50.400346 16274 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:50.352465 15652 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.406335 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:50.344539 17536 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:50.380327 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.000s	sys 0.026s
I20260709 13:06:50.381336 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:06:50.410683 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71289.7us
W20260709 13:06:50.424626 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.380368 17511 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:50.381371 17530 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:50.297142 17522 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:06:50.402850 17430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.021s	sys 0.070s
I20260709 13:06:50.158915 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:50.476022 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:50.401883 17392 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:50.482892 15472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.036s	sys 0.028s
W20260709 13:06:50.415899 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.025s	sys 0.057s
I20260709 13:06:50.313915 17523 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 13:06:50.484359 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58608.6us
W20260709 13:06:50.486766 15472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.036s	sys 0.028s
W20260709 13:06:50.488179 16237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.022s	sys 0.044s
W20260709 13:06:50.495703 16237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.022s	sys 0.044s
I20260709 13:06:50.498163 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:50.404317 17262 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:50.509191 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 213162us
I20260709 13:06:50.511967 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:50.486164 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.025s	sys 0.057s
I20260709 13:06:50.437441 17530 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.484968 17531 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:50.504359 16273 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:06:50.503960 17407 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.005s
W20260709 13:06:50.549597 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61599.8us
I20260709 13:06:50.515821 17430 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:50.539758 17246 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:06:50.519840 17527 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.553406 17515 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.511s	user 0.000s	sys 0.001s
I20260709 13:06:50.501201 17392 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.543174 17359 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:50.573096 17467 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.546137 17504 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:50.494270 17245 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.557550 17430 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:50.578361 17537 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:06:50.578176 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 66284.3us
I20260709 13:06:50.582078 17556 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.582685 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:06:50.586242 17532 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:06:50.586997 17541 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:50.587642 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 365) took 1507 ms. Trace:
I20260709 13:06:50.588080 15646 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:50.588837 17513 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:06:50.595091 17437 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.606761 17392 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:50.608208 17542 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
I20260709 13:06:50.578756 17467 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:50.611747 17262 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:50.617228 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:50.626217 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 139639us
W20260709 13:06:50.581458 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92524.4us
I20260709 13:06:50.569031 17511 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:50.617429 17429 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.000s
I20260709 13:06:50.568003 17246 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.617009 17430 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.556851 17531 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.618331 17556 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:50.651929 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.651086 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:50.624683 15722 rpcz_store.cc:276] 0709 13:06:49.080546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.082992 (+  2446us) service_pool.cc:224] Handling call
0709 13:06:49.086761 (+  3769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.108118 (+ 21357us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:49.108511 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.587008 (+1478497us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18003d2e20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287
0709 13:06:50.587139 (+   131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:50.587204 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:50.587280 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.587363 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.587530 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31008,"prepare.queue_time_us":237,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":387071,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":14056,"spinlock_wait_cycles":3061504,"thread_start_us":431219,"threads_started":2,"wal-append.queue_time_us":52656,"wal-append.run_cpu_time_us":1427,"wal-append.run_wall_time_us":1003356}
W20260709 13:06:50.658588 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 248535us
I20260709 13:06:50.660498 17429 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:50.676280 17429 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:50.676968 15654 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:50.678519 17525 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:06:50.679914 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1447) took 1397 ms. Trace:
I20260709 13:06:50.680335 15577 rpcz_store.cc:276] 0709 13:06:49.282457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.541994 (+259537us) service_pool.cc:224] Handling call
0709 13:06:49.570737 (+ 28743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.572928 (+  2191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.572957 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.581695 (+  8738us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.154045 (+572350us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:50.154089 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.154155 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.679685 (+525530us) raft_consensus.cc:1685] finished
0709 13:06:50.679705 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.679836 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1834,"raft.queue_time_us":21276,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":1702,"spinlock_wait_cycles":9088,"thread_start_us":550207,"threads_started":1,"wal-append.queue_time_us":882401}
I20260709 13:06:50.649839 17468 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:50.684257 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 332) took 1596 ms. Trace:
I20260709 13:06:50.684827 17468 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.685361 17468 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:50.684685 15649 rpcz_store.cc:276] 0709 13:06:49.087725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.118626 (+ 30901us) service_pool.cc:224] Handling call
0709 13:06:49.131218 (+ 12592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.146998 (+ 15780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.147035 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.156230 (+  9195us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.807466 (+651236us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.807524 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.807616 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.684019 (+876403us) raft_consensus.cc:1685] finished
0709 13:06:50.684045 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.684176 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6647,"raft.queue_time_us":8879,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14654,"thread_start_us":639767,"threads_started":1,"wal-append.queue_time_us":818774}
I20260709 13:06:50.686395 17468 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.687700 17468 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.690065 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.637392 17437 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:50.572533 17527 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.653847 17467 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.673943 17288 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.696056 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:50.696921 17437 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.697934 17437 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.703594 17246 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:50.694885 15726 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.695277 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:50.694111 17547 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:50.707000 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55146us
I20260709 13:06:50.707330 17547 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:50.707747 17385 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.708293 17547 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.710548 17527 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:50.711609 16269 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:50.666744 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 323) took 1782 ms. Trace:
I20260709 13:06:50.695722 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:50.666947 16275 raft_consensus.cc:2410] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:50.707862 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.714524 15649 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:50.692785 17556 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.721964 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.728542 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:50.729441 15649 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:50.738214 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 590) took 1365 ms. Trace:
I20260709 13:06:50.738698 16275 rpcz_store.cc:276] 0709 13:06:49.363403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.384666 (+ 21263us) service_pool.cc:224] Handling call
0709 13:06:50.582523 (+1197857us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:50.728271 (+145748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29930368}
I20260709 13:06:50.716073 17530 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.744393 17530 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:50.741076 17467 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:50.726060 17456 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.752213 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1449) took 1364 ms. Trace:
I20260709 13:06:50.728355 17504 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:50.764039 17504 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:50.764492 17504 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.765151 17531 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:50.752821 15572 rpcz_store.cc:276] 0709 13:06:49.387936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.612128 (+224192us) service_pool.cc:224] Handling call
0709 13:06:49.612559 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.618252 (+  5693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.618298 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.620642 (+  2344us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.596963 (+976321us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18000b6aa0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:06:50.655217 (+ 58254us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:50.655257 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.655325 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.748419 (+ 93094us) raft_consensus.cc:1685] finished
0709 13:06:50.748447 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.752126 (+  3679us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5334,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4704,"spinlock_wait_cycles":3215104,"thread_start_us":58088,"threads_started":1,"wal-append.queue_time_us":1114579}
W20260709 13:06:50.767450 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45564.5us
I20260709 13:06:50.767452 15692 leader_election.cc:400] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:50.768146 15692 leader_election.cc:403] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.768342 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.768765 17395 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:50.769865 17533 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.771605 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:50.771885 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:50.725772 17262 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:50.774283 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:50.775583 17467 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:50.785508 17543 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:06:50.775767 15652 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.789044 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:50.789538 17529 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.452s	user 0.000s	sys 0.002s
I20260709 13:06:50.789601 17531 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.799504 17473 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:50.800459 17288 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:50.799047 17547 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.842077 17547 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.800729 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.801185 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:50.802313 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1435) took 1360 ms. Trace:
I20260709 13:06:50.803107 17536 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.809157 17377 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:50.833052 17531 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.810669 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2047) took 1236 ms. Trace:
I20260709 13:06:50.860533 15728 rpcz_store.cc:276] 0709 13:06:49.574228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.591466 (+ 17238us) service_pool.cc:224] Handling call
0709 13:06:49.614651 (+ 23185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.913182 (+298531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.810342 (+897160us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54003becd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:50.810588 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655795584}
W20260709 13:06:50.826251 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.829526 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55331.4us
I20260709 13:06:50.837544 17473 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:50.843338 15575 rpcz_store.cc:276] 0709 13:06:49.442145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.621339 (+179194us) service_pool.cc:224] Handling call
0709 13:06:49.621581 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.982956 (+361375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.802003 (+819047us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540026c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:50.802233 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829347072}
I20260709 13:06:50.849076 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:50.827950 17479 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:50.850759 17538 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:50.831249 17530 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.859637 17467 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.848788 17291 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:50.712430 15574 rpcz_store.cc:276] 0709 13:06:48.877906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.879363 (+  1457us) service_pool.cc:224] Handling call
0709 13:06:48.925829 (+ 46466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.148483 (+222654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.160634 (+ 12151us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.189332 (+ 28698us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.824805 (+635473us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:49.824871 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.824993 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.651687 (+826694us) raft_consensus.cc:1685] finished
0709 13:06:50.651716 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.660320 (+  8604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":505,"raft.queue_time_us":12450,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":16689,"thread_start_us":765808,"threads_started":2,"wal-append.queue_time_us":784597}
I20260709 13:06:50.831899 15572 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:50.940970 17562 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.092s	user 0.004s	sys 0.001s
I20260709 13:06:50.941313 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:50.864925 16236 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.588s (SENT)
I20260709 13:06:50.848811 15577 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:50.989468 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:50.988504 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:50.893838 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:50.895130 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:50.891115 17538 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.862310 17531 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.043480 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:50.885035 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:50.901829 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:51.051283 17467 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.915566 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:51.052953 15576 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:51.054283 15576 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.914535 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:50.878750 17479 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.846287 17288 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:50.858387 17289 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:50.866942 17395 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:50.882202 17429 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:50.987102 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:50.943038 16278 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.990348 15577 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.895318 17547 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:50.998824 17533 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:50.944700 17513 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:50.984752 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:51.035061 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.998804 17539 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:51.006403 17262 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:51.001770 17473 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:51.038219 15573 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:51.036778 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 171868us
I20260709 13:06:51.047904 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1469) took 1348 ms. Trace:
I20260709 13:06:51.035681 15571 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.050457 15579 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:51.050848 17437 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:51.051826 15655 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:51.051924 17425 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.878948 17430 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.055581 15575 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:51.078316 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:51.084451 17567 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.004s
I20260709 13:06:51.037218 17538 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:51.036749 17504 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.152197 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2010) took 1838 ms. Trace:
I20260709 13:06:51.490881 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.557583 15728 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:51.492748 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.558799 15653 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
W20260709 13:06:51.560285 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.561249 16236 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.616s (SENT)
I20260709 13:06:51.559002 15723 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:51.565011 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.097208 17289 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.558740 15654 rpcz_store.cc:276] 0709 13:06:49.699921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.700062 (+   141us) service_pool.cc:224] Handling call
0709 13:06:49.700433 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.677439 (+977006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.047667 (+370228us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540035c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:51.047841 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245390208}
I20260709 13:06:51.557302 15648 rpcz_store.cc:276] 0709 13:06:49.314130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.320684 (+  6554us) service_pool.cc:224] Handling call
0709 13:06:49.347087 (+ 26403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.789309 (+442222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.151867 (+1362558us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54002e4354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:51.152110 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980644224}
I20260709 13:06:51.561820 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:51.045265 17527 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.056727 17526 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:51.616014 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.616289 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.153944 16273 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:51.616436 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:51.573282 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:51.446524 17570 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.463s	user 0.004s	sys 0.000s
I20260709 13:06:51.622991 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.097332 17511 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.526s
I20260709 13:06:51.626128 15729 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.557132 17425 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.460822 17467 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:51.703658 15577 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:06:51.712359 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:51.661870 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 88727.7us
I20260709 13:06:51.714267 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:51.210165 17528 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.563836 17462 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.570176 15574 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.191848 17377 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:51.569144 17289 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:51.102612 17556 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:51.675037 17380 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:51.725342 17531 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:06:51.724931 17377 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:51.725337 15651 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:51.725755 17528 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.725811 17531 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.727305 17377 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:51.727922 17528 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:51.728050 17531 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:51.718008 17430 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:51.675462 15647 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.616084 17473 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.662642 17526 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:51.681118 17538 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.718969 15720 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:51.616647 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.730396 17538 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.729369 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.617316 17468 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.618898 17512 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.616063 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.653537 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:51.572002 17437 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.571933 17262 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:51.661708 17498 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.324400 17498 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:51.834391 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:51.762156 15578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.081s	sys 0.155s
I20260709 13:06:51.751066 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:52.162544 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.009s
I20260709 13:06:52.324971 17522 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.334762 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.006s	sys 0.015s
I20260709 13:06:51.717286 17425 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:52.338985 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.693964 17504 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:52.106441 17539 raft_consensus.cc:670] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:52.334731 15578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.082s	sys 0.206s
I20260709 13:06:51.694576 17479 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.325533 17468 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.326611 15724 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:51.731248 17526 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:51.680958 15652 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.341239 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:52.189688 17245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.023s	sys 0.029s
W20260709 13:06:52.341835 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 590843us
I20260709 13:06:51.731930 17533 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.964660 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:52.344132 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.006s	sys 0.016s
W20260709 13:06:52.387773 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.006s	sys 0.016s
W20260709 13:06:51.946596 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.723551 17527 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.970085 17535 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.315726 17554 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:51.846601 15580 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:51.847028 17288 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.335340 17481 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.384764 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:51.969955 17519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.018s	sys 0.045s
W20260709 13:06:52.384351 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 267262us
I20260709 13:06:51.731321 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.406936 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.385605 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:52.388445 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.407858 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.344270 17473 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:52.398903 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 339) took 1704 ms. Trace:
W20260709 13:06:52.384425 17506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.018s	sys 0.028s
I20260709 13:06:51.724144 17467 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.425982 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.427740 17467 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.428267 17467 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.428908 17437 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.429482 17437 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:52.430178 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1483) took 1591 ms. Trace:
I20260709 13:06:52.429953 17437 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.430550 15653 rpcz_store.cc:276] 0709 13:06:50.838491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.618155 (+779664us) service_pool.cc:224] Handling call
0709 13:06:51.657955 (+ 39800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.429092 (+771137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.429120 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.429157 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:52.429189 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.429931 (+   742us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400369054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.429969 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.430123 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773052800}
I20260709 13:06:52.425563 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.432111 16276 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Advancing to term 3
I20260709 13:06:52.433019 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:52.390270 17539 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.343183 17522 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.434388 17539 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.435703 17522 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.436401 17539 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.437125 15721 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.402271 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:52.438397 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:52.439113 16277 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:52.409521 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1482) took 1582 ms. Trace:
I20260709 13:06:52.384423 17555 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.440039 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.440676 17555 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:52.440963 17506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.019s	sys 0.028s
I20260709 13:06:52.441164 17555 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.441664 17506 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.384697 17479 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.773633 17462 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.386373 17395 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.335083 17512 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.384562 16275 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:52.410048 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 848735us
W20260709 13:06:52.449754 16236 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.758s (SENT)
I20260709 13:06:52.450235 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.396517 17535 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.424057 15655 rpcz_store.cc:276] 0709 13:06:50.694399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.694583 (+   184us) service_pool.cc:224] Handling call
0709 13:06:50.708802 (+ 14219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.556427 (+847625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.398676 (+842249us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54002490d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.398841 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788123392}
I20260709 13:06:52.392969 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:52.385155 17245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.023s	sys 0.033s
W20260709 13:06:52.409194 17519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.024s	sys 0.059s
I20260709 13:06:52.391356 15725 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:52.446532 17377 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.458812 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:52.459936 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:52.446758 17429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.019s	sys 0.035s
I20260709 13:06:52.448884 17556 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.379575 17289 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:52.384253 17498 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.439905 15652 rpcz_store.cc:276] 0709 13:06:50.827274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.234750 (+407476us) service_pool.cc:224] Handling call
0709 13:06:51.652610 (+417860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.386640 (+734030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.406964 (+ 20324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.444844 15646 raft_consensus.cc:2368] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6.
I20260709 13:06:52.448076 17479 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:52.476413 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 135237us
I20260709 13:06:52.401430 17554 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.465690 17462 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.474006 15720 raft_consensus.cc:2376] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4. Re-sending same reply.
I20260709 13:06:52.471232 17522 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.447911 17473 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.485674 15544 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:52.479025 17429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.020s	sys 0.036s
I20260709 13:06:52.451889 17395 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.469918 15727 raft_consensus.cc:2376] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5. Re-sending same reply.
I20260709 13:06:52.480718 17512 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.483251 17467 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:52.488054 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 342) took 1715 ms (client timeout 1663 ms). Trace:
I20260709 13:06:52.486045 17437 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.489049 17498 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.501487 17468 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.502249 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:52.502451 16277 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:52.490479 17262 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.489876 17579 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.490767 17429 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:52.498778 17377 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.514798 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:52.508565 16276 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEARNER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:52.510314 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.502480 17395 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.519162 16277 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.500635 17555 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.504153 17580 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.507848 17527 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.510821 16270 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.526199 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:52.532660 17538 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.001s
I20260709 13:06:52.533363 15725 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:52.563814 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.609s (SENT) [suppressed 21 similar messages]
I20260709 13:06:52.503110 17512 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:52.498520 17467 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:52.571882 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67114.2us
I20260709 13:06:52.572883 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.540990 17377 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.574937 17581 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:52.499933 15646 rpcz_store.cc:269] 0709 13:06:50.772117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.775256 (+  3139us) service_pool.cc:224] Handling call
0709 13:06:51.964486 (+1189230us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:52.487412 (+522926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3663104}
I20260709 13:06:52.558960 17395 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.584034 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1464) took 3441 ms. Trace:
I20260709 13:06:52.584904 17581 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.585436 17582 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.565212 17580 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.567487 17527 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:52.568487 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 228792us
I20260709 13:06:52.596304 15650 rpcz_store.cc:276] 0709 13:06:49.136795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.136917 (+   122us) service_pool.cc:224] Handling call
0709 13:06:49.140767 (+  3850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.014618 (+873851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.577763 (+2563145us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400084b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.578072 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007997696}
I20260709 13:06:52.611207 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:52.618016 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54254.3us
W20260709 13:06:52.619166 16236 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.851s (SENT)
I20260709 13:06:52.619593 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.513652 17579 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.580593 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1475) took 1807 ms. Trace:
I20260709 13:06:52.582013 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:52.595321 17512 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.633545 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.584848 17535 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.634925 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 332) took 1831 ms. Trace:
I20260709 13:06:52.637794 15543 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:06:52.642299 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.931s (SENT)
W20260709 13:06:52.648113 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 222232us
I20260709 13:06:52.631400 17526 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.648837 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:52.641896 15578 rpcz_store.cc:276] 0709 13:06:50.803415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.803527 (+   112us) service_pool.cc:224] Handling call
0709 13:06:50.803876 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.804099 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:50.865433 (+ 61334us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.634255 (+1768822us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.634329 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:52.634398 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.634695 (+   297us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.634850 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238246,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":70298,"spinlock_wait_cycles":4785920,"thread_start_us":1829272,"threads_started":3,"wal-append.queue_time_us":1543569}
I20260709 13:06:52.637023 17522 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:52.655622 16236 leader_election.cc:336] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.989s (SENT)
I20260709 13:06:52.642462 16271 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.641320 17395 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:52.641779 17588 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:52.630919 17245 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:52.644220 17479 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:52.664664 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.057s (SENT)
I20260709 13:06:52.668143 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:52.669370 16236 leader_election.cc:336] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.058s (SENT)
W20260709 13:06:52.670219 16236 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.104s (SENT)
I20260709 13:06:52.671429 17579 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.671480 17437 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.672360 17395 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:06:52.672820 16236 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.158s (SENT)
W20260709 13:06:52.674386 16236 leader_election.cc:336] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.238s (SENT)
W20260709 13:06:52.678270 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44859.3us
I20260709 13:06:52.652993 17586 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:52.645610 15574 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:06:52.706539 16236 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.241s (SENT)
I20260709 13:06:52.708423 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.679451 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:52.680841 17580 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.663422 17498 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:52.695060 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 46230.7us
I20260709 13:06:52.695860 15693 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:52.690420 17581 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:52.715237 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 77581.3us
I20260709 13:06:52.663169 17554 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.663707 17473 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.638193 17429 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.677217 17526 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.635080 15647 rpcz_store.cc:276] 0709 13:06:50.773026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.774686 (+  1660us) service_pool.cc:224] Handling call
0709 13:06:50.775013 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.729341 (+954328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.566491 (+837150us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.575776 (+  9285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018896128}
I20260709 13:06:52.721971 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:52.723076 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 283097us
I20260709 13:06:52.723273 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.723862 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.727241 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.731149 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.731616 17595 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.734378 17535 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:52.728456 17584 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.737033 15647 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:52.737192 17395 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:52.711022 17590 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.716322 15574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1446) took 1814 ms (client timeout 1801 ms). Trace:
I20260709 13:06:52.702446 17586 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.738597 17512 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.739099 17512 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.739471 17512 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.740653 17586 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.741083 17477 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.741561 17477 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:52.675674 17588 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.742681 17477 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.744130 17588 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.744714 17588 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.745244 17477 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.745563 17535 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.728199 17581 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.746042 17425 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.741516 17547 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.719619 17526 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:52.747478 17526 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.747287 17547 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.748461 17425 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.728431 17473 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.746057 17535 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:52.751053 17535 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.752398 17535 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.752663 17554 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.753443 17554 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:52.755584 17585 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:52.756276 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2049) took 2357 ms. Trace:
I20260709 13:06:52.758415 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1505) took 2144 ms. Trace:
I20260709 13:06:52.758270 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.758832 15729 rpcz_store.cc:276] 0709 13:06:50.614313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.614474 (+   161us) service_pool.cc:224] Handling call
0709 13:06:50.614851 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.712011 (+1097160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.758170 (+1046159us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003be7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.758343 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325211392}
I20260709 13:06:52.759316 15647 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:52.761245 16278 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:52.756711 15726 rpcz_store.cc:276] 0709 13:06:50.398475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.398605 (+   130us) service_pool.cc:224] Handling call
0709 13:06:50.433173 (+ 34568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.705240 (+272067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.756002 (+2050762us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.756189 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601421696}
I20260709 13:06:52.762216 17530 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:52.762635 17530 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:52.763497 17530 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.765779 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.767932 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:52.768724 15647 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:52.738463 15574 rpcz_store.cc:269] 0709 13:06:50.898233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.984403 (+ 86170us) service_pool.cc:224] Handling call
0709 13:06:52.711863 (+1727460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.770447 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.771072 15650 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
W20260709 13:06:52.775455 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44432.8us
W20260709 13:06:52.775969 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.776281 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:52.777503 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:52.778110 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54929.8us
W20260709 13:06:52.779656 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.781418 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.777593 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.782332 15723 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:52.718539 17536 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:52.791028 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:52.727639 16236 leader_election.cc:336] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.703s (SENT)
I20260709 13:06:52.792309 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.794888 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.794914 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:52.811622 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.812281 15729 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:52.795835 17589 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.796005 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.796113 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:52.797410 17505 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:52.810415 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.825295 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.823612 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.826787 15729 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.826990 15579 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.828516 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.798889 17467 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:52.799769 17596 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.800441 17554 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.801551 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.784811 17588 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.805568 16271 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:52.808080 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:52.856325 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:52.809058 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 78056.1us
I20260709 13:06:52.810375 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.779742 17427 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.822800 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.823585 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.823788 17538 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.798061 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.825465 15650 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:52.831995 15572 raft_consensus.cc:2368] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6.
I20260709 13:06:52.833972 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:52.834996 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 107357us
W20260709 13:06:52.859459 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 135667us
I20260709 13:06:52.863351 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.863920 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.835994 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 343) took 1982 ms. Trace:
I20260709 13:06:52.865705 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.860497 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.867831 15653 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:06:52.845597 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 131190us
W20260709 13:06:52.868688 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 77747.6us
I20260709 13:06:52.851661 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.869169 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.849464 15723 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:52.824857 17505 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:52.833295 17245 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.848963 17498 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.876304 15649 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:52.848506 17288 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:52.868629 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:52.840071 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.849453 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:52.851330 17581 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:06:52.871209 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 385) took 1346 ms (client timeout 1769 ms). Trace:
I20260709 13:06:52.871587 15653 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:52.880743 16235 leader_election.cc:400] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6.
I20260709 13:06:52.881156 16235 leader_election.cc:403] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.855926 17377 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.845237 17385 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.874619 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.890663 15653 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:52.890947 15572 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:52.892184 15572 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.892241 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:52.864778 15654 rpcz_store.cc:276] 0709 13:06:50.853261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.621795 (+768534us) service_pool.cc:224] Handling call
0709 13:06:51.622254 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.466470 (+844216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.466524 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.467248 (+   724us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.643241 (+175993us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.643305 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.835455 (+192150us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400157554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.835518 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.835578 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:52.835602 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.835913 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2644,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5506,"spinlock_wait_cycles":1940527488,"thread_start_us":173594,"threads_started":1,"wal-append.queue_time_us":223848}
I20260709 13:06:52.879956 16276 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:52.845140 17526 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.857522 17579 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.880121 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:52.880595 15722 rpcz_store.cc:269] 0709 13:06:51.519197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.656612 (+137415us) service_pool.cc:224] Handling call
0709 13:06:52.807926 (+1151314us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:52.865434 (+ 57508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13804928}
I20260709 13:06:52.866696 15651 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:52.866675 17467 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.883749 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.884186 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:52.884506 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:52.887698 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.872994 17481 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:06:52.870275 17427 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.884215 15652 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:52.889266 16278 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:52.875715 17504 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:06:52.889674 17538 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.872920 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.896965 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:52.890558 17479 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6.
I20260709 13:06:52.898469 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.845410 17590 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:06:52.904428 15724 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:52.928117 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1517) took 1269 ms. Trace:
I20260709 13:06:52.872668 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:52.809033 17536 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.911136 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:52.911244 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.912355 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.900066 17437 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.888983 17377 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:52.954012 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55672.2us
I20260709 13:06:52.954946 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:52.956149 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.956208 17377 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:52.916272 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:52.871124 17580 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:06:52.902411 17436 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.850278 17414 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:52.919970 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.921439 16275 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:52.921674 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:52.908447 17555 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:06:52.922209 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 65975.2us
I20260709 13:06:52.916960 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1454) took 2021 ms. Trace:
I20260709 13:06:52.888906 17505 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:52.872284 17597 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.880849 17576 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.926308 17425 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:52.983415 15653 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.913465 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:52.928653 15724 rpcz_store.cc:276] 0709 13:06:51.658719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.438658 (+779939us) service_pool.cc:224] Handling call
0709 13:06:52.903921 (+465263us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:52.904100 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.927731 (+ 23631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.928039 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9012992}
I20260709 13:06:52.875604 17589 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:06:52.952270 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44423.5us
I20260709 13:06:52.911604 17579 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:52.963176 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46966.1us
I20260709 13:06:52.913565 15574 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:52.880077 17245 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.998787 17526 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.000645 17245 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.000802 17427 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:53.001125 17585 consensus_queue.cc:1175] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "680390d3f0884c91bf1f22ba914b438a" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:52.912458 17429 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.884276 17586 consensus_queue.cc:1059] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:52.855453 17587 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.884531 17498 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:52.918900 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:52.890141 17288 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.012228 17498 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.013376 15647 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:52.974066 15580 rpcz_store.cc:276] 0709 13:06:50.891373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.894374 (+  3001us) service_pool.cc:224] Handling call
0709 13:06:50.894664 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.395950 (+1501286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.891577 (+495627us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54000d52d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:52.912238 (+ 20661us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187937536}
I20260709 13:06:53.002556 17536 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.018780 17586 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.019450 17586 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:53.020627 17586 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.023332 15646 raft_consensus.cc:2410] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:53.024471 15653 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.897766 15572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:52.914103 17467 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:52.971391 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:53.026563 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55261.1us
I20260709 13:06:53.032346 17385 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:53.032913 17385 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:52.995178 17582 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.971073 17504 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.976112 15571 raft_consensus.cc:2410] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:52.968495 17595 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:52.977352 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 98951.5us
I20260709 13:06:52.930475 17538 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:52.958865 17437 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.949254 17583 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.986222 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:52.941321 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:52.995074 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.969161 17481 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.004426 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:52.970829 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 62332.9us
I20260709 13:06:53.004302 17505 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.051815 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 381) took 1533 ms. Trace:
W20260709 13:06:53.052264 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 111135us
I20260709 13:06:53.036460 17467 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:53.054008 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 157311us
I20260709 13:06:53.025734 17289 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.006561 17429 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.054729 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:53.056267 15728 rpcz_store.cc:276] 0709 13:06:51.518083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.661468 (+143385us) service_pool.cc:224] Handling call
0709 13:06:52.986071 (+1324603us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:53.051757 (+ 65686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13304704}
W20260709 13:06:53.057637 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 59701.1us
I20260709 13:06:53.060822 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:53.051303 17437 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.063323 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:53.066998 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.067864 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.068645 17600 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:53.052222 17538 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.050287 17589 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:53.081574 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:53.083434 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:53.075177 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:53.088761 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:53.051357 17535 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.048539 17504 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:53.051306 17536 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.066368 17427 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:53.094260 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.096141 16276 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:53.094497 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:53.094278 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:53.095135 16278 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.054399 17288 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:53.054526 17590 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.994699 17597 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.053774 17481 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:53.106539 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.058475 17586 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.059113 17414 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.111425 17414 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:53.111857 17414 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.113263 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:53.101567 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.114101 17590 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.114432 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:53.114799 16277 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:53.073015 17555 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:53.115568 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:53.033826 17385 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.064358 17429 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.095263 15580 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:53.062929 17245 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.133540 15728 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.074213 17477 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.080322 17522 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:53.101148 17584 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.103523 17425 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.110262 17481 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.100879 17587 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.207647 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:53.208287 15726 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:53.110553 17527 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:53.110280 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.118326 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.214674 15649 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:06:53.216002 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:53.103837 17536 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.055042 17512 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.096462 17498 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:53.096298 17583 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.098758 17504 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.134495 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.302183 16276 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:53.126839 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.190920 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.065318 17595 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:06:53.139216 15575 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:53.207413 17587 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.196772 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:53.309084 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 112385us
I20260709 13:06:53.200165 15653 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.200165 15728 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:06:53.203003 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:53.199373 17427 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:53.210014 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.102936 17535 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.212568 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:53.120841 15648 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:53.217566 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:53.225260 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:53.218528 15725 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:53.226864 16269 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:53.216948 17245 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.489081 17245 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.489621 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.490310 15648 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:53.491176 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.219455 15571 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:06:53.234683 17576 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.495193 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.495334 17576 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.126296 17288 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:06:53.236318 17289 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.237049 17481 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.498097 17289 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:53.499060 17289 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.237787 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.500268 15646 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:53.500234 17289 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.501581 15646 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:53.502774 15646 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:53.238489 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.503736 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.240935 17579 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:53.242686 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:53.242937 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:53.505257 15574 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:53.506599 17577 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.156154 17522 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:53.248334 15649 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:53.303902 16272 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:06:53.274132 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 145721us
W20260709 13:06:53.510730 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.511574 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.111851 17384 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:53.311005 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.215879 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.312443 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:53.551420 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 239072us
I20260709 13:06:53.210994 17425 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:53.196647 17526 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:06:53.310742 15728 pending_rounds.cc:85] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 2
W20260709 13:06:53.564723 15573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.011s
I20260709 13:06:53.564960 15728 pending_rounds.cc:107] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
W20260709 13:06:53.565096 15573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.011s
I20260709 13:06:53.196983 17377 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:06:53.216143 17590 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.441381 17527 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.260429 17385 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.441818 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 224323us
I20260709 13:06:53.419600 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:53.487267 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 531146us
I20260709 13:06:53.231659 17547 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:53.201922 17251 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:06:53.231918 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:53.513113 15544 connection.cc:256] RPC call timeout handler was delayed by -1.4790449039999203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:06:53.378770 17539 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.378556 17587 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.553429 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.556277 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 597) took 2661 ms (client timeout 1740 ms). Trace:
I20260709 13:06:53.563856 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:53.565258 15728 raft_consensus.cc:2917] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:06:53.497927 17603 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:53.507093 17577 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:53.654042 16236 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.579s (SENT)
I20260709 13:06:53.553931 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.667024 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:53.654505 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:53.655195 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:53.654256 15722 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:53.526712 17522 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.653753 17527 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.526957 17384 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:53.507680 15580 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.663102 15651 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:06:53.665999 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.668180 15728 raft_consensus.cc:2889] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.668519 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:53.672163 15692 leader_election.cc:400] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:06:53.629384 17605 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.673121 16274 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.626926 17530 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:53.659757 17473 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.910s	user 0.019s	sys 0.000s
I20260709 13:06:53.623075 17581 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:06:53.664044 17603 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:53.705763 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:53.707342 15692 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:53.664388 16275 rpcz_store.cc:269] 0709 13:06:50.894753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.895763 (+  1010us) service_pool.cc:224] Handling call
0709 13:06:53.556080 (+2660317us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:53.556203 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3059870976}
I20260709 13:06:53.677263 15652 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:53.671818 17288 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.674718 17527 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:53.745455 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 541794us
I20260709 13:06:53.678047 17595 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:53.787642 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.792054 17384 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.791985 16269 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:53.775513 17547 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.757596 17619 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.709652 17583 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.210s
I20260709 13:06:53.808338 17595 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:53.930013 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 224315us
W20260709 13:06:53.914672 17607 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 13:06:53.900015 17533 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:53.916383 17621 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:53.916947 17597 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.894389 17614 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.924010 17477 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.000s
I20260709 13:06:53.908128 17291 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.908519 17619 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:53.902696 17579 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:53.926092 17437 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.861s	user 0.004s	sys 0.004s
I20260709 13:06:53.913815 17245 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:53.928972 17547 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:53.900029 17384 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.966864 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:53.863479 17512 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:53.930543 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 223281us
I20260709 13:06:53.990748 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:53.993706 17616 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.995217 17616 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:53.931910 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:53.933854 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.002276 17620 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:06:54.002382 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.773168 17473 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.937242 17526 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.004717 17526 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.005147 17526 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.910333 17368 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:06:53.970371 17614 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.935439 17533 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:54.017792 17533 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.962461 17477 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.963244 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:54.019388 16271 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.962953 17291 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:53.964653 17437 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.023238 17437 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.023442 17436 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.023918 17436 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:54.024770 17436 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:54.004293 17538 consensus_meta.cc:287] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.000s
I20260709 13:06:53.954960 17535 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.030529 17538 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:53.932626 17595 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.032353 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1485) took 1180 ms. Trace:
I20260709 13:06:54.035125 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:54.034880 15655 rpcz_store.cc:276] 0709 13:06:52.851569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.861713 (+ 10144us) service_pool.cc:224] Handling call
0709 13:06:52.873366 (+ 11653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.873624 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.873653 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.880609 (+  6956us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.136149 (+255540us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.136185 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.136247 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.032136 (+895889us) raft_consensus.cc:1685] finished
0709 13:06:54.032154 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.032290 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":246029,"threads_started":1,"wal-append.queue_time_us":332299}
W20260709 13:06:54.036782 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.038465 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106697us
I20260709 13:06:54.039775 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:54.040414 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 310601us
I20260709 13:06:54.051026 15472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 367) took 6412 ms. Trace:
I20260709 13:06:53.807289 17425 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.057802 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:54.058306 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 88114.3us
I20260709 13:06:53.949311 17576 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:53.952890 17511 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:54.065791 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.961330 17536 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.073602 15572 raft_consensus.cc:606] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:54.142782 15572 raft_consensus.cc:614] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:54.074536 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:54.143635 15578 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.121114 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63392.9us
I20260709 13:06:54.145097 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:54.069149 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1461) took 1022 ms. Trace:
I20260709 13:06:54.023270 17291 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:54.121270 17586 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.999s	user 0.017s	sys 0.008s
I20260709 13:06:54.033959 17468 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:54.063318 17289 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.064057 17384 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:54.057071 17245 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:06:54.127887 17618 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:54.183727 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.015s	sys 0.070s
W20260709 13:06:54.174904 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 100480us
I20260709 13:06:54.064225 17535 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:54.136628 17414 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.024s	user 0.010s	sys 0.000s
I20260709 13:06:54.170869 17590 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.063460 17512 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:06:54.063140 17585 consensus_queue.cc:1059] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:06:54.123932 17436 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.188356 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.015s	sys 0.071s
I20260709 13:06:54.182238 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:54.135507 17511 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:54.176687 17289 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.385782 17467 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.386185 17289 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.192768 17245 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:54.193316 17617 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:54.054596 15472 rpcz_store.cc:276] 0709 13:06:47.639104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.639474 (+   370us) service_pool.cc:224] Handling call
0709 13:06:54.050823 (+6411349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.558787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.593051 (+ 34264us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.593086 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:50.593103 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:50.593751 (+   648us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.593808 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.593836 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:50.594386 (+   550us) tablet.cc:701] Row locks acquired
0709 13:06:50.594405 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:50.594538 (+   133us) write_op.cc:270] Start()
0709 13:06:50.594651 (+   113us) write_op.cc:276] Timestamp: P: 1783602410594491 usec, L: 0
0709 13:06:50.594673 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.595508 (+   835us) log.cc:844] Serialized 2147 byte log entry
0709 13:06:50.768667 (+173159us) op_driver.cc:464] REPLICATION: finished
0709 13:06:50.901846 (+133179us) write_op.cc:301] APPLY: starting
0709 13:06:50.939390 (+ 37544us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:50.941820 (+  2430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:50.941945 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:50.984233 (+ 42288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:50.984458 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:50.984503 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:50.984795 (+   292us) log.cc:844] Serialized 47 byte log entry
0709 13:06:50.989004 (+  4209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.989155 (+   151us) write_op.cc:454] Released schema lock
0709 13:06:50.989222 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.046722 (+ 57500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.046756 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":294,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":126960,"apply.run_cpu_time_us":13780,"apply.run_wall_time_us":144834,"num_ops":5,"prepare.queue_time_us":558298,"prepare.run_cpu_time_us":4742,"prepare.run_wall_time_us":96819,"raft.queue_time_us":63924,"raft.run_cpu_time_us":48064,"raft.run_wall_time_us":92255,"replication_time_us":173817,"thread_start_us":705204,"threads_started":4,"wal-append.queue_time_us":106852,"wal-append.run_cpu_time_us":23106,"wal-append.run_wall_time_us":1341118}]]}
I20260709 13:06:54.389760 17245 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.390190 17245 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:54.391103 17245 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.392376 17245 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.385710 17511 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.394688 17511 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.402124 17617 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:54.403203 17617 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.404337 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 340) took 1566 ms. Trace:
I20260709 13:06:54.404541 17617 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:54.410782 17527 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.004s
I20260709 13:06:54.332238 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 358) took 1245 ms. Trace:
W20260709 13:06:54.218338 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 564307us
W20260709 13:06:54.249145 17385 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.008s
I20260709 13:06:54.404860 15579 rpcz_store.cc:276] 0709 13:06:52.837849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.838445 (+   596us) service_pool.cc:224] Handling call
0709 13:06:52.838895 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.040775 (+201880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.040827 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.041430 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.136212 (+ 94782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.136268 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.403804 (+1267536us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002c6d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:54.403868 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.403928 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:54.403948 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.404257 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6754,"raft.queue_time_us":5377,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":40317,"spinlock_wait_cycles":376714496,"thread_start_us":77133,"threads_started":1,"wal-append.queue_time_us":164005}
W20260709 13:06:54.215425 15692 connection.cc:256] RPC call timeout handler was delayed by -1.6982871700000715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:06:54.254001 17614 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:54.211246 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.262486 17625 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:06:54.255748 17429 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.117s	user 0.006s	sys 0.014s
I20260709 13:06:54.258490 17626 raft_consensus.cc:1064] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:54.187199 17618 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:54.265731 17530 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.502s	user 0.001s	sys 0.007s
I20260709 13:06:54.149065 15571 rpcz_store.cc:276] 0709 13:06:53.046942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.495298 (+448356us) service_pool.cc:224] Handling call
0709 13:06:53.495669 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.496105 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.496135 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.496692 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.556349 (+ 59657us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.675672 (+119323us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.743656 (+ 67984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.787454 (+ 43798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.033686 (+246232us) raft_consensus.cc:1685] finished
0709 13:06:54.033705 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.069076 (+ 35371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24757,"prepare.queue_time_us":392672,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":28337,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":45335,"spinlock_wait_cycles":32204672,"thread_start_us":168537,"threads_started":2,"wal-append.queue_time_us":246473}
I20260709 13:06:54.466845 17614 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.177277 17468 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.467507 17614 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:54.253346 17505 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.191s	user 0.009s	sys 0.000s
W20260709 13:06:54.211838 17522 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.008s
I20260709 13:06:54.195502 17590 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:54.186177 17535 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:54.219646 17577 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.187726 17611 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.183382 17384 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:06:54.239580 17622 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:54.190945 17414 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.263996 17526 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.240289 17585 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.480034 17436 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.372453 17538 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:54.376773 17587 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.703s	user 0.002s	sys 0.002s
I20260709 13:06:54.382174 15578 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:06:54.385613 15580 consensus_meta.cc:287] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.004s
W20260709 13:06:54.387035 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 204915us
W20260709 13:06:54.412901 16236 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.626s (SENT)
W20260709 13:06:54.397758 17612 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.532s	user 0.000s	sys 0.012s
I20260709 13:06:54.434208 15728 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.508219 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:54.508689 15580 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:54.509289 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1456) took 1477 ms. Trace:
I20260709 13:06:54.509380 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:54.438474 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.420604 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:54.411258 17527 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.420039 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:06:54.432255 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3724871699999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:06:54.330904 17588 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:54.412595 15650 rpcz_store.cc:276] 0709 13:06:53.086366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.092613 (+  6247us) service_pool.cc:224] Handling call
0709 13:06:53.104844 (+ 12231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.486554 (+381710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.486599 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.550692 (+ 64093us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.033125 (+482433us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:54.033186 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.033306 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.331989 (+298683us) raft_consensus.cc:1685] finished
0709 13:06:54.332011 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.332166 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4790,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":700289,"threads_started":2,"wal-append.queue_time_us":510520}
W20260709 13:06:54.211949 16270 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.084s	user 0.022s	sys 0.013s
I20260709 13:06:54.467984 17498 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.468344 17584 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:54.471411 17603 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.476884 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:54.443594 17291 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.480132 15653 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.480960 15726 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.420997 17580 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.483812 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:54.524847 15649 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:54.425724 17619 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.473750 17618 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.482959 17590 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.483026 17535 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.444003 17583 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:06:54.554368 17481 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.533004 17588 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.557735 17628 raft_consensus.cc:1064] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
W20260709 13:06:54.558269 17628 raft_consensus.cc:1068] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Unable to promote non-voter 681370bcf39d46b189ec8e9a5957f93d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:54.486116 17384 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.558898 17619 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:54.559767 17619 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.560111 17619 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:54.485471 17611 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:54.560890 17611 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.560835 17626 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.501899 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:54.563243 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 150363us
W20260709 13:06:54.564163 16236 leader_election.cc:336] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.803s (SENT)
I20260709 13:06:54.564633 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:54.502069 15618 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:54.475739 17429 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:54.571369 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 69397.3us
I20260709 13:06:54.496541 17585 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:54.524801 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2887871700000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260709 13:06:54.509646 15580 rpcz_store.cc:276] 0709 13:06:53.031756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.218462 (+186706us) service_pool.cc:224] Handling call
0709 13:06:54.509224 (+1290762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:54.531754 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:54.510399 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 811) took 1388 ms. Trace:
I20260709 13:06:54.509984 15728 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:06:54.533437 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 113491us
I20260709 13:06:54.533785 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:54.492879 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:54.525316 17498 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:54.511267 17538 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.581000 15723 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:54.579844 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:54.532816 17291 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.510161 17587 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.538317 15726 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:54.482554 17522 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.566771 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:54.568717 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:54.510574 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 352) took 1448 ms. Trace:
I20260709 13:06:54.529238 17584 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:54.532788 17580 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.518582 17595 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.584960 15652 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:54.525663 16270 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:54.581523 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:54.570559 17504 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.185s	user 0.017s	sys 0.018s
I20260709 13:06:54.500386 17436 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.544091 17473 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.579813 15722 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.582934 17582 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:54.535823 17554 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.588460 15648 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.569479 17599 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:54.580324 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:54.575488 17633 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.581363 17481 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:54.618014 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:54.580399 16277 rpcz_store.cc:276] 0709 13:06:53.122150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.124124 (+  1974us) service_pool.cc:224] Handling call
0709 13:06:53.124491 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.124749 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.124785 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.125295 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.534331 (+409036us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.534379 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.534471 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.397032 (+862561us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:06:54.510110 (+113078us) raft_consensus.cc:1685] finished
0709 13:06:54.510130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.510321 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30616832,"thread_start_us":325339,"threads_started":1,"wal-append.queue_time_us":517479}
I20260709 13:06:54.575024 17603 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:54.621033 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:54.622524 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 53861.7us
I20260709 13:06:54.623885 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1454) took 1592 ms. Trace:
I20260709 13:06:54.603799 17467 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:54.627185 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47415.6us
I20260709 13:06:54.628577 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:54.839337 15651 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.629747 17291 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.843025 17535 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.843617 17429 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.844518 17526 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.835520 17605 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:54.845240 17436 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.845577 17527 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.845510 17605 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.846768 17585 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.847069 15651 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:54.847705 17605 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.643762 15722 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:06:54.630416 15647 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:54.848356 15647 pending_rounds.cc:85] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 4
I20260709 13:06:54.838577 17604 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.850194 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:54.633455 16270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 808) took 1559 ms (client timeout 1648 ms). Trace:
W20260709 13:06:54.851096 16270 rpcz_store.cc:269] 0709 13:06:53.074376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.081574 (+  7198us) service_pool.cc:224] Handling call
0709 13:06:54.633394 (+1551820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39808}
I20260709 13:06:54.633533 15650 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:54.839037 17467 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.852496 17384 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.853197 17467 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.853247 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:54.633813 17504 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.855769 17504 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.855692 17611 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.857008 17245 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.857601 17245 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.858517 15729 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.858577 17611 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.645440 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 796) took 2214 ms. Trace:
I20260709 13:06:54.860344 16274 rpcz_store.cc:276] 0709 13:06:52.431233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.444494 (+ 13261us) service_pool.cc:224] Handling call
0709 13:06:53.557022 (+1112528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.707065 (+150043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.643836 (+936771us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:54.645235 (+  1399us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400771ad0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:54.645359 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824495232}
I20260709 13:06:54.860785 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:54.618562 15574 rpcz_store.cc:276] 0709 13:06:53.062056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.505975 (+443919us) service_pool.cc:224] Handling call
0709 13:06:53.506330 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.506721 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.506752 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.507235 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.929558 (+422323us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:53.929606 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.929680 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.510306 (+580626us) raft_consensus.cc:1685] finished
0709 13:06:54.510332 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.510495 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6305,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":26701,"thread_start_us":404817,"threads_started":1,"wal-append.queue_time_us":557525}
W20260709 13:06:54.644129 17589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.527s	user 0.027s	sys 0.037s
I20260709 13:06:54.634254 17511 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.868389 17640 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.868860 17640 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.869163 17640 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.870673 17245 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.634557 15727 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.605254 17538 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.642376 17587 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.836328 17368 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.625195 17638 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:54.796463 17614 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.861340 17427 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:54.816259 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 236034us
I20260709 13:06:54.911852 17427 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.913404 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:54.914201 17611 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:54.914125 17638 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.915210 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:54.915740 17611 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.916462 17611 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.916738 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:54.815913 17481 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.918470 17384 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.918995 17481 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.818086 17414 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.697731 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 359) took 1611 ms. Trace:
I20260709 13:06:54.634852 15720 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:54.819314 17590 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.920075 17467 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.922276 17590 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.719538 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2028) took 1559 ms. Trace:
I20260709 13:06:54.922976 17535 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.922942 15648 rpcz_store.cc:276] 0709 13:06:53.160224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.496010 (+335786us) service_pool.cc:224] Handling call
0709 13:06:53.496247 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.640218 (+1143971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.719198 (+ 78980us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002e2054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:54.719459 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511225216}
I20260709 13:06:54.682608 17473 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.924357 17473 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.925570 17640 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:54.926574 17473 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.927248 17473 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.927657 17473 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.927851 17640 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.928061 17473 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.929351 17617 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:54.929957 17617 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.930194 17511 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:54.930590 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.931375 17511 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:54.931764 17511 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:54.932145 17526 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.932229 17617 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.635710 17584 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.821864 17377 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.932608 17511 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:54.687017 15578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 351) took 1843 ms (client timeout 1924 ms). Trace:
I20260709 13:06:54.933933 17602 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.934263 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:54.934619 17602 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.935515 17522 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:54.834784 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 216867us
I20260709 13:06:54.937284 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:54.938566 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 102057us
I20260709 13:06:54.639439 16276 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:54.628448 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:54.835374 15573 rpcz_store.cc:276] 0709 13:06:53.031165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.032674 (+  1509us) service_pool.cc:224] Handling call
0709 13:06:53.033029 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.039141 (+  6112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.039174 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.039664 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.624272 (+584608us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.947317 (+323045us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.033754 (+ 86437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.033830 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.623593 (+589763us) raft_consensus.cc:1685] finished
0709 13:06:54.623622 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.623803 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85605,"prepare.queue_time_us":406518,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":114099,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":63598,"thread_start_us":810756,"threads_started":2,"wal-append.queue_time_us":993548}
I20260709 13:06:54.558921 17289 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:54.836095 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.848678 15647 pending_rounds.cc:107] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:54.632702 15652 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.663357 17596 raft_consensus.cc:1064] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:06:54.865183 15649 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.638301 17554 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.815433 17599 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:54.867792 17468 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.656615 17619 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:54.680231 17634 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.487s	user 0.000s	sys 0.002s
I20260709 13:06:54.675458 17586 raft_consensus.cc:3055] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:54.883729 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 262763us
I20260709 13:06:54.799888 17498 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:54.866285 17589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.759s	user 0.027s	sys 0.037s
I20260709 13:06:54.751756 17539 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:54.630144 17580 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.631645 17595 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:54.941999 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.045375 17589 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.045694 17619 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.046475 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.047372 17599 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.048486 17602 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.048545 17599 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:55.049911 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.050771 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:54.895913 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 158918us
I20260709 13:06:54.897203 17245 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.899057 15580 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.899439 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.052781 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 819) took 1117 ms. Trace:
I20260709 13:06:54.900589 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:54.803761 16278 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:54.905902 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.053146 16276 rpcz_store.cc:276] 0709 13:06:53.935160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.935293 (+   133us) service_pool.cc:224] Handling call
0709 13:06:55.052615 (+1117322us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54006306d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:55.052729 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544860416}
I20260709 13:06:54.901540 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:54.875166 17505 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:54.874904 17555 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.916528 17638 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.918566 17427 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.582779 17629 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.819193 17588 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:54.904312 17585 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.932766 17526 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:54.635203 17582 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:55.058962 17539 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:54.830303 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43846 (request call id 16) took 1932 ms. Trace:
W20260709 13:06:54.933637 15578 rpcz_store.cc:269] 0709 13:06:52.843738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.876213 (+ 32475us) service_pool.cc:224] Handling call
0709 13:06:54.686782 (+1810569us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:54.686940 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814096128}
W20260709 13:06:54.940536 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.076190 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:54.778065 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.089042 15580 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:55.089264 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.090174 15578 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:55.091132 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.091735 15575 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:55.092782 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.093375 15577 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:06:55.051527 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.016294 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 181592us
I20260709 13:06:54.944687 15724 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:54.906972 15571 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:54.909361 17538 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.052978 15579 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:55.035817 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.057301 17584 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.054489 15693 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:55.058324 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 815) took 1378 ms. Trace:
I20260709 13:06:55.047508 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:54.995651 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.942319 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.064810 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:54.942221 15655 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:55.066830 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 165395us
I20260709 13:06:54.919852 15654 rpcz_store.cc:276] 0709 13:06:53.086637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.087022 (+   385us) service_pool.cc:224] Handling call
0709 13:06:53.101618 (+ 14596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.814533 (+712915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.814562 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.931025 (+116463us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.066773 (+135748us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:54.066828 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.697215 (+630387us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002490d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:54.697282 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.697349 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:54.697371 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.697648 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3997,"raft.queue_time_us":147190,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14604,"spinlock_wait_cycles":637868800,"thread_start_us":535486,"threads_started":2,"wal-append.queue_time_us":100837}
I20260709 13:06:55.068487 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.066298 17580 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:55.071013 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 818) took 1136 ms. Trace:
I20260709 13:06:55.071272 17481 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.071483 17587 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.068959 17555 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.060153 17245 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:55.072687 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.051976 17611 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:55.049860 17586 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:55.052001 17547 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.073237 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:55.073572 17526 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:54.940632 15728 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:54.893435 17291 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.099560 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.074560 15572 rpcz_store.cc:276] 0709 13:06:52.897516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.897657 (+   141us) service_pool.cc:224] Handling call
0709 13:06:54.710476 (+1812819us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0d853 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691 00007f2d93f6160c 00007f2d93f608c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:54.830197 (+119721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410014592}
I20260709 13:06:55.108505 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.054276 17527 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.035498 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.016345 17590 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:06:55.109853 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.215090 17511 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.215478 15575 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:55.216426 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.216984 17245 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.217164 15577 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:55.217413 17635 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:55.217728 17414 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.217972 17635 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:55.218132 17414 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.218889 17414 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.218887 17635 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.220389 17414 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.221169 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:55.222079 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 167669us
I20260709 13:06:55.222332 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.222522 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.222797 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:55.223026 15571 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:55.223145 16273 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:55.223559 17585 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.111842 15720 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:55.223995 17585 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.224437 17585 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.224893 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.225425 15720 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.140648 16276 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.183084 15725 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:55.227442 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.228116 15721 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:55.114558 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.230072 15724 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:55.191967 17640 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.230825 15727 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:55.231391 17481 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:06:55.147586 16236 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.598s (SENT)
I20260709 13:06:55.232158 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:55.232317 17481 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.232839 15729 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.233218 16277 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.146445 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.231161 17640 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.235841 15576 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:54.996101 17615 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.168s
I20260709 13:06:54.903883 17368 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.237079 15723 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.237089 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.128496 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:55.238428 15722 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.230361 17580 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:55.266877 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 119319us
W20260709 13:06:55.268719 16236 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.609s (SENT)
I20260709 13:06:55.269043 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:55.269323 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:55.214612 16272 rpcz_store.cc:276] 0709 13:06:53.934573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.934707 (+   134us) service_pool.cc:224] Handling call
0709 13:06:53.970076 (+ 35369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.989365 (+ 19289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.989397 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.989897 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.054456 (+ 64559us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:54.054497 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.054580 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.679492 (+624912us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:06:55.058089 (+378597us) raft_consensus.cc:1685] finished
0709 13:06:55.058108 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.070949 (+ 12841us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20071,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":7506816,"thread_start_us":64131,"threads_started":1,"wal-append.queue_time_us":202490}
I20260709 13:06:55.060640 15647 raft_consensus.cc:2889] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.994529 17535 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.236002 16278 rpcz_store.cc:276] 0709 13:06:53.679859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.680109 (+   250us) service_pool.cc:224] Handling call
0709 13:06:53.706007 (+ 25898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.057300 (+1351293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.058101 (+   801us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400697654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:55.058260 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520685440}
W20260709 13:06:55.070413 17596 raft_consensus.cc:1068] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Unable to promote non-voter 681370bcf39d46b189ec8e9a5957f93d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:55.244035 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.033625 15472 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.272482 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:54.955664 17646 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.138652 17638 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:55.274296 17583 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.298316 17638 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:55.274259 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 75022.7us
I20260709 13:06:55.275687 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:55.299911 15654 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.271214 17648 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:55.300436 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:55.300571 17648 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.279611 17595 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:55.302371 17595 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.303470 17648 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.211189 17289 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:55.240332 17467 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.304600 17595 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.306164 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.310155 17535 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.208487 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.287807 15580 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:55.105453 17588 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.312736 15654 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:55.113189 17533 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:55.183126 17468 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.288038 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:55.169492 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.286415 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:55.274127 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 198107us
I20260709 13:06:55.289958 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:55.292599 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.654s (SENT)
I20260709 13:06:55.294513 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:55.275980 17539 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.296103 17582 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.295651 17586 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.299795 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.413483 16276 raft_consensus.cc:2376] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3. Re-sending same reply.
I20260709 13:06:55.301061 15571 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:55.192096 17644 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:55.311542 15619 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:55.273684 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 174289us
I20260709 13:06:55.321053 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.288107 15472 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 3, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.323825 15729 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:55.324851 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.312003 17641 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.262995 17538 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.289167 17429 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 13:06:55.332616 15573 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:55.333057 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:55.330727 16277 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:06:55.581503 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 290004us
I20260709 13:06:55.271667 17291 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.244275 17547 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.288869 17384 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:06:55.289045 17626 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.243s
I20260709 13:06:55.198913 17589 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.247882 17527 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.601420 15648 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:55.600384 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 267395us
I20260709 13:06:55.502555 15722 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:55.535158 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.479015 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:55.431667 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.568730 15723 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:55.285066 17614 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:06:55.323154 17629 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.635713 15654 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:55.505221 17539 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.576068 15576 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:55.535223 16236 leader_election.cc:336] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.663s (SENT)
I20260709 13:06:55.609926 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:55.639163 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 103966us
I20260709 13:06:55.639415 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:55.640214 16236 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.769s (SENT)
I20260709 13:06:55.640734 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:55.577410 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.641741 17291 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.642491 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.643127 15729 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:55.643653 17547 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.643925 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.644701 17640 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.581087 17644 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.644958 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.578528 15472 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.645926 17498 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:55.605439 17599 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
W20260709 13:06:55.462170 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.580104 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.110740 17522 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:06:55.631803 17582 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.646018 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.653944 15729 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:55.514453 16270 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:55.417757 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:55.651302 16274 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:55.649453 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:55.655279 15653 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:55.648716 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.653034 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:55.573343 17577 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.000s	sys 0.028s
W20260709 13:06:55.614784 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.630983 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.656381 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.640911 15722 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:55.661077 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.605103 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:55.574306 17586 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:55.666599 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61602.5us
W20260709 13:06:55.653885 17618 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.083s	user 0.012s	sys 0.000s
I20260709 13:06:55.587303 17467 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.670674 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:55.311128 17535 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:55.663837 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.604707 17533 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.587059 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.390318 17468 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.646934 15472 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 5, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:55.575582 17604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.059s	sys 0.153s
I20260709 13:06:55.652880 17583 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:55.652103 17522 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:55.651036 17585 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.667874 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.667065 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:55.600888 17635 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:55.671520 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:55.324819 17473 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.673161 15725 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:55.673290 17582 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.639393 17628 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:06:55.674114 17368 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:55.675674 17619 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.000s
I20260709 13:06:55.677237 15653 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:55.332038 17588 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:55.680536 17555 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.681095 17615 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:55.681656 17385 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.683032 17511 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.684092 15726 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:55.684149 17554 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:55.684295 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.686234 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.963095 17511 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:55.964085 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.670953 17646 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.964884 17588 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.965004 17646 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:55.965191 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.965559 17646 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.963130 17615 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.966406 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:55.966964 16272 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.966814 17615 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:55.967932 17385 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:55.968770 17385 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:55.969924 17385 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.771046 17527 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:55.693986 15720 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:55.973284 16277 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:55.975790 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 304322us
I20260709 13:06:55.976910 15651 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:55.589627 15727 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:55.588418 17538 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:55.977826 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 96948.3us
I20260709 13:06:55.989326 16272 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:55.990316 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.986089 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:55.690008 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:55.997468 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 307549us
I20260709 13:06:55.599912 17414 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.001041 15472 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.873037 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:55.874058 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.965466 17511 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:06:55.663492 17577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.000s	sys 0.028s
I20260709 13:06:56.015939 16277 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:06:56.059646 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 63396.8us
I20260709 13:06:55.646629 17644 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:56.041563 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.958994 17584 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.072913 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:55.710773 17626 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.937155 17289 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.083052 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:55.686111 17618 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:55.686959 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:56.083943 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 443720us
I20260709 13:06:56.084728 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:56.030985 17582 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.030786 17554 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.083938 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.094420 16272 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.980566 17368 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:56.009197 17604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.067s	sys 0.170s
W20260709 13:06:56.098063 15692 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.009s
I20260709 13:06:55.664042 17539 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.068990 15472 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.991937 17599 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:06:56.079092 17481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.012s	sys 0.019s
I20260709 13:06:56.118770 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.686319 17384 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:56.123771 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.110172 15692 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.010s	sys 0.009s
I20260709 13:06:56.108264 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:55.709782 17467 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.007663 17533 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.082655 17619 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.094084 16273 raft_consensus.cc:2393] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:06:56.145496 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 555138us
I20260709 13:06:56.086150 17414 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.006131 17635 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.150090 16277 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:55.880210 17505 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.265s
I20260709 13:06:56.153954 17618 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.157955 16271 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:56.214567 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 617) took 1019 ms. Trace:
I20260709 13:06:56.214929 16271 rpcz_store.cc:276] 0709 13:06:55.194856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.311415 (+116559us) service_pool.cc:224] Handling call
0709 13:06:55.685258 (+373843us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:56.214507 (+529249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89004800}
I20260709 13:06:56.216203 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:56.092253 17626 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.218309 17626 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.109978 17368 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.219025 17368 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.162263 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:06:56.220750 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 58546.6us
I20260709 13:06:56.221035 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.221985 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:56.223409 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:56.151322 17539 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:56.141402 17481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.014s	sys 0.022s
I20260709 13:06:56.109787 17425 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:56.157222 17646 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:56.251467 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.252013 17533 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.252113 15573 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:56.253017 17646 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.094195 17289 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.255858 17289 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:56.099500 17644 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.137495 17588 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:56.136927 17587 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.175454 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.168889 17384 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:56.099128 17582 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.269969 17582 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.270253 17538 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.270840 17547 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.187274 17468 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:56.183264 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.197489 17619 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.197553 15653 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.197888 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.198223 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:56.198343 15646 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.199157 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2063) took 1144 ms. Trace:
I20260709 13:06:56.244206 17629 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.205327 17655 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:56.205257 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.293888 16276 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 2: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:56.207752 17585 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:56.208837 17473 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.141106 17554 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:56.210501 17638 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:56.212090 17498 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
I20260709 13:06:56.226889 15579 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.227931 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:56.232964 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1508) took 1426 ms. Trace:
I20260709 13:06:56.225847 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.325948 15575 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:56.235517 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:56.239682 16272 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:56.327205 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 626) took 1129 ms. Trace:
W20260709 13:06:56.327504 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92059.9us
I20260709 13:06:56.327630 16272 rpcz_store.cc:276] 0709 13:06:55.197658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.991404 (+793746us) service_pool.cc:224] Handling call
0709 13:06:56.327133 (+335729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.247078 15648 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.246901 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.329375 15580 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:56.330471 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:56.295195 17377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.030s	sys 0.063s
I20260709 13:06:56.248457 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.250564 15650 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:56.336637 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 108801us
I20260709 13:06:56.337502 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:56.337697 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.250454 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.253055 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.260368 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 398) took 1019 ms. Trace:
I20260709 13:06:56.340466 17641 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.267606 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.268086 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 828) took 1156 ms. Trace:
W20260709 13:06:56.268558 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.260921 17658 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:56.182193 17414 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.245271 17522 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:56.204294 17649 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:56.277871 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.186605 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2042) took 1711 ms. Trace:
I20260709 13:06:56.189168 17635 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.336022 17638 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.244529 17633 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:56.287032 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:56.288522 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:56.250593 15721 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.246708 17662 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:56.246855 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.289559 15724 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:56.282570 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:56.290795 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.247684 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 830) took 1097 ms. Trace:
W20260709 13:06:56.296617 15578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.014s	sys 0.025s
W20260709 13:06:56.434484 15578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.014s	sys 0.025s
I20260709 13:06:56.261876 17644 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:06:56.303062 15655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.012s
I20260709 13:06:56.304116 15543 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:56.318926 15720 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:56.331375 15580 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:56.088774 17584 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.322738 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.441215 16276 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:06:56.441051 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 152594us
I20260709 13:06:56.324991 15651 rpcz_store.cc:276] 0709 13:06:54.806202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.849855 (+ 43653us) service_pool.cc:224] Handling call
0709 13:06:56.214015 (+1364160us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540017c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.232876 (+ 18861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564003712}
I20260709 13:06:56.441819 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:56.442423 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.332156 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.338575 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:56.339897 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.341820 15726 rpcz_store.cc:276] 0709 13:06:55.241427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.242286 (+   859us) service_pool.cc:224] Handling call
0709 13:06:55.324680 (+ 82394us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:56.260171 (+935491us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b5400003554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.260297 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216800896}
I20260709 13:06:56.251140 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.271705 17587 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.296176 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.263024 17425 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.452641 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.271327 17547 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.345006 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.346241 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.302567 17663 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:56.374876 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:56.460372 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 124736us
I20260709 13:06:56.455083 15575 raft_consensus.cc:2376] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4. Re-sending same reply.
I20260709 13:06:56.388568 17467 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:56.388873 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.340246 17377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.030s	sys 0.063s
I20260709 13:06:56.341850 15573 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:56.389215 16277 rpcz_store.cc:276] 0709 13:06:55.112174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.118378 (+1006204us) service_pool.cc:224] Handling call
0709 13:06:56.267880 (+149502us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b54002d5d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.268018 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19112192}
I20260709 13:06:56.390646 16274 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:56.271862 17588 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:56.357962 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.469857 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.333684 17603 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.396435 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.470752 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.332758 17527 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.427821 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.476001 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.343374 17629 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.434867 15722 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:56.342975 17604 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:56.444227 15576 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.444499 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.408561 17539 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.447563 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1481) took 1136 ms. Trace:
W20260709 13:06:56.448379 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 153325us
W20260709 13:06:56.449759 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 111271us
I20260709 13:06:56.443725 15579 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:56.458947 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.482366 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:56.465179 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:56.455780 15577 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:06:56.483840 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:56.438665 15646 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.480003 15578 rpcz_store.cc:276] 0709 13:06:55.310652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.310770 (+   118us) service_pool.cc:224] Handling call
0709 13:06:55.311078 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.311294 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:55.576273 (+264979us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.447127 (+870854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.447194 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:56.447258 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.447342 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.447495 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12164,"prepare.queue_time_us":340616,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":22610,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4724,"thread_start_us":1084456,"threads_started":2,"wal-append.queue_time_us":883214}
I20260709 13:06:56.432520 17669 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.394508 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 330283us
I20260709 13:06:56.472157 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:56.541180 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:56.396780 17658 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.471524 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.476457 15650 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:56.476611 15720 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:56.619529 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:56.476521 16278 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:06:56.621385 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.457446 17635 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:06:56.622557 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.385515 17384 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:56.625525 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 153440us
I20260709 13:06:56.438902 16273 rpcz_store.cc:276] 0709 13:06:55.148659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.312861 (+164202us) service_pool.cc:224] Handling call
0709 13:06:56.245763 (+932902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942912}
I20260709 13:06:56.488528 17583 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:56.457000 17522 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.468448 17468 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.432781 17554 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:56.466197 17648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.007s	sys 0.018s
I20260709 13:06:56.525701 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.482857 15655 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:56.673988 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.526397 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.683568 16272 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
W20260709 13:06:56.669344 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 183274us
I20260709 13:06:56.528635 15651 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:56.445544 17599 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:56.524616 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.688918 15578 raft_consensus.cc:2410] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:56.547966 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:56.545042 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:56.690271 15653 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:56.623473 16277 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:56.624117 15649 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.577991 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.624835 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:56.277906 15725 rpcz_store.cc:276] 0709 13:06:55.054787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.229952 (+175165us) service_pool.cc:224] Handling call
0709 13:06:55.665077 (+435125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.978475 (+313398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.198879 (+220404us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400106650. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.199078 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870180608}
I20260709 13:06:56.626368 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:56.449061 17662 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:56.478875 17629 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.578629 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.683358 15650 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:56.522782 16271 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.408411 15647 rpcz_store.cc:276] 0709 13:06:54.475473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.479670 (+  4197us) service_pool.cc:224] Handling call
0709 13:06:54.556958 (+ 77288us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:54.557159 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.316648 (+759489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.186242 (+869594us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b5400085a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:56.186521 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184090240}
I20260709 13:06:56.525342 15727 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:56.526142 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 43874.7us
I20260709 13:06:56.468477 17663 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.632620 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.473735 17533 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 13:06:56.580888 17674 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.577684 17619 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.429661 17633 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.579367 17616 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.696776 15729 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:56.696353 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.484793 17603 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:56.712520 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 87781.4us
I20260709 13:06:56.640873 17676 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:56.714896 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 88590us
W20260709 13:06:56.688759 17648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.007s	sys 0.018s
I20260709 13:06:56.632659 17291 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.722244 15720 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:56.720088 17535 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.488023 17527 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.684473 17583 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:56.689828 17685 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.709612 17629 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.695852 17468 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:56.522782 17604 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.751705 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:56.478422 17677 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.216s
W20260709 13:06:56.752283 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 287154us
I20260709 13:06:56.701581 17644 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.756099 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.790549 15723 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:56.676124 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.757324 15720 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:06:56.758817 17673 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:06:56.759570 17668 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:06:56.759694 15574 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:56.800187 15648 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:56.774492 17676 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.719697 17615 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:56.802237 17615 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.762478 15722 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
W20260709 13:06:56.802708 17667 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:06:56.802736 17615 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:56.727056 17619 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:56.806200 17584 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:56.806670 17619 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.627460 17669 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.807667 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1462) took 1906 ms. Trace:
I20260709 13:06:56.808682 17425 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.745008 17670 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.779172 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.809701 17670 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:56.809937 15727 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:56.810658 17670 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.745049 17674 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:56.720918 17641 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:56.757047 17505 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:56.768529 17661 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:06:56.718660 17368 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.794757 15720 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:56.761081 17535 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.759827 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:56.848724 15729 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:06:56.807699 17619 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.826592 15647 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:56.631062 17539 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.778574 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:56.784668 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:56.864856 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 80269us
I20260709 13:06:56.866181 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:56.866254 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.866925 15572 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:56.867385 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1463) took 1465 ms. Trace:
I20260709 13:06:56.851161 17535 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.808159 15574 rpcz_store.cc:276] 0709 13:06:54.901629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.479330 (+577701us) service_pool.cc:224] Handling call
0709 13:06:56.759216 (+1279886us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:56.759453 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.807353 (+ 47900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.807597 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8917760}
I20260709 13:06:56.721925 17522 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:56.863312 15578 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:56.855191 16270 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:56.867664 15572 rpcz_store.cc:276] 0709 13:06:55.401673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.865974 (+1464301us) service_pool.cc:224] Handling call
0709 13:06:56.867332 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.849753 17505 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:56.887164 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.887544 17505 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.887982 17674 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.888331 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:56.871728 17533 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:06:56.871614 17467 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.792235 17662 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.890671 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2062) took 1836 ms. Trace:
I20260709 13:06:56.891105 15721 rpcz_store.cc:276] 0709 13:06:55.054590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.229099 (+174509us) service_pool.cc:224] Handling call
0709 13:06:55.229363 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.433195 (+1203832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.890441 (+457246us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540039a654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:56.890614 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348254080}
I20260709 13:06:56.876061 17580 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.871666 17291 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.876832 17588 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.881493 17672 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.864445 17583 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.888459 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 614) took 1717 ms. Trace:
I20260709 13:06:56.889022 15572 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.877827 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2045) took 1268 ms. Trace:
I20260709 13:06:56.898466 16274 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:56.898499 15648 rpcz_store.cc:276] 0709 13:06:55.609368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.609623 (+   255us) service_pool.cc:224] Handling call
0709 13:06:56.877619 (+1267996us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002693d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.877754 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398227712}
I20260709 13:06:56.875052 17693 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.905150 17672 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:56.896198 17291 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:56.909076 17291 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.909560 17672 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:56.890700 16273 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:56.898198 16270 rpcz_store.cc:276] 0709 13:06:55.170672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.112324 (+941652us) service_pool.cc:224] Handling call
0709 13:06:56.888251 (+775927us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:56.888401 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804377984}
I20260709 13:06:56.911420 16273 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:56.910825 17527 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:56.912134 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 463) took 1805 ms. Trace:
I20260709 13:06:56.912541 16273 rpcz_store.cc:276] 0709 13:06:55.107189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.910829 (+1803640us) service_pool.cc:224] Handling call
0709 13:06:56.911206 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.911871 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.912077 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:56.846078 17676 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:56.846140 15576 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:56.870163 17587 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:56.869946 17468 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.003067 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:56.875039 17385 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.000s
I20260709 13:06:57.309404 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:06:57.310190 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.321916 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:56.978958 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 431064us
W20260709 13:06:56.937757 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 68967.9us
W20260709 13:06:56.981648 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 296827us
I20260709 13:06:57.329304 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1483) took 1114 ms. Trace:
I20260709 13:06:57.342576 15576 rpcz_store.cc:276] 0709 13:06:56.214848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.220526 (+  5678us) service_pool.cc:224] Handling call
0709 13:06:57.329248 (+1108722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.345541 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1519) took 1097 ms. Trace:
W20260709 13:06:57.331066 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.308784 15652 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.007s	user 0.019s	sys 0.001s
W20260709 13:06:57.351214 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.337275 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.049705 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.343665 16277 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:57.345820 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:56.919723 15572 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:06:56.896266 17427 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:56.970772 17688 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:06:57.320039 17680 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.465s	user 0.006s	sys 0.005s
I20260709 13:06:57.347856 15580 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.946715 17693 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:57.102519 17586 consensus_meta.cc:287] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.408s	user 0.008s	sys 0.004s
W20260709 13:06:56.981341 17289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.001s	sys 0.012s
W20260709 13:06:57.263872 15646 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.002s
W20260709 13:06:56.998245 17414 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
W20260709 13:06:56.916884 17582 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.002s
I20260709 13:06:56.896067 17678 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:57.472121 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.063663 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:56.914476 17663 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:06:57.103606 17604 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.996125 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.057516 17377 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:57.057407 17671 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.468132 17289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.002s	sys 0.023s
W20260709 13:06:57.353824 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 621) took 2157 ms (client timeout 2528 ms). Trace:
W20260709 13:06:57.507964 16278 rpcz_store.cc:269] 0709 13:06:55.196075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.093090 (+897015us) service_pool.cc:224] Handling call
0709 13:06:57.353668 (+1260578us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54005f1c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:57.353771 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757981056}
W20260709 13:06:57.355398 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.274294 17291 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.361429 15652 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:56.996968 16271 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:56.998994 17585 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:56.946980 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 610) took 1849 ms. Trace:
I20260709 13:06:57.350154 17587 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.001516 17539 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:56.968725 16273 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.262428 17535 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:57.373490 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.596026 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 836) took 1272 ms. Trace:
I20260709 13:06:57.481891 17427 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:57.480857 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:57.482191 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 140032us
I20260709 13:06:57.607757 15722 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:57.608573 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:57.375370 15619 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:57.515202 16235 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.924s (SENT)
W20260709 13:06:57.609593 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 94455.8us
I20260709 13:06:57.365377 15720 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:57.613068 15720 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:57.523012 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 468) took 2404 ms. Trace:
I20260709 13:06:57.613871 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:57.614063 16277 rpcz_store.cc:276] 0709 13:06:55.118262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.343122 (+2224860us) service_pool.cc:224] Handling call
0709 13:06:57.343446 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.522611 (+179165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.522935 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.615226 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.616067 16277 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEARNER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:06:57.433090 17522 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.387440 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:57.574954 15693 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:57.387562 17368 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:57.485221 17646 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.578677 17377 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:57.592521 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:57.577436 17585 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:57.350648 15653 rpcz_store.cc:276] 0709 13:06:56.248494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.697759 (+449265us) service_pool.cc:224] Handling call
0709 13:06:56.726989 (+ 29230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.727214 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:56.845797 (+118583us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.345230 (+499433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.345280 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:57.345324 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.345392 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.345492 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15970,"prepare.queue_time_us":293415,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":182663,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":22508,"thread_start_us":412218,"threads_started":2,"wal-append.queue_time_us":504200}
I20260709 13:06:57.596658 16276 rpcz_store.cc:276] 0709 13:06:56.323511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.477986 (+154475us) service_pool.cc:224] Handling call
0709 13:06:57.594467 (+1116481us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54006306d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:57.595924 (+  1457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771581312}
I20260709 13:06:57.500221 16269 raft_consensus.cc:2376] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3. Re-sending same reply.
I20260709 13:06:57.599257 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:57.647120 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72292.4us
I20260709 13:06:57.597628 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.648232 15572 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
W20260709 13:06:57.602633 17703 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:06:57.578177 15574 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:57.481995 17414 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:57.490209 17635 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.354933 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:57.653959 15724 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:57.484208 15646 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
W20260709 13:06:57.620577 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 245288us
I20260709 13:06:57.623262 17539 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:57.655543 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:57.650286 17586 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.622812 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.650049 17427 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.657375 17586 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:57.658198 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.659010 15651 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:57.629365 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 467) took 2521 ms. Trace:
W20260709 13:06:57.659348 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 630) took 1451 ms (client timeout 1776 ms). Trace:
I20260709 13:06:57.659775 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.620065 17587 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.111495 17615 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.488842 17582 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:57.630462 15577 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.641263 17658 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:57.642338 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:57.595235 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1513) took 1391 ms. Trace:
I20260709 13:06:57.633802 17385 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.631394 17377 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:57.682503 15577 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:57.598462 15580 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:57.625403 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.684273 15576 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:57.610177 17674 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:57.647828 15693 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:57.650415 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.624102 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.635535 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.630775 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.625131 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:57.490954 17678 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.656781 17619 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.657694 17427 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.661439 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:57.621078 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:57.562438 17583 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.751951 16277 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:57.665445 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.628790 17533 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.562275 17671 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:57.650700 17629 consensus_meta.cc:287] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.860s	user 0.005s	sys 0.006s
I20260709 13:06:57.625347 15648 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:57.643452 17697 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.670076 15722 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.600562 17535 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:57.767884 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.769084 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.769670 15648 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:06:57.660957 16269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 613) took 2536 ms (client timeout 1740 ms). Trace:
I20260709 13:06:57.675905 16270 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:57.630059 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.623565 17698 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:06:57.628480 17522 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.676856 17291 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:57.667167 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1521) took 1399 ms (client timeout 1813 ms). Trace:
I20260709 13:06:57.795562 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.664426 17577 raft_consensus.cc:2764] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:06:57.659828 16271 rpcz_store.cc:269] 0709 13:06:56.207905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.215920 (+  8015us) service_pool.cc:224] Handling call
0709 13:06:57.659173 (+1443253us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54005906d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:57.659289 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602617728}
I20260709 13:06:57.677040 17587 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:57.767504 17589 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.824756 17589 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.659547 16273 rpcz_store.cc:276] 0709 13:06:55.108120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.913579 (+1805459us) service_pool.cc:224] Handling call
0709 13:06:56.913924 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.620041 (+706117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.629298 (+  9257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.826217 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.827356 16273 raft_consensus.cc:2410] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:57.828454 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:57.739114 17585 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.830665 17585 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.830884 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:57.833280 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.766116 17583 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.835419 17678 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:57.589257 16275 rpcz_store.cc:276] 0709 13:06:55.097191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.109278 (+ 12087us) service_pool.cc:224] Handling call
0709 13:06:55.211418 (+102140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.347828 (+136410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.394155 (+ 46327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.453186 (+ 59031us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:55.481290 (+ 28104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.892548 (+1411258us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400541854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:56.896982 (+  4434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.916571 (+ 19589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247773440}
I20260709 13:06:57.832880 17589 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.836859 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.838932 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 616) took 2644 ms. Trace:
I20260709 13:06:57.839330 16275 rpcz_store.cc:276] 0709 13:06:55.194526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.837988 (+2643462us) service_pool.cc:224] Handling call
0709 13:06:57.838353 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.838552 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.838584 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.838635 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.838671 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.838741 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.838864 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.678362 17603 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:57.739530 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.667552 17694 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.842430 17694 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:57.629650 17646 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.841840 16276 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:57.847891 17646 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:57.782845 16269 rpcz_store.cc:269] 0709 13:06:55.118520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.503752 (+385232us) service_pool.cc:224] Handling call
0709 13:06:57.063496 (+1559744us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eeeee 0000000000375939 00007f2d9a9621e0 00007f2d9aa2b0c4 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:57.654618 (+591122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18201728}
I20260709 13:06:57.771054 17629 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.848490 16276 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:57.751926 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 130919us
I20260709 13:06:57.740227 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 357) took 1523 ms. Trace:
I20260709 13:06:57.852730 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 622) took 2656 ms. Trace:
I20260709 13:06:57.852981 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:57.755034 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.629397 17368 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:06:57.757220 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 95860us
W20260709 13:06:57.761303 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 113540us
I20260709 13:06:57.668968 17696 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.669330 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.678978 17385 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.670327 17539 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:57.676899 17547 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:57.678407 17693 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:57.752643 17619 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.786798 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.667280 17635 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.754477 17662 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.788702 15573 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:06:57.794483 15655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.023s	sys 0.031s
I20260709 13:06:57.758772 17554 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.758543 17533 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:06:57.677320 17702 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:06:57.796221 16278 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:06:57.769116 17700 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:57.798851 15647 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:57.671053 15652 rpcz_store.cc:276] 0709 13:06:56.197796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.197963 (+   167us) service_pool.cc:224] Handling call
0709 13:06:57.589410 (+1391447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.824777 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:57.850893 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 832) took 1621 ms. Trace:
I20260709 13:06:57.851984 16273 raft_consensus.cc:2368] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
W20260709 13:06:57.754581 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 129525us
I20260709 13:06:57.740279 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:57.983496 15580 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:57.660728 17672 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.752374 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:57.983870 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:57.984452 15577 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:57.756129 17674 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:57.957226 15655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.024s	sys 0.032s
I20260709 13:06:57.957646 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:57.960397 17385 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.853166 16276 rpcz_store.cc:276] 0709 13:06:55.196363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.847808 (+2651445us) service_pool.cc:224] Handling call
0709 13:06:57.848142 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.852478 (+  4336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.852674 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:57.870782 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.852849 15572 rpcz_store.cc:276] 0709 13:06:56.217119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.739229 (+1522110us) service_pool.cc:224] Handling call
0709 13:06:57.739612 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.739825 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.739860 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.739915 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.739963 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.740035 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.740163 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.797366 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:57.856171 16277 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:57.797816 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:57.967543 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 113203us
W20260709 13:06:57.969738 15693 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.130:44871 timed out after 2.244s (SENT) [suppressed 25 similar messages]
I20260709 13:06:57.763916 17658 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:57.973552 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.988883 16269 rpcz_store.cc:276] 0709 13:06:56.229342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.849511 (+1620169us) service_pool.cc:224] Handling call
0709 13:06:57.849839 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.850481 (+   642us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:57.850518 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.850569 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.850632 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.850708 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.850832 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.041759 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.977089 15722 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:06:57.985184 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:58.042805 17587 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.853878 17535 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.959270 17619 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.990468 15653 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:57.957918 15654 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:06:57.989352 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 833) took 1759 ms. Trace:
I20260709 13:06:58.047537 16278 rpcz_store.cc:276] 0709 13:06:56.229634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.967381 (+1737747us) service_pool.cc:224] Handling call
0709 13:06:57.988841 (+ 21460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.989034 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.989064 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.989101 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:57.989131 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.989179 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.989281 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:57.961956 17533 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:57.969273 17694 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:57.785403 17697 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:57.966121 17678 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:57.969532 17700 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.037897 17582 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.034461 17539 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.036870 17629 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:57.968417 17696 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.041819 17291 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:06:58.039781 17615 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.040432 17414 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.040616 17522 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:57.848663 17698 consensus_queue.cc:1243] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:57.962637 17671 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:57.990306 17672 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.058260 17583 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:57.963027 17662 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:57.979064 17644 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:06:58.046795 17535 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:58.044145 17658 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:06:57.796955 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 227717us
I20260709 13:06:58.040129 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 358) took 1822 ms. Trace:
I20260709 13:06:58.039101 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 361) took 1821 ms. Trace:
I20260709 13:06:58.038137 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:57.799124 15646 rpcz_store.cc:269] 0709 13:06:56.268112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.286759 (+ 18647us) service_pool.cc:224] Handling call
0709 13:06:57.664342 (+1377583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.040879 15648 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:58.038546 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:58.043084 15652 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.042452 16269 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEARNER]: Advancing to term 4
I20260709 13:06:58.058859 16271 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:06:58.296689 15578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 370) took 1887 ms (client timeout 2190 ms). Trace:
I20260709 13:06:58.446452 15653 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.402443 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:58.447860 15721 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:58.446753 15578 rpcz_store.cc:269] 0709 13:06:56.409556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.696084 (+286528us) service_pool.cc:224] Handling call
0709 13:06:58.296195 (+1600111us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400055354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:58.296495 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280521472}
I20260709 13:06:58.448470 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2070) took 1094 ms. Trace:
I20260709 13:06:58.448573 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:58.449036 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:58.448967 15721 rpcz_store.cc:276] 0709 13:06:57.354106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.374132 (+ 20026us) service_pool.cc:224] Handling call
0709 13:06:58.401970 (+1027838us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:58.448333 (+ 46363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12650240}
W20260709 13:06:58.292526 15571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1490) took 1829 ms (client timeout 1751 ms). Trace:
W20260709 13:06:58.450222 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.396447 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:58.392647 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.450780 15571 rpcz_store.cc:269] 0709 13:06:56.462654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.473843 (+ 11189us) service_pool.cc:224] Handling call
0709 13:06:58.291900 (+1818057us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54000c62d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:58.292223 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731632000}
I20260709 13:06:58.451611 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:58.451776 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:58.452811 16271 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:58.453778 15653 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:58.042418 16275 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.039893 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 835) took 1742 ms. Trace:
I20260709 13:06:58.449221 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.452255 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.414486 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 363) took 2149 ms. Trace:
I20260709 13:06:58.295579 15579 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.702064 17658 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.378091 15654 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:58.417269 15692 connection.cc:256] RPC call timeout handler was delayed by -1.4715939409999237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:06:58.063395 17681 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.205082 17533 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.702929 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 369) took 2312 ms. Trace:
I20260709 13:06:58.705184 15579 rpcz_store.cc:276] 0709 13:06:56.390405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.294672 (+1904267us) service_pool.cc:224] Handling call
0709 13:06:58.295161 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.702473 (+407312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.702826 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.085814 17628 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:58.706714 17628 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:58.706820 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:58.048293 17554 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.708077 15579 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.703722 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1525) took 1069 ms. Trace:
I20260709 13:06:58.511422 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:58.708865 15654 rpcz_store.cc:276] 0709 13:06:57.634579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.047954 (+413375us) service_pool.cc:224] Handling call
0709 13:06:58.377558 (+329604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.703399 (+325841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.703631 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.711167 17638 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:58.375223 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 362) took 3314 ms. Trace:
I20260709 13:06:58.111043 17589 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:58.713024 15649 rpcz_store.cc:276] 0709 13:06:55.061157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.286153 (+224996us) service_pool.cc:224] Handling call
0709 13:06:55.286413 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.703655 (+1417242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.374570 (+1670915us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400157554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:58.374993 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075916544}
I20260709 13:06:58.714953 15650 raft_consensus.cc:2368] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
I20260709 13:06:58.715415 15646 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.438510 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 367) took 2116 ms. Trace:
I20260709 13:06:58.716523 15574 rpcz_store.cc:276] 0709 13:06:56.321754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.284616 (+1962862us) service_pool.cc:224] Handling call
0709 13:06:58.285471 (+   855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.286511 (+  1040us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:58.286584 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.286681 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.286760 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.286875 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.438254 (+151379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":363090,"spinlock_wait_cycles":68224}
W20260709 13:06:58.356524 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 383632us
I20260709 13:06:58.155709 17674 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.708226 17554 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.715730 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 377) took 1034 ms. Trace:
I20260709 13:06:58.717290 17589 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:58.722473 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 267872us
I20260709 13:06:58.723765 17425 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:58.724378 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.013s	sys 0.031s
W20260709 13:06:58.452263 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.373157 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.306203 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 372) took 1490 ms (client timeout 1884 ms). Trace:
I20260709 13:06:58.717842 16277 rpcz_store.cc:276] 0709 13:06:56.297545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.995031 (+1697486us) service_pool.cc:224] Handling call
0709 13:06:58.039473 (+ 44442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.039628 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.039651 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.039686 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.039713 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.039760 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.039846 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.711619 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 840) took 1719 ms. Trace:
I20260709 13:06:58.727327 15649 rpcz_store.cc:276] 0709 13:06:57.680870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.714468 (+1033598us) service_pool.cc:224] Handling call
0709 13:06:58.715004 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.715353 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.715376 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.715444 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.715483 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.715541 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.715656 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.304555 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 368) took 1957 ms. Trace:
I20260709 13:06:58.718189 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2052) took 1094 ms. Trace:
I20260709 13:06:58.737766 16272 rpcz_store.cc:276] 0709 13:06:56.992221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.710188 (+1717967us) service_pool.cc:224] Handling call
0709 13:06:58.710742 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.711177 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.711205 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.711267 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.711311 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.711404 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.711536 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.703047 15693 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.002s	sys 0.009s
I20260709 13:06:58.738201 15575 rpcz_store.cc:276] 0709 13:06:56.347340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.293237 (+1945897us) service_pool.cc:224] Handling call
0709 13:06:58.293919 (+   682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.303899 (+  9980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.303940 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.304015 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.304057 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.304133 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.304296 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.441370 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:58.088025 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 831) took 1859 ms. Trace:
I20260709 13:06:58.454380 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:58.398638 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:58.718554 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:06:58.756971 15693 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.003s	sys 0.010s
I20260709 13:06:58.441515 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 464) took 3333 ms. Trace:
W20260709 13:06:58.736604 15573 rpcz_store.cc:269] 0709 13:06:56.816020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.005865 (+189845us) service_pool.cc:224] Handling call
0709 13:06:58.305707 (+1299842us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540026cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:58.305968 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035266944}
I20260709 13:06:58.399905 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:58.749059 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.013s	sys 0.031s
I20260709 13:06:58.726171 17511 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:58.735488 17425 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:58.775282 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1524) took 1148 ms. Trace:
I20260709 13:06:58.776894 17715 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.780836 17696 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:58.781950 15576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.005s	sys 0.019s
I20260709 13:06:58.782431 17681 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:58.783067 15578 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:58.783512 17662 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.050307 17427 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.784123 17535 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.803684 15576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.005s	sys 0.020s
W20260709 13:06:58.784651 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 746975us
W20260709 13:06:58.785230 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.012s
I20260709 13:06:58.785650 17603 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:58.786131 17522 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.786429 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.056651 17716 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:58.043454 17587 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:06:58.809501 15543 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:06:58.810271 15655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.015s	sys 0.026s
I20260709 13:06:58.809782 17587 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:58.810745 15655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.015s	sys 0.026s
I20260709 13:06:58.810490 16274 rpcz_store.cc:276] 0709 13:06:56.229030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.469584 (+240554us) service_pool.cc:224] Handling call
0709 13:06:58.087783 (+1618199us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54006982d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:58.087940 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984176896}
I20260709 13:06:58.811268 15543 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:58.702569 17697 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.218947 17619 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.816907 17619 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.817121 15653 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:58.817842 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1529) took 1162 ms. Trace:
I20260709 13:06:58.817963 17674 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.818497 17674 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.818378 15653 rpcz_store.cc:276] 0709 13:06:57.655807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.652941 (+997134us) service_pool.cc:224] Handling call
0709 13:06:58.765074 (+112133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.817571 (+ 52497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.817756 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.818964 17674 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.820312 15653 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:58.821008 17669 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:58.792133 17533 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:58.792972 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 823231us
I20260709 13:06:58.793524 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 620) took 3597 ms. Trace:
I20260709 13:06:58.817651 17635 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.736263 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 376) took 1041 ms. Trace:
I20260709 13:06:58.834996 15574 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.799849 15579 raft_consensus.cc:2410] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:58.796324 15580 rpcz_store.cc:276] 0709 13:06:56.237177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.033705 (+1796528us) service_pool.cc:224] Handling call
0709 13:06:58.038574 (+  4869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.038759 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.038787 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.038830 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.038864 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.038914 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.039023 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.798501 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.071607 17700 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.701195 15572 rpcz_store.cc:276] 0709 13:06:56.265248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.284498 (+2019250us) service_pool.cc:224] Handling call
0709 13:06:58.285471 (+   973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.286193 (+   722us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:58.286906 (+   713us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.413850 (+126944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.413907 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.413954 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.414161 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.414298 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":363709,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":29979,"raft.queue_time_us":272659,"spinlock_wait_cycles":21248,"thread_start_us":102951,"threads_started":1,"wal-append.queue_time_us":143383}
W20260709 13:06:58.801359 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54422.5us
I20260709 13:06:58.085373 17641 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.793988 17511 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:06:58.807874 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.000s	sys 0.012s
I20260709 13:06:58.740772 15647 rpcz_store.cc:276] 0709 13:06:57.623857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.038189 (+414332us) service_pool.cc:224] Handling call
0709 13:06:58.717779 (+679590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.847729 17427 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:58.848719 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 863595us
I20260709 13:06:58.849759 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:58.781422 15577 rpcz_store.cc:276] 0709 13:06:56.217351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.993941 (+1776590us) service_pool.cc:224] Handling call
0709 13:06:58.039703 (+ 45762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.039857 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.039880 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.039915 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.039947 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.039994 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.040082 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.851791 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:58.852115 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:58.853032 15577 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.853060 17728 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.805119 17603 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:58.854444 17729 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.855224 17603 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:58.830711 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.858539 15571 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:58.859740 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.861268 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.833549 17648 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.862311 17641 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.862618 17671 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.862337 17648 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:58.863387 16274 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:58.863420 17671 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.864207 17671 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.864594 17648 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.866482 17635 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.867314 17635 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:58.858551 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.869285 15580 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:58.122262 17385 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:58.870311 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.846930 15575 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:06:58.871161 15580 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:58.871719 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:58.871992 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.872537 15575 raft_consensus.cc:2376] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6. Re-sending same reply.
I20260709 13:06:58.872606 17385 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.872774 15580 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:06:58.873313 16269 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:58.873683 16269 pending_rounds.cc:85] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 2
I20260709 13:06:58.816931 17633 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:58.874511 15651 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:58.846947 17672 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.876854 15648 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:58.878517 17425 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.881141 17425 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.882295 17662 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:58.882661 17681 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.883278 17662 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:58.884270 17681 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.885249 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:58.708627 17628 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:58.813742 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.887126 17628 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.887671 17697 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:58.888402 16277 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.889081 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 473) took 1545 ms. Trace:
I20260709 13:06:58.835249 15646 rpcz_store.cc:276] 0709 13:06:57.675659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.713247 (+1037588us) service_pool.cc:224] Handling call
0709 13:06:58.714424 (+  1177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.716415 (+  1991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.716789 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.834378 15619 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:58.821798 17676 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.891274 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.891353 15543 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:58.873956 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.893430 15575 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:58.846973 17587 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:58.772318 16270 rpcz_store.cc:276] 0709 13:06:55.107438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.911524 (+1804086us) service_pool.cc:224] Handling call
0709 13:06:57.664716 (+753192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.787514 (+122798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.440890 (+653376us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54005906d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:58.441216 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721067264}
I20260709 13:06:58.795118 15652 rpcz_store.cc:276] 0709 13:06:57.626323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.042607 (+416284us) service_pool.cc:224] Handling call
0709 13:06:58.042902 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.767926 (+725024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.775093 (+  7167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.892714 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.896413 16270 pending_rounds.cc:85] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 5
I20260709 13:06:58.897101 16270 pending_rounds.cc:107] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 13:06:58.857793 17603 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.898337 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.899623 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 474) took 1555 ms. Trace:
I20260709 13:06:58.824543 16275 rpcz_store.cc:276] 0709 13:06:55.195762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.840418 (+2644656us) service_pool.cc:224] Handling call
0709 13:06:58.017627 (+177209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.792753 (+775126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.793285 (+   532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.899643 15572 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:58.900032 16274 rpcz_store.cc:276] 0709 13:06:57.344123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.842964 (+1498841us) service_pool.cc:224] Handling call
0709 13:06:58.863117 (+ 20153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.899379 (+ 36262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.899568 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.842448 15729 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:06:58.862836 17641 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.896482 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.894937 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.839654 15728 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:06:58.924505 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2072) took 1565 ms. Trace:
I20260709 13:06:58.851809 15649 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:58.866641 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1295939409999392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:06:58.923429 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.896559 17511 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.902189 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2074) took 1539 ms. Trace:
I20260709 13:06:58.889430 16277 rpcz_store.cc:276] 0709 13:06:57.343791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.841871 (+1498080us) service_pool.cc:224] Handling call
0709 13:06:58.888123 (+ 46252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.888829 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.889012 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.924892 15728 rpcz_store.cc:276] 0709 13:06:57.359255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.360304 (+  1049us) service_pool.cc:224] Handling call
0709 13:06:58.399444 (+1039140us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:58.924438 (+524994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36293504}
W20260709 13:06:58.925488 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1079939410000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:06:58.927732 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1079939410000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:06:58.928086 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1043939410000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:06:58.928140 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.865945 17648 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.873939 16269 pending_rounds.cc:107] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:58.936954 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.926016 15729 rpcz_store.cc:276] 0709 13:06:57.363096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.363441 (+   345us) service_pool.cc:224] Handling call
0709 13:06:58.398181 (+1034740us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:06:58.902131 (+503950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14216064}
W20260709 13:06:58.942472 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 501513us
I20260709 13:06:58.946506 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.950165 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.923020 15571 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:06:58.955108 15577 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:58.956907 17368 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.885309 17662 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.959121 17674 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:58.950042 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 115847us
I20260709 13:06:58.962767 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:58.965332 17635 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:58.966439 15575 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:58.967128 17427 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.968336 15575 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:58.969065 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 380) took 1535 ms. Trace:
I20260709 13:06:58.937968 16269 raft_consensus.cc:2889] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:58.969831 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.969452 15575 rpcz_store.cc:276] 0709 13:06:57.434218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.967335 (+1533117us) service_pool.cc:224] Handling call
0709 13:06:58.967858 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.968785 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.968983 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.957036 15571 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:58.970396 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 72238.3us
I20260709 13:06:58.902452 16270 raft_consensus.cc:2917] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 13:06:58.971527 15578 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:58.922262 17522 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.983801 15573 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
W20260709 13:06:58.984032 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.983932 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 98964.2us
W20260709 13:06:58.984753 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.985776 16274 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:58.985914 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:58.986256 17427 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.986685 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 482) took 1408 ms. Trace:
I20260709 13:06:58.986994 17427 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:58.987232 16274 rpcz_store.cc:276] 0709 13:06:57.578849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.939612 (+1360763us) service_pool.cc:224] Handling call
0709 13:06:58.985145 (+ 45533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.986366 (+  1221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.986626 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.988363 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:58.971802 15577 pending_rounds.cc:85] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 5
I20260709 13:06:58.991086 15577 pending_rounds.cc:107] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 13:06:58.995083 15577 raft_consensus.cc:2917] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
W20260709 13:06:58.998076 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.994511 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:58.971676 17385 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.971297 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 637) took 2497 ms. Trace:
I20260709 13:06:58.974232 17674 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:58.993537 17697 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:58.993804 17368 raft_consensus.cc:2764] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:58.989985 17427 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.022423 15580 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:59.024521 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 47144us
I20260709 13:06:59.008769 17385 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.026110 16274 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.027268 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.027765 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:59.028582 16274 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.028960 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.030369 17577 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.030897 17577 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.031296 17577 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:59.037469 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.038552 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.039857 15649 raft_consensus.cc:2410] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:59.040971 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.003041 17522 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.015434 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1468) took 2130 ms. Trace:
I20260709 13:06:59.008287 16269 rpcz_store.cc:276] 0709 13:06:56.474065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.042062 (+1567997us) service_pool.cc:224] Handling call
0709 13:06:58.042343 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.970936 (+928593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.971229 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.042737 15571 rpcz_store.cc:276] 0709 13:06:56.872416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.953460 (+2081044us) service_pool.cc:224] Handling call
0709 13:06:58.954007 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.990539 (+ 36532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.002358 (+ 11819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.026160 16235 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:06:59.045832 16235 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:59.046737 17587 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:59.047106 17587 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:06:59.047487 17587 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.047549 17658 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.050212 17522 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.050652 17522 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.056466 17698 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.057569 17698 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.060282 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1467) took 2192 ms. Trace:
I20260709 13:06:59.051072 17522 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.061048 15580 rpcz_store.cc:276] 0709 13:06:56.868399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.977481 (+2109082us) service_pool.cc:224] Handling call
0709 13:06:59.017772 (+ 40291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.059980 (+ 42208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.060211 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.020069 17554 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.070380 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.072538 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:58.970930 17700 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.049819 17658 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.041740 15649 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:06:59.018992 17697 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.054267 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.083110 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 837) took 2364 ms. Trace:
I20260709 13:06:59.061764 16275 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:59.026500 17385 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.066486 17511 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:59.099853 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.098414 15577 raft_consensus.cc:2889] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.073266 16270 raft_consensus.cc:2889] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:58.930054 17715 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.083834 17697 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.100374 17368 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.121930 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 375) took 1453 ms. Trace:
I20260709 13:06:59.123093 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.084623 16278 rpcz_store.cc:276] 0709 13:06:56.718207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.048445 (+1330238us) service_pool.cc:224] Handling call
0709 13:06:58.055351 (+  6906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.055562 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:58.512082 (+456520us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.991243 (+479161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.998997 (+  7754us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.019639 (+ 20642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.072128 (+ 52489us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.082935 (+ 10807us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":940010,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":9601,"raft.queue_time_us":47844,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":272,"thread_start_us":917659,"threads_started":3}
I20260709 13:06:59.134836 17705 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:06:59.138470 15721 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:06:59.140408 15722 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:59.141757 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.142221 17635 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:59.142855 15723 raft_consensus.cc:2410] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:59.144294 17635 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:59.145327 17635 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:59.145726 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63404.8us
I20260709 13:06:59.147015 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:59.148892 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.145713 17635 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:59.157454 15649 raft_consensus.cc:2393] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:59.087924 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.158968 17635 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.162645 17669 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.163305 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.164315 17676 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.164746 17676 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.165118 17676 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.167529 16271 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:59.098098 17427 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:59.170856 17427 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.172187 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.174041 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:59.175344 17658 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.175755 17658 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.176160 17658 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.176954 17662 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:59.178619 17736 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.179133 17736 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:59.178491 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:59.216034 17616 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.216074 16273 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:59.216604 17616 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:59.219269 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 839) took 2228 ms. Trace:
I20260709 13:06:59.220077 16273 rpcz_store.cc:276] 0709 13:06:56.990609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.089219 (+1098610us) service_pool.cc:224] Handling call
0709 13:06:58.089672 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.216868 (+1127196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.218839 (+  1971us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400697654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:59.219185 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589252992}
I20260709 13:06:59.134881 17724 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 13:06:59.226446 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.227317 15721 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:59.227566 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.253196 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.217722 17616 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:59.329257 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.330137 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.331342 17619 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.332793 17291 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.333258 17291 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:59.333889 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.334213 17533 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.334758 15653 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:59.332952 17619 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.334796 17533 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.333748 17291 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.380715 17616 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.382576 17733 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.383184 17733 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.383867 15723 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.385468 17724 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.386380 17724 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.399518 15729 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:59.340965 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.335839 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:59.376844 15722 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.448109 17586 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:59.449147 15653 raft_consensus.cc:2376] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6. Re-sending same reply.
W20260709 13:06:59.459158 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.180153 17736 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.478729 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.479522 15653 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:59.480585 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:59.480758 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 482483us
W20260709 13:06:59.481642 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.494251 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 333727us
I20260709 13:06:59.483705 17635 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.512238 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:59.514385 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 367592us
I20260709 13:06:59.519975 15653 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:06:59.521955 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.519935 15723 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:06:59.515002 17681 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.630s	user 0.021s	sys 0.039s
I20260709 13:06:59.519105 17554 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.539167 15729 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:59.539734 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.540275 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.543597 15722 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.544338 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:06:59.535753 17721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.002s	sys 0.015s
I20260709 13:06:59.531615 17705 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.556289 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1470) took 2659 ms. Trace:
W20260709 13:06:59.554224 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.560586 15577 rpcz_store.cc:276] 0709 13:06:56.896664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.971086 (+2074422us) service_pool.cc:224] Handling call
0709 13:06:58.971565 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.144435 (+172870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.144469 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.144903 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.525066 (+380163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.525098 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.525166 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.555962 (+ 30796us) raft_consensus.cc:1685] finished
0709 13:06:59.555989 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.556178 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":379770,"threads_started":1,"wal-append.queue_time_us":407911}
I20260709 13:06:59.564565 15618 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:06:59.566462 17603 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.668s	user 0.022s	sys 0.021s
I20260709 13:06:59.566620 17739 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:59.566814 17368 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:06:59.566951 17725 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.567281 17739 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.567471 17368 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.568854 17291 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.569456 17739 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.569687 17368 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.566336 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.535810 17698 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.551389 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 190508us
I20260709 13:06:59.536164 17700 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.577647 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.570989 17291 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:59.560218 17721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.002s	sys 0.016s
W20260709 13:06:59.547144 17672 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.008s
I20260709 13:06:59.554144 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 476) took 2209 ms. Trace:
I20260709 13:06:59.567605 17725 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:59.579524 15728 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:06:59.546722 17619 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.589725 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.591663 15729 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:06:59.559208 17704 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.593298 17589 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.594094 17587 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.015s
I20260709 13:06:59.583336 17533 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:59.593339 17742 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:06:59.599397 15721 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.602643 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.123073 15654 rpcz_store.cc:276] 0709 13:06:57.668512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.710762 (+1042250us) service_pool.cc:224] Handling call
0709 13:06:58.711224 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.711726 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:58.797294 (+ 85568us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.121487 (+324193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.121557 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.121611 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.121709 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.121860 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17137,"prepare.queue_time_us":155509,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":28545,"thread_start_us":255207,"threads_started":2}
W20260709 13:06:59.608083 15650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2055) took 1983 ms (client timeout 2303 ms). Trace:
W20260709 13:06:59.609788 17425 consensus_meta.cc:287] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.728s	user 0.014s	sys 0.011s
I20260709 13:06:59.562263 17715 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.540733 17385 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.625705 16274 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.014s
I20260709 13:06:59.621258 15723 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.629611 16274 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:06:59.626138 15722 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:06:59.622733 15650 rpcz_store.cc:269] 0709 13:06:57.624533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.769270 (+144737us) service_pool.cc:224] Handling call
0709 13:06:59.607841 (+1838571us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002e3454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:59.608007 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557481216}
I20260709 13:06:59.622146 15726 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:59.620364 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89683.5us
I20260709 13:06:59.628253 17670 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.592272 17733 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.634915 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:59.646405 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54461us
W20260709 13:06:59.645495 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.646975 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:59.647842 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.648275 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.649859 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.650242 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.634387 17368 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.655993 15653 raft_consensus.cc:2368] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
W20260709 13:06:59.647568 17511 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.537s	user 0.019s	sys 0.004s
I20260709 13:06:59.633360 17724 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.588029 17705 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.649755 17729 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.018s
I20260709 13:06:59.666208 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 834) took 3292 ms. Trace:
I20260709 13:06:59.636420 17704 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:06:59.658084 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.642133 17670 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:59.656879 15729 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:59.683493 17704 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.684001 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.684666 15729 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:06:59.685559 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.686152 17733 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:06:59.654665 17535 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.015s
I20260709 13:06:59.687678 17733 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:59.687840 17535 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.690241 15647 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:59.652313 17641 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.011s
I20260709 13:06:59.691222 17641 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.691432 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.692329 15721 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:59.693356 17641 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:59.694056 16277 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.694744 17535 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:06:59.650856 17671 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.783s	user 0.034s	sys 0.065s
I20260709 13:06:59.668756 17583 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:59.668067 16276 rpcz_store.cc:276] 0709 13:06:56.243717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.993167 (+1749450us) service_pool.cc:224] Handling call
0709 13:06:59.064213 (+1071046us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:06:59.064533 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.064921 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:59.121652 (+ 56731us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.535983 (+414331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.536036 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.536076 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.536136 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.536235 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13204,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3493,"raft.queue_time_us":5643,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":20700,"spinlock_wait_cycles":5194496,"thread_start_us":197495,"threads_started":2,"wal-append.queue_time_us":276054}
I20260709 13:06:59.658373 17539 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:59.696858 17539 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.697865 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:59.699064 17539 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.652509 17589 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.701140 17736 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.701272 17589 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.652427 17674 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:59.646708 17715 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.702404 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:59.702284 17715 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.702929 17726 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.835s	user 0.005s	sys 0.002s
I20260709 13:06:59.703089 15650 raft_consensus.cc:2376] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6. Re-sending same reply.
I20260709 13:06:59.704154 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.671173 17729 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.670619 17725 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:06:59.671801 15728 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:59.674872 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:59.715693 15646 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:59.666435 17368 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.716707 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:06:59.677533 15574 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.016s
W20260709 13:06:59.658914 17648 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.714s	user 0.023s	sys 0.014s
W20260709 13:06:59.678567 17658 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.018s
I20260709 13:06:59.678929 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:06:59.620046 17672 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:06:59.680181 17697 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.624672 17587 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.658850 17427 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:59.682436 17628 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.795s	user 0.025s	sys 0.038s
I20260709 13:06:59.681955 17619 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:59.666544 17681 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.710345 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 355) took 3493 ms. Trace:
I20260709 13:06:59.710768 17715 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.710646 17671 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.711122 17385 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:06:59.712872 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 69876.1us
I20260709 13:06:59.713841 15726 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:59.624792 17698 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:06:59.720093 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 60181.8us
I20260709 13:06:59.682014 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.592605 15577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:59.751139 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.725364 15646 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:59.759414 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:59.721832 16236 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.881s (SENT)
I20260709 13:06:59.738777 16276 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.720500 15574 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:06:59.757138 15723 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:06:59.757361 15575 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:59.776883 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1481) took 1359 ms. Trace:
I20260709 13:06:59.727423 15576 rpcz_store.cc:276] 0709 13:06:56.216613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.685074 (+1468461us) service_pool.cc:224] Handling call
0709 13:06:57.759733 (+ 74659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.956268 (+196535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.956353 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.956956 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.894480 (+937524us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.894534 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.057029 (+162495us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b5400292f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:59.057081 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.641400 (+584319us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:06:59.706100 (+ 64700us) raft_consensus.cc:1685] finished
0709 13:06:59.706120 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.710250 (+  4130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9035,"raft.queue_time_us":119058,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7634,"spinlock_wait_cycles":262883968,"thread_start_us":812879,"threads_started":1,"wal-append.queue_time_us":891736}
I20260709 13:06:59.602315 16270 rpcz_store.cc:276] 0709 13:06:57.344705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.895001 (+1550296us) service_pool.cc:224] Handling call
0709 13:06:58.895696 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.470870 (+575174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.470925 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.471598 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.553535 (+ 81937us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:59.553617 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.553759 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.553822 (+    63us) raft_consensus.cc:1685] finished
0709 13:06:59.553845 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.554056 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":81423,"threads_started":1,"wal-append.queue_time_us":79431}
I20260709 13:06:59.777231 15574 rpcz_store.cc:276] 0709 13:06:58.417390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.718087 (+300697us) service_pool.cc:224] Handling call
0709 13:06:59.776816 (+1058729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.764325 15646 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.777648 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:06:59.779831 17672 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:59.764905 17705 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.730474 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 479) took 2381 ms. Trace:
I20260709 13:06:59.768412 17697 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.769497 17368 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.721607 17658 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.775899 17587 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.751996 15577 raft_consensus.cc:606] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:59.783526 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:06:59.793555 15618 connection.cc:256] RPC call timeout handler was delayed by -3.007685904999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:06:59.794253 15618 connection.cc:256] RPC call timeout handler was delayed by -2.2984859049998931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2528s for a response
W20260709 13:06:59.794916 15618 connection.cc:256] RPC call timeout handler was delayed by -1.8662551339999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:06:59.795606 15618 connection.cc:256] RPC call timeout handler was delayed by -1.8631811249999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:06:59.796064 15618 connection.cc:256] RPC call timeout handler was delayed by -1.8060919709998871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
W20260709 13:06:59.796569 15618 connection.cc:256] RPC call timeout handler was delayed by -1.6918859049999355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32020000000000004s for a response
W20260709 13:06:59.759249 17522 consensus_meta.cc:287] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.014s
W20260709 13:06:59.792035 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 110105us
W20260709 13:06:59.784222 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 90591.3us
I20260709 13:06:59.797823 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:06:59.799280 15651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2051) took 2175 ms (client timeout 1943 ms). Trace:
I20260709 13:06:59.799727 17698 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:06:59.801219 17671 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:06:59.790246 16275 rpcz_store.cc:276] 0709 13:06:57.346948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.901251 (+1554303us) service_pool.cc:224] Handling call
0709 13:06:58.940958 (+ 39707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.100512 (+159554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.718177 (+617665us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b540053a054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:59.728183 (+ 10006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114493824}
W20260709 13:06:59.825350 15651 rpcz_store.cc:269] 0709 13:06:57.623612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.659540 (+ 35928us) service_pool.cc:224] Handling call
0709 13:06:59.799028 (+2139488us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400085054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:06:59.799183 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791033088}
I20260709 13:06:59.809361 15653 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:59.756856 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:06:59.810751 17577 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.779s	user 0.016s	sys 0.006s
I20260709 13:06:59.810930 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 843) took 1413 ms. Trace:
I20260709 13:06:59.754927 17681 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:06:59.812968 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.792961 17628 raft_consensus.cc:2764] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:59.819530 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1528) took 2168 ms. Trace:
I20260709 13:06:59.819845 17705 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:59.820482 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 65935.7us
I20260709 13:06:59.823673 15726 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
W20260709 13:06:59.823974 15618 connection.cc:256] RPC call timeout handler was delayed by -1.588225073999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:06:59.797361 15727 raft_consensus.cc:2368] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
W20260709 13:06:59.828827 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.819598 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:06:59.805285 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.814992 17658 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:06:59.839956 15648 rpcz_store.cc:276] 0709 13:06:57.651077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.452754 (+801677us) service_pool.cc:224] Handling call
0709 13:06:58.453297 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.877385 (+424088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.819169 (+941784us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540035cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:59.819410 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825167104}
W20260709 13:06:59.902418 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 188691us
I20260709 13:06:59.903436 15648 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:59.903606 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.924s (SENT)
I20260709 13:06:59.904065 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:06:59.895409 15720 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.905324 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.837762 16277 rpcz_store.cc:276] 0709 13:06:58.398170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.932791 (+534621us) service_pool.cc:224] Handling call
0709 13:06:58.954604 (+ 21813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.694447 (+739843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.810584 (+116137us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:06:59.810844 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700175104}
I20260709 13:06:59.891999 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:06:59.906379 15618 connection.cc:256] RPC call timeout handler was delayed by -1.5716383640000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:06:59.893558 15577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:06:59.907773 15577 raft_consensus.cc:606] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:59.908125 15577 raft_consensus.cc:614] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:59.895733 15619 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.901369 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.896593 15723 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:06:59.908885 15618 connection.cc:256] RPC call timeout handler was delayed by -1.547807665999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:06:59.909440 15618 connection.cc:256] RPC call timeout handler was delayed by -1.4958201739999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2716s for a response
I20260709 13:06:59.893929 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:59.910552 16278 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:06:59.911017 15618 connection.cc:256] RPC call timeout handler was delayed by -1.4356811249999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:06:59.911803 15618 connection.cc:256] RPC call timeout handler was delayed by -1.4164076659999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:06:59.907400 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:06:59.904026 17697 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:06:59.952379 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 110814us
I20260709 13:06:59.943148 15648 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:59.943833 15543 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:06:59.890376 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47975.8us
I20260709 13:06:59.955498 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:59.956467 15579 pending_rounds.cc:85] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 4
I20260709 13:06:59.945379 15724 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:06:59.830139 17522 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.959038 15579 pending_rounds.cc:107] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:59.958050 15728 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
I20260709 13:06:59.965710 15579 raft_consensus.cc:2889] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.956548 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:06:59.959715 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:06:59.959851 15571 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:59.959944 15619 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:06:59.960361 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56797.3us
I20260709 13:06:59.961827 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:59.964313 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.966701 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:59.972695 15576 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:59.973258 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 59379.1us
I20260709 13:06:59.974440 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:59.968650 16274 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:06:59.830363 17587 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.975028 15577 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.968802 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.840605 17715 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.840541 17672 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.889842 17705 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:06:59.840710 17577 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.976866 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:59.899509 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:06:59.838011 17535 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:06:59.983493 15619 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.978372 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:06:59.901079 16269 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:06:59.979636 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:06:59.974092 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:59.955984 17586 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:59.986743 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:59.986932 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:59.987579 15571 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.977211 17697 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.988206 17754 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:59.988358 17697 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:06:59.988667 17754 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.988895 16236 leader_election.cc:400] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:06:59.989073 17754 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.989326 16236 leader_election.cc:403] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.989662 15647 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:06:59.989840 17753 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.990145 17619 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.990399 17753 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:06:59.990504 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 171018us
I20260709 13:06:59.990975 17753 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.992496 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:06:59.981601 16277 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:59.966367 17635 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.993229 17635 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:06:59.993585 17635 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.993669 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:59.957790 17724 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.994815 17729 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.994645 17736 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:59.995726 17736 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:59.996083 17736 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:06:59.997488 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:06:59.997149 17736 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.955047 17648 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.987458 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:06:59.986572 17586 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:06:59.969005 17658 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.984452 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:06:59.981062 16272 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.008874 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:00.009909 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.006754 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1476) took 1705 ms. Trace:
I20260709 13:07:00.025460 15720 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:00.016166 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:00.002677 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1515) took 3767 ms. Trace:
W20260709 13:07:00.054136 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61703.2us
I20260709 13:07:00.054498 15575 rpcz_store.cc:276] 0709 13:06:58.301774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.990766 (+688992us) service_pool.cc:224] Handling call
0709 13:06:59.009894 (+ 19128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.777039 (+767145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.006494 (+229455us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54003f8ed4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:00.006678 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718666624}
I20260709 13:06:59.913384 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:00.060077 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.060672 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:00.031001 17715 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:00.063364 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.972534 17725 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:07:00.096984 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:00.098342 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.099038 15580 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:00.099732 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:00.100255 15580 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:00.101008 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.101475 15580 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.101369 15578 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:06:59.998497 17724 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:00.102837 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:00.102758 17724 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:00.104067 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.104781 15578 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.074697 15720 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:07:00.075353 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 91334.7us
W20260709 13:07:00.051440 17676 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.886s	user 0.040s	sys 0.017s
I20260709 13:06:59.979970 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:00.079049 17648 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.122546 17729 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:07:00.123448 17582 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.083042 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:00.124614 16274 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:59.998245 17385 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.075870 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:00.133023 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:00.133526 15650 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:00.011924 17533 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:00.086485 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.151448 15576 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:00.006126 17589 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.152613 17589 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:59.990696 17755 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:06:59.982765 15725 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:00.154934 17715 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:00.155968 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:00.156646 15725 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:06:59.983518 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:00.158985 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:00.159845 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:00.160169 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:00.160663 16269 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:00.010236 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:00.161640 15721 raft_consensus.cc:2410] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:00.164158 16270 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:00.165068 15727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2077) took 2786 ms (client timeout 2303 ms). Trace:
I20260709 13:07:00.092906 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:00.165482 15727 rpcz_store.cc:269] 0709 13:06:57.379078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.381642 (+  2564us) service_pool.cc:224] Handling call
0709 13:06:58.395761 (+1014119us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:00.164860 (+1769099us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540004b354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:00.164981 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004161024}
I20260709 13:07:00.165947 15647 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:00.079246 17368 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:00.093580 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 143458us
I20260709 13:07:00.169566 17619 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.093923 15571 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:00.094228 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 115943us
I20260709 13:07:00.170646 15571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:00.170746 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:00.152740 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.095098 17377 raft_consensus.cc:1064] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:07:00.171808 15576 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.123857 17582 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:00.172317 17368 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.172930 17368 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:00.173535 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 844) took 1704 ms (client timeout 1835 ms). Trace:
I20260709 13:07:00.173202 17582 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:00.092561 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:00.174705 15572 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.096282 17754 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.050894 17704 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.998131 17681 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:00.110039 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:06:59.989331 17697 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.118523 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:00.125402 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.065001 17427 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:00.124287 15651 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:00.128050 15578 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:00.073195 17468 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.124244 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:00.054224 15655 rpcz_store.cc:276] 0709 13:06:56.234991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.695727 (+460736us) service_pool.cc:224] Handling call
0709 13:06:57.006996 (+311269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.007197 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:57.143065 (+135868us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.811490 (+1668425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.811599 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.811736 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.811842 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.002493 (+1190651us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400156150. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:00.002613 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13510,"prepare.queue_time_us":74172,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":719163,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":319,"spinlock_wait_cycles":642189184,"thread_start_us":1731954,"threads_started":3,"wal-append.queue_time_us":986108,"wal-append.run_cpu_time_us":1277,"wal-append.run_wall_time_us":1008151}
I20260709 13:07:00.139187 15577 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:00.152954 17671 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.153247 16277 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.164793 17750 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:00.064817 17672 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.173966 17368 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.095899 17705 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:00.096156 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:00.181739 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.194440 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 124706us
I20260709 13:07:00.121524 17753 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.255445 17704 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:00.832787 17704 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:00.833427 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1589) took 1238 ms. Trace:
W20260709 13:07:00.836822 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.837131 15729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.017s	sys 0.090s
I20260709 13:07:00.795179 15473 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.153112 17589 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:00.830688 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 660028us
W20260709 13:07:00.837393 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.368068 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63114.4us
W20260709 13:07:00.837711 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 473710us
W20260709 13:07:00.836462 16272 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.755s	user 0.022s	sys 0.015s
I20260709 13:07:00.255566 15576 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:00.837744 15729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.017s	sys 0.090s
I20260709 13:07:00.191373 15575 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:00.613971 15580 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.000s
W20260709 13:07:00.847240 15579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.003s	sys 0.006s
W20260709 13:07:00.847404 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 680147us
I20260709 13:07:00.350952 15654 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.892534 15580 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:00.883129 15692 leader_election.cc:400] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:07:00.893287 15692 leader_election.cc:403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:00.847975 15572 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
W20260709 13:07:00.894274 15579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.006s
I20260709 13:07:00.894454 15572 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:00.947695 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.833832 15472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 347) took 6387 ms. Trace:
I20260709 13:07:00.948480 16272 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:00.951717 15573 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:00.952041 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.952351 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 388) took 1048 ms. Trace:
W20260709 13:07:00.952504 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.953001 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.952728 15573 rpcz_store.cc:276] 0709 13:06:59.904087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.131714 (+227627us) service_pool.cc:224] Handling call
0709 13:07:00.892605 (+760891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.952113 (+ 59508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.952301 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.836422 15722 rpcz_store.cc:276] 0709 13:06:59.595157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.648167 (+ 53010us) service_pool.cc:224] Handling call
0709 13:06:59.652557 (+  4390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:59.668240 (+ 15683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.668264 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:59.713502 (+ 45238us) log.cc:844] Serialized 52 byte log entry
0709 13:06:59.955684 (+242182us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:59.955728 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.955806 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.123404 (+167598us) raft_consensus.cc:1685] finished
0709 13:07:00.123432 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.833296 (+709864us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1265,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":114,"thread_start_us":234138,"threads_started":1,"wal-append.queue_time_us":354334}
I20260709 13:07:00.387710 15574 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:07:00.241848 17468 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.242677 17698 raft_consensus.cc:2764] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:00.889055 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:00.347039 17729 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.254935 17669 raft_consensus.cc:2764] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:00.384629 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1542) took 1215 ms. Trace:
I20260709 13:07:00.272197 17648 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:00.381855 17754 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:00.848471 17736 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.191715 17427 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:00.953874 17635 consensus_meta.cc:287] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.960s	user 0.005s	sys 0.006s
W20260709 13:07:01.006883 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 168190us
I20260709 13:07:00.888415 17750 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.255239 17511 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.729s
I20260709 13:07:01.011394 15575 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:01.060173 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1495) took 1096 ms. Trace:
I20260709 13:07:01.013622 15473 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 3, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 3 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.060530 15575 rpcz_store.cc:276] 0709 13:06:59.963616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.986319 (+1022703us) service_pool.cc:224] Handling call
0709 13:07:01.011161 (+ 24842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.059868 (+ 48707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.060113 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:00.134506 17676 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:00.978232 17615 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.989306 17468 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.896157 17522 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:00.386345 17577 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:00.248785 17587 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.791s
I20260709 13:07:01.041683 17700 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:07:00.983076 17385 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:01.062839 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75910.6us
I20260709 13:07:01.013310 17586 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.073957 17291 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.152812 17670 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.102505 15728 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:01.075665 17511 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:01.076129 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:01.015739 16275 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:00.174003 16271 rpcz_store.cc:269] 0709 13:06:58.433550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.453838 (+ 20288us) service_pool.cc:224] Handling call
0709 13:07:00.116974 (+1663136us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54004c2054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:00.138230 (+ 21256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871945984}
I20260709 13:07:01.078019 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:01.109337 15726 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.014638 17729 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:01.081187 17768 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:07:01.081383 17753 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:01.082839 17648 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:01.052526 17427 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:01.085106 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 387) took 1181 ms. Trace:
I20260709 13:07:01.050449 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1494) took 1081 ms. Trace:
I20260709 13:07:01.086094 16235 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:01.089036 15473 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.054904 17582 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.138039 15574 rpcz_store.cc:276] 0709 13:06:59.963346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.386911 (+423565us) service_pool.cc:224] Handling call
0709 13:07:00.387394 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.988949 (+601555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.044489 (+ 55540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.139701 15574 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:01.139493 15473 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.140394 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1504) took 1163 ms. Trace:
I20260709 13:07:01.140853 15574 rpcz_store.cc:276] 0709 13:06:59.976602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.138949 (+1162347us) service_pool.cc:224] Handling call
0709 13:07:01.139307 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.140083 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.140322 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.104892 17291 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.120512 17670 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.060431 17635 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.125182 15579 rpcz_store.cc:276] 0709 13:06:59.903820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.913158 (+  9338us) service_pool.cc:224] Handling call
0709 13:06:59.956291 (+ 43133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.083777 (+127486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.083811 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.084304 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.894867 (+810563us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:00.894912 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.894980 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.084895 (+189915us) raft_consensus.cc:1685] finished
0709 13:07:01.084913 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.085049 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":719385,"threads_started":1,"wal-append.queue_time_us":962748}
I20260709 13:07:01.105804 17511 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:01.115535 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 645) took 1044 ms. Trace:
I20260709 13:07:01.129181 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1595) took 1039 ms. Trace:
I20260709 13:07:01.131145 15544 leader_election.cc:400] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
I20260709 13:07:01.147744 15544 leader_election.cc:403] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:01.135416 17698 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:01.146116 15723 rpcz_store.cc:276] 0709 13:07:00.090177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.090400 (+   223us) service_pool.cc:224] Handling call
0709 13:07:00.094408 (+  4008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.094773 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.094805 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.095298 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.197620 (+102322us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.197683 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.197785 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.080532 (+882747us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:01.121336 (+ 40804us) raft_consensus.cc:1685] finished
0709 13:07:01.121365 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.129072 (+  7707us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2153,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":197899648,"thread_start_us":101818,"threads_started":1,"wal-append.queue_time_us":766875}
I20260709 13:07:01.136359 15726 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:07:01.136972 17767 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260709 13:07:01.137691 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 432) took 1437 ms. Trace:
I20260709 13:07:01.153327 15728 rpcz_store.cc:276] 0709 13:06:59.700398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.966157 (+265759us) service_pool.cc:224] Handling call
0709 13:07:01.137523 (+1171366us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400003554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:01.137644 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551713536}
W20260709 13:07:01.142477 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56478.2us
I20260709 13:07:01.065286 17750 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.141745 15473 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.084568 17615 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.162585 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:00.949770 15472 rpcz_store.cc:276] 0709 13:06:54.467359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.472749 (+  5390us) service_pool.cc:224] Handling call
0709 13:07:00.833619 (+6360870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.743041 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.803298 (+ 60257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.803334 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:06:56.803354 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:56.804186 (+   832us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.804254 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.804279 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:56.804790 (+   511us) tablet.cc:701] Row locks acquired
0709 13:06:56.804807 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:56.804947 (+   140us) write_op.cc:270] Start()
0709 13:06:56.805060 (+   113us) write_op.cc:276] Timestamp: P: 1783602416804896 usec, L: 0
0709 13:06:56.805082 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.805739 (+   657us) log.cc:844] Serialized 2472 byte log entry
0709 13:06:58.850737 (+2044998us) op_driver.cc:464] REPLICATION: finished
0709 13:06:58.972336 (+121599us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d929090ac 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d99449ef0
0709 13:06:59.113752 (+141416us) write_op.cc:301] APPLY: starting
0709 13:06:59.113878 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:59.114180 (+   302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:59.114252 (+    72us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:59.115197 (+   945us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:59.115446 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:59.115475 (+    29us) write_op.cc:312] APPLY: finished
0709 13:06:59.115772 (+   297us) log.cc:844] Serialized 53 byte log entry
0709 13:06:59.115952 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.116143 (+   191us) write_op.cc:454] Released schema lock
0709 13:06:59.116183 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:59.116716 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.116754 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":262639,"apply.run_cpu_time_us":2960,"apply.run_wall_time_us":2960,"num_ops":6,"prepare.queue_time_us":537300,"prepare.run_cpu_time_us":16588,"prepare.run_wall_time_us":372309,"raft.queue_time_us":766050,"raft.run_cpu_time_us":29332,"raft.run_wall_time_us":272379,"replication_time_us":2045443,"spinlock_wait_cycles":91391488,"thread_start_us":945802,"threads_started":4,"wal-append.queue_time_us":674280,"wal-append.run_cpu_time_us":16276,"wal-append.run_wall_time_us":2632418}]]}
I20260709 13:07:01.145154 17648 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:01.167313 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57321.5us
I20260709 13:07:01.169508 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:01.171011 15473 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 2 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.127123 17771 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:07:01.174319 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:01.168377 17672 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.149513 16275 rpcz_store.cc:276] 0709 13:07:00.068527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.888638 (+820111us) service_pool.cc:224] Handling call
0709 13:07:01.112781 (+224143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.333561 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:01.334424 15720 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:01.335415 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.336946 17533 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:01.342279 16277 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:01.349114 15619 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:01.342338 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 448151us
I20260709 13:07:01.176522 17619 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:01.353664 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 179423us
I20260709 13:07:01.356410 17779 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:01.396454 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:01.356086 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.360508 17577 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.367200 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.369349 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:01.343518 15571 raft_consensus.cc:606] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:01.355638 17772 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.012113 15646 rpcz_store.cc:276] 0709 13:06:59.481014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.778464 (+297450us) service_pool.cc:224] Handling call
0709 13:06:59.778847 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.779293 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.779332 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.779868 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.058397 (+278529us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:00.064108 (+  5711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.079827 (+ 15719us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.384307 (+304480us) raft_consensus.cc:1685] finished
0709 13:07:00.384341 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.384542 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1715,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":30541,"thread_start_us":201857,"threads_started":1,"wal-append.queue_time_us":345311}
I20260709 13:07:01.332229 17385 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.181159 17648 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:01.333123 17753 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:01.372174 15655 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.386359 15653 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:01.427922 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:01.375770 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.379189 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:01.417855 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.423133 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.432763 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 483784us
W20260709 13:07:01.436682 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 68521.8us
I20260709 13:07:01.383198 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.332798 17511 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:01.435011 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 426735us
W20260709 13:07:01.376724 17769 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
W20260709 13:07:01.441740 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 87246us
I20260709 13:07:01.460462 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 642) took 1483 ms. Trace:
I20260709 13:07:01.724491 16277 rpcz_store.cc:276] 0709 13:06:59.976814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.993411 (+ 16597us) service_pool.cc:224] Handling call
0709 13:07:01.460175 (+1466764us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54005438d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:01.460366 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365536512}
I20260709 13:07:01.369975 17589 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.725800 15726 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:01.725909 17724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.008s	sys 0.004s
W20260709 13:07:01.726363 17724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.009s	sys 0.004s
W20260709 13:07:01.726665 15727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.028s	sys 0.078s
W20260709 13:07:01.726982 15727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.028s	sys 0.078s
I20260709 13:07:01.584038 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.727856 15650 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.727998 15652 raft_consensus.cc:2368] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5.
I20260709 13:07:01.729269 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.724157 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.578451 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1600) took 1481 ms. Trace:
I20260709 13:07:01.609066 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:01.678524 15545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.007s
W20260709 13:07:01.731808 15545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.008s	sys 0.011s
I20260709 13:07:01.730525 15725 rpcz_store.cc:276] 0709 13:07:00.097461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.157434 (+ 59973us) service_pool.cc:224] Handling call
0709 13:07:00.157823 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.846571 (+688748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.896060 (+ 49489us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.074461 (+178401us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.425810 (+351349us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:01.437420 (+ 11610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.489907 (+ 52487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.502451 (+ 12544us) raft_consensus.cc:1685] finished
0709 13:07:01.511677 (+  9226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.575326 (+ 63649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106288,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":17684,"thread_start_us":271122,"threads_started":1,"wal-append.queue_time_us":311562}
I20260709 13:07:01.730114 15648 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:07:01.681679 17427 consensus_meta.cc:287] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:07:01.733040 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:01.733839 15648 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.678388 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:01.727901 17589 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.734555 15721 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:01.734675 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.735407 15648 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.733296 17427 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.736158 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:01.737229 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:01.570226 15577 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.017s
I20260709 13:07:01.738088 17427 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.460793 17779 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.739733 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1596) took 1646 ms. Trace:
I20260709 13:07:01.740365 17779 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:01.591849 17671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.012s
W20260709 13:07:01.741508 17671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.011s	sys 0.013s
I20260709 13:07:01.741346 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:01.740082 15729 rpcz_store.cc:276] 0709 13:07:00.093249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.097823 (+  4574us) service_pool.cc:224] Handling call
0709 13:07:00.098164 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.098515 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.098541 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.098984 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.895196 (+796212us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.895234 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.895387 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.376104 (+480717us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:01.739490 (+363386us) raft_consensus.cc:1685] finished
0709 13:07:01.739510 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.739679 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1025,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":154185600,"thread_start_us":795867,"threads_started":1,"wal-append.queue_time_us":761601}
I20260709 13:07:01.608388 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:01.744160 15646 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.746739 15655 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:01.749138 16272 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.378789 17291 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.743216 17583 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:01.572062 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.009s
I20260709 13:07:01.756740 17583 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:01.757272 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.013s	sys 0.011s
W20260709 13:07:01.757583 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 874604us
I20260709 13:07:01.757899 17583 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.759438 17587 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.759981 17587 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.759752 17672 consensus_queue.cc:1059] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:01.761184 17672 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:01.762470 17587 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.762856 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:01.601049 15546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.053s
W20260709 13:07:01.784730 15546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.004s	sys 0.061s
I20260709 13:07:01.601363 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:01.785836 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.400851 17676 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.385977 17783 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
I20260709 13:07:01.795982 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.796936 16277 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:01.790934 17754 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.790566 17753 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:01.790797 17715 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.660972 17635 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.804277 17754 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:01.819693 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:01.804657 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.820996 15573 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:01.822296 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.823304 15647 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:01.823664 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.824445 15573 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:01.805692 17772 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.824982 15647 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:01.806219 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:01.825057 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3074051130000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:07:01.792219 17587 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:01.755755 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:01.826602 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:01.594334 17704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.013s
W20260709 13:07:01.829578 17704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.011s	sys 0.013s
I20260709 13:07:01.807003 17715 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.759446 17583 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.829232 17522 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.808833 15650 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:01.832048 17522 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:01.808992 17468 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.001s
I20260709 13:07:01.832923 17468 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.430384 17577 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.461026 17780 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.834280 17522 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.834532 17780 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:01.806347 15580 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:01.835146 17780 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.836148 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:01.836794 16270 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:01.834303 17577 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.824462 15722 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:01.601099 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:01.825076 17772 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.766008 16272 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:01.805482 17753 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.840493 17772 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.805838 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.841548 15579 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:01.842165 17783 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.842700 17783 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.843465 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.845261 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.844871 17754 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.845968 16272 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:01.846206 17705 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:01.846719 17705 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:01.608687 17729 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.595005 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:01.845569 17577 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.768354 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:01.849108 17783 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.769279 15649 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.456940 17619 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.848431 17705 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:01.773065 17670 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.003s
I20260709 13:07:01.850143 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.850605 15576 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:01.776152 17736 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.724s	user 0.006s	sys 0.002s
I20260709 13:07:01.851091 15575 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:01.778599 17582 consensus_meta.cc:287] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260709 13:07:01.780202 17615 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.780709 17648 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.853176 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1499) took 1888 ms. Trace:
I20260709 13:07:01.767845 17750 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.834900 17468 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.854364 15578 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:01.854729 15578 pending_rounds.cc:85] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 2
I20260709 13:07:01.854990 15578 pending_rounds.cc:107] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:01.855284 15578 raft_consensus.cc:2889] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.764384 17672 raft_consensus.cc:3055] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:01.785939 15728 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:07:01.826262 15692 connection.cc:256] RPC call timeout handler was delayed by -3.2561051130001033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:07:01.826814 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71149.9us
I20260709 13:07:01.807974 17368 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:01.838383 15723 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.847378 17715 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.847432 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.848430 15651 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.848495 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.849220 15729 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.851119 16273 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.747608 15655 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.850445 15652 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.777527 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43846 (request call id 19) took 1785 ms. Trace:
W20260709 13:07:01.613936 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 274373us
W20260709 13:07:01.743113 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.853523 15575 rpcz_store.cc:276] 0709 13:06:59.964679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.065102 (+1100423us) service_pool.cc:224] Handling call
0709 13:07:01.095334 (+ 30232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.851464 (+756130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.852976 (+  1512us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b540026c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:01.853126 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737484160}
I20260709 13:07:01.648648 15720 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
W20260709 13:07:01.893246 15720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1599) took 1799 ms (client timeout 1569 ms). Trace:
I20260709 13:07:01.857657 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.740777 17511 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:01.602511 17773 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:07:01.611619 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1501) took 1646 ms. Trace:
I20260709 13:07:01.850237 17577 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.863906 15576 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:07:01.738090 15577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.000s	sys 0.024s
W20260709 13:07:01.816380 15654 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.865s	user 0.006s	sys 0.004s
I20260709 13:07:01.935894 15654 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:01.765606 17791 raft_consensus.cc:1064] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:07:01.935247 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:01.937650 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:01.938287 16277 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:01.934744 15572 rpcz_store.cc:276] 0709 13:06:59.965210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.082203 (+1116993us) service_pool.cc:224] Handling call
0709 13:07:01.082783 (+   580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.083186 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.083223 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.113980 (+ 30757us) log.cc:844] Serialized 564 byte log entry
0709 13:07:01.410778 (+296798us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:01.410816 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.410881 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.611340 (+200459us) raft_consensus.cc:1685] finished
0709 13:07:01.611367 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.611546 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":257516,"threads_started":1,"wal-append.queue_time_us":465282}
W20260709 13:07:01.939373 15692 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.501s (SENT)
W20260709 13:07:01.936393 15654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 393) took 1861 ms (client timeout 1594 ms). Trace:
I20260709 13:07:01.940032 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:01.940254 15654 rpcz_store.cc:269] 0709 13:07:00.074696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.074943 (+   247us) service_pool.cc:224] Handling call
0709 13:07:01.936327 (+1861384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:01.870844 17672 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:01.874332 17671 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.888897 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:01.577824 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:01.882959 17754 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:01.935182 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.949505 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:01.950327 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.803277 17789 raft_consensus.cc:2764] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:01.936748 15648 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.874486 17783 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.883070 15544 connection.cc:256] RPC call timeout handler was delayed by -2.0754270059999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:07:01.941121 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.969458 15723 raft_consensus.cc:2410] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:01.893656 15720 rpcz_store.cc:269] 0709 13:07:00.097180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.125421 (+ 28241us) service_pool.cc:224] Handling call
0709 13:07:01.215604 (+1090183us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eee9c 00007f2d928eea5b 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:01.893179 (+677575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184386816}
I20260709 13:07:01.850096 17619 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.896939 15580 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.945242 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:01.969449 15544 connection.cc:256] RPC call timeout handler was delayed by -1.751427005999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2303s for a response
I20260709 13:07:01.946516 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:01.885849 17697 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.972604 17697 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:01.972730 17783 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.974701 17697 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:01.974928 17783 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:01.934834 17368 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.718411 17533 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:01.944738 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:01.983353 15575 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:01.948097 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:01.946722 15655 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.899559 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1491) took 1937 ms. Trace:
I20260709 13:07:01.984416 15578 rpcz_store.cc:276] 0709 13:06:59.962424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.257497 (+295073us) service_pool.cc:224] Handling call
0709 13:07:00.361709 (+104212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.870040 (+1508331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.899289 (+ 29249us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001c4b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:01.899489 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3432087296}
I20260709 13:07:01.985590 15544 leader_election.cc:400] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
I20260709 13:07:01.967867 16278 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:01.969612 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:01.947860 15579 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:01.993439 15729 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:07:02.007076 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.007719 15573 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:02.008442 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 66120us
I20260709 13:07:02.072463 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:02.072822 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 133485us
I20260709 13:07:01.958812 17635 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.949523 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:02.076702 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91254.5us
I20260709 13:07:02.076730 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:02.079101 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.089437 15720 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.896404 17715 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:07:02.006417 15728 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.937469 17704 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:07:02.094880 15654 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:02.095911 15544 leader_election.cc:400] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5.
I20260709 13:07:01.970981 16270 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:01.994081 17522 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.096268 15544 leader_election.cc:403] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:02.096370 15654 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:02.096642 17522 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:02.089557 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.978580 17619 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.099052 15692 leader_election.cc:336] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.549s (SENT)
I20260709 13:07:02.099553 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:02.075935 17698 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.083830 17427 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.094924 15721 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:02.076836 17783 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:02.110447 16277 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:07:02.207391 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:02.190304 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.218408 15728 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:01.979440 17671 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:07:02.183291 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.193622 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:02.199440 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103684us
I20260709 13:07:01.896066 15571 rpcz_store.cc:276] 0709 13:06:59.992573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.170512 (+177939us) service_pool.cc:224] Handling call
0709 13:07:01.775948 (+1605436us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b4c0010d2c0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d93cdfa20 00007f2d93cf0a29 00007f2d93cb6644 00007f2d93cddf2d 00007f2d93cddb93 00007f2d95a0dc92 00007f2d95a0d84a 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691
0709 13:07:01.777290 (+  1342us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003facd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0d853 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691 00007f2d93f6160c 00007f2d93f608c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:01.777417 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3311582976}
I20260709 13:07:02.076133 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:02.210418 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:02.214951 15720 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:02.101455 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:02.256359 16273 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
W20260709 13:07:02.257459 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.206527 17427 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.242676 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:02.194195 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:02.293272 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.194617 17704 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.246511 15729 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.448618 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1493) took 2444 ms. Trace:
W20260709 13:07:02.329006 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 641) took 2288 ms (client timeout 1653 ms). Trace:
W20260709 13:07:02.457754 16278 rpcz_store.cc:269] 0709 13:06:59.971853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.971985 (+   132us) service_pool.cc:224] Handling call
0709 13:07:02.260404 (+2288419us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54005393d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:02.260510 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4133461376}
I20260709 13:07:02.457095 15577 rpcz_store.cc:276] 0709 13:06:59.963033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.296096 (+333063us) service_pool.cc:224] Handling call
0709 13:07:00.296604 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.948195 (+651591us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:01.935693 (+987498us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.082689 (+146996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.083398 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.084884 (+  1486us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.090811 (+  5927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.090881 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.406779 (+315898us) raft_consensus.cc:1685] finished
0709 13:07:02.406811 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.407025 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20512,"prepare.queue_time_us":806543,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":561993,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":124085,"thread_start_us":1018228,"threads_started":2,"wal-append.queue_time_us":329337}
I20260709 13:07:02.216802 17697 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.358135 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 257452us
I20260709 13:07:02.245285 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:02.341099 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.473212 16277 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:02.390586 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.431738 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.007s
I20260709 13:07:02.243880 17670 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.199705 17672 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:02.276966 17805 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:07:02.390584 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 164840us
W20260709 13:07:02.494366 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.210908 17784 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.224740 17789 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:02.276237 17801 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:07:02.227727 17648 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.497802 15729 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:02.275293 17797 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:02.554692 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 67495.9us
I20260709 13:07:02.538906 15652 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:02.487596 16269 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
W20260709 13:07:02.502466 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 423569us
I20260709 13:07:02.506754 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:02.500666 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.009s
W20260709 13:07:02.586445 15576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.011s
I20260709 13:07:02.487531 17697 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:02.631819 15576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.004s	sys 0.015s
I20260709 13:07:02.633327 16278 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:02.640786 16236 leader_election.cc:336] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.585s (SENT)
I20260709 13:07:02.641463 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:02.646773 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.648269 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 758019us
W20260709 13:07:02.360423 15646 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.005s
I20260709 13:07:02.390967 17368 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:02.584842 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 391316us
W20260709 13:07:02.611595 17619 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
I20260709 13:07:02.390123 17776 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.366222 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:02.518589 17615 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:02.590294 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:02.556634 17753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.016s	sys 0.002s
W20260709 13:07:02.556167 17780 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.720s	user 0.016s	sys 0.005s
W20260709 13:07:02.670770 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.603690 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.613389 17809 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:02.599196 17672 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:02.614423 17792 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.529s	user 0.000s	sys 0.001s
I20260709 13:07:02.486481 17806 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:02.654003 15619 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:02.652843 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:02.662222 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72027.2us
W20260709 13:07:02.686689 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.678978 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.678860 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.722193 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 68282.4us
I20260709 13:07:02.729992 15619 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:02.661208 17753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.017s	sys 0.003s
I20260709 13:07:02.731683 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:02.732115 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 91380.7us
I20260709 13:07:02.727550 16278 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:02.652037 15646 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:07:02.737212 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 88133.6us
I20260709 13:07:02.615157 17648 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.730530 17533 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.661203 15721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:07:02.606070 17784 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.724712 17368 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:02.670696 17577 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 13:07:02.779476 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.749547 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:02.745924 17589 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:02.779922 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45764.8us
I20260709 13:07:02.777562 17806 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:02.796828 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47377.3us
I20260709 13:07:02.611299 17789 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:02.797878 15692 connection.cc:256] RPC call timeout handler was delayed by -3.0752051130001519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:07:02.800415 15692 connection.cc:256] RPC call timeout handler was delayed by -3.0086051130000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 13:07:02.800802 15692 connection.cc:256] RPC call timeout handler was delayed by -2.9933051130001331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
I20260709 13:07:02.673897 16273 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:02.801302 15692 connection.cc:256] RPC call timeout handler was delayed by -2.6432051130001355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
W20260709 13:07:02.802085 15692 connection.cc:256] RPC call timeout handler was delayed by -2.3633051130001377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2863s for a response
W20260709 13:07:02.802477 15692 connection.cc:256] RPC call timeout handler was delayed by -2.3539453760000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32930000000000004s for a response
I20260709 13:07:02.803112 17676 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.803694 17676 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.806386 17676 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:02.807137 15692 connection.cc:256] RPC call timeout handler was delayed by -1.8440577240000948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:07:02.807617 15692 connection.cc:256] RPC call timeout handler was delayed by -1.7846577240001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:07:02.808012 15692 connection.cc:256] RPC call timeout handler was delayed by -1.6091577240000561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:07:02.808615 15692 connection.cc:256] RPC call timeout handler was delayed by -1.4201577240000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:07:02.813501 16273 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:07:02.663142 17619 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:02.824142 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 103086us
W20260709 13:07:02.824610 17819 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:07:02.825521 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:02.661865 17776 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:02.720816 17780 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.749775 17818 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.733623 17715 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:02.784399 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2064) took 1201 ms (client timeout 1533 ms). Trace:
I20260709 13:07:02.785050 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 862) took 1038 ms. Trace:
I20260709 13:07:02.789740 17533 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:02.836301 17782 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.778891 17821 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:07:02.841763 17778 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:02.858225 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 125052us
W20260709 13:07:02.889117 16236 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.889s (SENT)
W20260709 13:07:02.889727 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.837329 17818 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:02.893134 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71746.8us
I20260709 13:07:02.893975 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:02.891718 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.895685 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:02.899149 15655 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.915s	user 0.006s	sys 0.003s
I20260709 13:07:02.849383 17427 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:02.899904 15655 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:07:02.900354 15655 pending_rounds.cc:85] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:07:02.900640 15655 pending_rounds.cc:107] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:02.900938 15655 raft_consensus.cc:2889] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:02.846361 17589 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:02.893985 17704 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.911201 15728 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.002s
I20260709 13:07:02.915115 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:02.720753 17791 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:02.922041 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 176362us
W20260709 13:07:02.847285 15646 rpcz_store.cc:269] 0709 13:07:01.579286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.608044 (+ 28758us) service_pool.cc:224] Handling call
0709 13:07:02.780198 (+1172154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.921408 15728 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:02.928444 17804 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:07:02.929044 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:02.895648 17818 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.929667 15728 raft_consensus.cc:2376] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3. Re-sending same reply.
I20260709 13:07:02.930859 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:02.917622 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 398) took 1548 ms. Trace:
I20260709 13:07:02.935351 15655 rpcz_store.cc:276] 0709 13:07:01.370984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.371604 (+   620us) service_pool.cc:224] Handling call
0709 13:07:01.371964 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.917285 (+1545321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.917547 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.929808 17806 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:02.925513 17704 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:02.917691 17771 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:02.955425 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.965040 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.940315 17704 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:02.942165 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1505) took 2958 ms. Trace:
I20260709 13:07:02.969312 15574 rpcz_store.cc:276] 0709 13:06:59.983822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.141807 (+1157985us) service_pool.cc:224] Handling call
0709 13:07:01.155902 (+ 14095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.341823 (+185921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.350779 (+  8956us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.423575 (+ 72796us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.071520 (+647945us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:02.071620 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.071749 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.929483 (+857734us) raft_consensus.cc:1685] finished
0709 13:07:02.929520 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.934326 (+  4806us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":538283,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":377499,"threads_started":1,"wal-append.queue_time_us":1102813}
I20260709 13:07:02.970841 17841 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:02.971768 17803 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:07:02.968896 17704 raft_consensus.cc:2764] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:03.012792 15728 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:02.995095 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.946748 17825 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:07:02.945567 17829 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:07:02.946082 17812 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:07:02.935757 17778 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.042829 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:03.034201 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 140305us
W20260709 13:07:03.037799 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 94348.1us
I20260709 13:07:02.936609 17697 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.044281 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:03.006484 17511 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.040s	user 0.008s	sys 0.003s
I20260709 13:07:02.939567 17698 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:02.949903 17619 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:02.955199 17840 raft_consensus.cc:2764] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:07:03.047634 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:03.050982 15724 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:03.053844 17832 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:03.039651 15721 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.060169 17780 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:03.060336 15721 raft_consensus.cc:614] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.023803 17771 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:03.061616 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 401) took 1155 ms. Trace:
W20260709 13:07:03.062002 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 131231us
I20260709 13:07:03.065701 15619 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:03.048566 17698 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.049089 17669 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.075054 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 156851us
I20260709 13:07:02.942498 17589 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.022929 17385 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:07:03.102135 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.943476 17533 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.062713 15651 rpcz_store.cc:276] 0709 13:07:01.906773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.937618 (+ 30845us) service_pool.cc:224] Handling call
0709 13:07:01.954925 (+ 17307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:02.078257 (+123332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.078302 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:02.122177 (+ 43875us) log.cc:844] Serialized 52 byte log entry
0709 13:07:02.722664 (+600487us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:02.796147 (+ 73483us) log.cc:844] Serialized 14 byte log entry
0709 13:07:02.858170 (+ 62023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.858623 (+   453us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.061307 (+202684us) raft_consensus.cc:1685] finished
0709 13:07:03.061337 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.061536 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115401,"prepare.queue_time_us":93697,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":7462,"raft.queue_time_us":149886,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":19612,"spinlock_wait_cycles":22601728,"thread_start_us":416316,"threads_started":2,"wal-append.queue_time_us":621279}
I20260709 13:07:03.069046 17841 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.070463 17840 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.112421 17582 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.073050 17780 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:03.063980 17619 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:07:03.141695 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 91846.7us
I20260709 13:07:02.848840 16275 rpcz_store.cc:276] 0709 13:07:01.747630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.753594 (+  5964us) service_pool.cc:224] Handling call
0709 13:07:01.757161 (+  3567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.757542 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.757571 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.758407 (+   836us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.799248 (+ 40841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:01.799320 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.799427 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.732420 (+932993us) raft_consensus.cc:1685] finished
0709 13:07:02.742395 (+  9975us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.780724 (+ 38329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":673,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":40370,"threads_started":1,"wal-append.queue_time_us":184245}
I20260709 13:07:03.150449 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1610) took 1143 ms. Trace:
I20260709 13:07:03.126662 17648 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:03.109649 17669 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.152413 15726 rpcz_store.cc:276] 0709 13:07:02.007196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.086614 (+ 79418us) service_pool.cc:224] Handling call
0709 13:07:02.086909 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.087147 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:02.538914 (+451767us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.149919 (+611005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.149999 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:03.150082 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.150190 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.150350 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20098,"prepare.queue_time_us":502206,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":5816,"raft.queue_time_us":113232,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":21100,"thread_start_us":923563,"threads_started":3}
I20260709 13:07:03.130877 17776 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.141786 17841 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:03.186240 17841 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.161031 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2063) took 1621 ms. Trace:
I20260709 13:07:03.151284 17784 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:03.156515 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.144284 17840 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:03.156514 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.145078 17582 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:03.217805 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61353.7us
I20260709 13:07:03.218772 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.188580 15653 rpcz_store.cc:276] 0709 13:07:01.539678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.765419 (+225741us) service_pool.cc:224] Handling call
0709 13:07:01.765789 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.766162 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.766197 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.766742 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.872782 (+106040us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:01.896934 (+ 24152us) log.cc:844] Serialized 14 byte log entry
0709 13:07:01.938667 (+ 41733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.938777 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.970464 (+1031687us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b48000ce358. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:03.153675 (+183211us) raft_consensus.cc:1685] finished
0709 13:07:03.160771 (+  7096us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.160963 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43698,"prepare.queue_time_us":69651,"raft.queue_time_us":49282,"raft.run_cpu_time_us":3423,"raft.run_wall_time_us":1020756,"spinlock_wait_cycles":67937408,"thread_start_us":105639,"threads_started":1,"wal-append.queue_time_us":773081}
I20260709 13:07:03.235222 17791 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:03.235679 17791 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:03.236032 17791 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.150624 17771 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:03.249092 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.272611 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 43508.8us
I20260709 13:07:03.189282 17852 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:03.278425 17840 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.217599 17782 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:03.281993 15693 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.130:44871 timed out after 1.530s (SENT) [suppressed 29 similar messages]
I20260709 13:07:03.288496 15725 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:03.273933 17754 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.305s	user 0.008s	sys 0.005s
I20260709 13:07:03.240116 17818 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:03.310647 15618 connection.cc:256] RPC call timeout handler was delayed by -2.0158120769999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:07:03.306845 16236 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.954s (SENT)
I20260709 13:07:03.231405 17778 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:03.311147 15618 connection.cc:256] RPC call timeout handler was delayed by -1.9384120769999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:07:03.314502 15618 connection.cc:256] RPC call timeout handler was delayed by -1.9384120769999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:07:03.314973 15618 connection.cc:256] RPC call timeout handler was delayed by -1.778212076999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:07:03.315291 15618 connection.cc:256] RPC call timeout handler was delayed by -1.76291207700001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:07:03.315577 15618 connection.cc:256] RPC call timeout handler was delayed by -1.6873120770000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:07:03.315865 15618 connection.cc:256] RPC call timeout handler was delayed by -1.6828120769999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:07:03.316146 15618 connection.cc:256] RPC call timeout handler was delayed by -1.4587120769999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:07:03.316419 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1275120770000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2554s for a response
I20260709 13:07:03.317196 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.318266 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:03.320334 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.296100 17648 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.319205 17849 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.325212 17849 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:03.326602 17824 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:03.329180 17849 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.330214 17619 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:03.332252 17854 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:07:03.335685 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:03.336148 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.318377 17852 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:03.333900 17670 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.004s
W20260709 13:07:03.350011 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 193571us
I20260709 13:07:03.319880 17754 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:03.352978 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.353219 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:03.353847 16278 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.358268 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:03.360311 17838 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:07:03.362373 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:03.321730 17860 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.362339 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:03.367223 16278 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:03.370333 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:03.370543 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.372809 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:03.351294 17729 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.379796 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:03.381620 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:03.357220 17670 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5.
I20260709 13:07:03.400032 16276 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.385149 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:03.406276 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.408455 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:03.402328 16270 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.410174 17861 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.366460 17754 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:03.414134 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.417045 17850 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.417716 16275 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:03.422372 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:03.415367 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.402855 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:03.382521 17698 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.423077 16272 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:03.424868 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 499) took 1414 ms. Trace:
I20260709 13:07:03.422838 17847 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.425313 16272 rpcz_store.cc:276] 0709 13:07:02.010178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.088506 (+ 78328us) service_pool.cc:224] Handling call
0709 13:07:03.422187 (+1333681us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:03.424812 (+  2625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699008}
W20260709 13:07:03.425242 17859 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:03.403072 17862 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.429422 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.430828 17848 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.431361 17848 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.431722 17848 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.417809 17857 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.406728 17778 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.436692 17862 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.437209 17862 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.437387 17847 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.445240 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:03.451952 16270 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:03.422824 17582 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.453016 17847 raft_consensus.cc:2764] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:03.457266 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:03.459018 17851 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.459606 17851 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:03.460490 17619 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.466430 17816 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:03.466831 17816 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:03.467546 17698 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.454564 17861 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:03.477731 17385 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:07:03.484550 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:03.484076 17849 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:03.485361 16269 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.456192 17857 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:03.499980 16276 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:03.507372 17818 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:03.513505 16277 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:03.484654 17385 consensus_queue.cc:1243] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:03.501144 17754 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:03.478179 17619 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:03.409873 17852 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.467679 17816 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.511425 17862 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.544111 17857 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.551046 17619 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:03.552549 17377 raft_consensus.cc:1068] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Unable to promote non-voter 681370bcf39d46b189ec8e9a5957f93d: Illegal state: Replica 8995ef9978c446769377fc0e9a0cb9c1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:07:03.555768 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:03.557363 17782 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.557889 17782 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:03.558796 17582 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:03.560079 17782 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.559579 17582 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:03.561976 17582 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.514334 17851 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.579103 17862 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.578086 17670 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:03.638055 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.907294 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.895051 15544 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:03.907998 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:03.902264 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 595441us
I20260709 13:07:03.909020 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:03.577214 17818 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.686467 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2065) took 2091 ms. Trace:
W20260709 13:07:03.913568 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.914852 15648 rpcz_store.cc:276] 0709 13:07:01.595005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.800024 (+205019us) service_pool.cc:224] Handling call
0709 13:07:01.936592 (+136568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.954695 (+ 18103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.686217 (+1731522us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540015a4d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:03.686394 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310524288}
I20260709 13:07:03.921490 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:03.922649 15579 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:03.833873 17725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.091s	sys 0.101s
I20260709 13:07:03.932346 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:03.933200 15572 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:03.934361 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:03.935061 15578 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.925773 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:03.926605 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:03.912508 17782 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.587708 16271 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:03.930416 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:03.889063 17671 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:03.946748 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:03.947530 15651 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:03.948513 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:03.602279 17808 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.852577 17856 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.038s
W20260709 13:07:03.939807 17725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.091s	sys 0.108s
I20260709 13:07:03.962913 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:03.921639 17582 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:03.949272 15653 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:03.969473 15578 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:03.943030 17377 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.975423 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:03.984102 15651 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:03.604753 17848 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.581573 17791 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:03.987931 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:03.988772 15572 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.959334 17816 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:03.928227 17818 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:04.005970 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.990242 15574 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:03.946187 17782 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:04.013139 15650 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:04.014266 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:03.976012 17583 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:04.015684 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 106791us
I20260709 13:07:03.982470 17377 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:04.021179 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.021642 15573 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:03.995118 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.028522 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.022728 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.003636 17582 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:03.978487 17808 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.017725 15651 raft_consensus.cc:2376] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4. Re-sending same reply.
I20260709 13:07:04.056839 15578 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:07:04.023200 17377 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:04.072685 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 162766us
W20260709 13:07:04.075037 16236 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.190s (SENT)
I20260709 13:07:04.075448 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.076175 17872 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.078895 17872 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.079632 17872 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.077095 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:04.082195 17872 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:04.083406 17872 raft_consensus.cc:670] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:07:04.084124 17670 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:04.084666 17670 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:04.085566 17670 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.094362 15572 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:04.095080 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:04.035841 17778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.017s	sys 0.026s
W20260709 13:07:04.099903 15618 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.061s
W20260709 13:07:04.057525 17849 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.571s	user 0.019s	sys 0.000s
I20260709 13:07:04.107932 15655 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:04.107410 15618 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.061s
I20260709 13:07:04.109088 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:04.109439 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 619644us
I20260709 13:07:04.054229 17582 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.112195 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:04.067976 17861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.025s	sys 0.038s
I20260709 13:07:04.023108 17583 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:04.106802 17778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.017s	sys 0.026s
I20260709 13:07:04.073109 17821 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.106432 17872 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.147696 17872 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:04.149106 17837 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.179s	user 0.001s	sys 0.001s
W20260709 13:07:04.111050 17868 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:04.106045 17754 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:04.146569 17848 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:04.142442 17861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.025s	sys 0.038s
I20260709 13:07:04.149958 17872 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:04.151963 17848 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.152181 17861 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.154544 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.155347 15574 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:04.151394 17754 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.155139 17861 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:04.145004 15572 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:04.263556 15572 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.116243 17671 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.266206 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:04.255541 16269 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.770s	user 0.014s	sys 0.003s
I20260709 13:07:04.332289 15572 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.341089 15572 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:04.344535 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 184330us
I20260709 13:07:04.347574 15572 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.338634 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.347867 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 398) took 2458 ms. Trace:
I20260709 13:07:04.356418 15576 rpcz_store.cc:276] 0709 13:07:01.889037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.970956 (+ 81919us) service_pool.cc:224] Handling call
0709 13:07:01.971347 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.632425 (+661078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.632477 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.633079 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.791802 (+158723us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.791850 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.791927 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.148460 (+1356533us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:04.201937 (+ 53477us) raft_consensus.cc:1685] finished
0709 13:07:04.201981 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.347800 (+145819us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106802,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6257,"spinlock_wait_cycles":73345408,"thread_start_us":708363,"threads_started":2,"wal-append.queue_time_us":305109}
W20260709 13:07:04.358320 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 246295us
I20260709 13:07:04.359439 15572 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:04.365396 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.334523 16269 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:04.378892 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.379654 15655 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:04.385448 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.764s (SENT)
I20260709 13:07:04.396178 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.392253 17849 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:04.384526 17879 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:04.387742 17818 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.411618 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:04.366516 17377 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.414770 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.412510 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.416290 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.417249 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.417193 17818 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.418008 17818 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:04.418197 17698 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.418442 17818 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.418591 17698 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:04.419009 17698 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.420825 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.421520 15654 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:04.421905 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.422394 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.422979 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.423537 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.424000 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.424366 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.424024 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:04.424678 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.425365 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.425428 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.425771 17698 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.384213 17715 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:04.404716 17669 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:04.407210 17782 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:04.430644 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:04.405303 17849 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:04.435022 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.459479 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.414295 17848 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.476698 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:04.431973 17808 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.430003 17857 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.481045 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.479367 17840 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.435213 17892 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.445262 15652 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:04.450474 17754 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:04.449442 17778 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.484365 17781 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.489681 17849 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:04.490954 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.491719 17377 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.492712 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:04.478019 17782 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.492832 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.511739 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.512342 15723 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.515300 17878 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.346s	user 0.011s	sys 0.011s
I20260709 13:07:04.492859 17582 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.499759 17781 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:04.480770 17848 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:04.502988 17778 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.485967 17840 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.526094 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 661) took 1019 ms. Trace:
I20260709 13:07:04.519862 15723 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:04.522523 17808 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.525030 17789 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.536310 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.526546 16278 rpcz_store.cc:276] 0709 13:07:03.506821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.507012 (+   191us) service_pool.cc:224] Handling call
0709 13:07:03.513856 (+  6844us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:03.517622 (+  3766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.517652 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:03.539767 (+ 22115us) log.cc:844] Serialized 52 byte log entry
0709 13:07:04.012016 (+472249us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.277329 (+265313us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.349538 (+ 72209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.349641 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.514673 (+165032us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:04.516306 (+  1633us) raft_consensus.cc:1685] finished
0709 13:07:04.522260 (+  5954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.526008 (+  3748us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3298,"prepare.queue_time_us":257963,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":4202,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":14649,"spinlock_wait_cycles":15286656,"thread_start_us":684965,"threads_started":2,"wal-append.queue_time_us":621402}
I20260709 13:07:04.529987 17781 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.539173 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.540215 17522 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:04.543080 17848 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.548488 15722 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:04.552485 17874 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.383s	user 0.011s	sys 0.009s
I20260709 13:07:04.555809 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.556896 15648 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:04.557205 15655 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:04.557921 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.550787 15721 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:04.562162 16236 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.820s (SENT)
W20260709 13:07:04.545250 17816 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.004s
I20260709 13:07:04.565717 15722 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:07:04.567687 15723 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.566138 15722 pending_rounds.cc:85] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 2
I20260709 13:07:04.569061 15722 pending_rounds.cc:107] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:07:04.569526 15722 raft_consensus.cc:2889] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:04.575137 16236 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.947s (SENT)
I20260709 13:07:04.575753 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.550459 17698 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.579170 15722 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:04.530241 17782 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:07:04.585346 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.12813e+06us
I20260709 13:07:04.509550 17892 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.512480 17670 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:07:04.585136 16236 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.021s (SENT)
I20260709 13:07:04.590370 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.583870 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1609) took 2584 ms. Trace:
I20260709 13:07:04.588785 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.589342 15724 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:04.588505 15723 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:04.584726 17753 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.599225 15722 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:04.552966 17778 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:04.600807 16236 leader_election.cc:336] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.093s (SENT)
I20260709 13:07:04.607625 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:04.607821 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 694740us
I20260709 13:07:04.608649 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1616) took 1878 ms. Trace:
I20260709 13:07:04.609035 15720 rpcz_store.cc:276] 0709 13:07:02.729888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.730160 (+   272us) service_pool.cc:224] Handling call
0709 13:07:02.779601 (+ 49441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.779836 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:02.841733 (+ 61897us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.110706 (+1268973us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b18002f48e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a
0709 13:07:04.608322 (+497616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.608371 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.608409 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.608489 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.608595 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542505,"prepare.queue_time_us":67005,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":9710976,"thread_start_us":47374,"threads_started":1,"wal-append.queue_time_us":97628,"wal-append.run_cpu_time_us":1106,"wal-append.run_wall_time_us":1007345}
I20260709 13:07:04.610894 17427 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:04.612959 17781 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.614195 15646 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:04.615350 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.615839 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.604877 15721 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.605952 17522 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.630545 17729 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.606443 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.631418 15653 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:04.589259 17511 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.618211 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.591058 15727 rpcz_store.cc:276] 0709 13:07:01.993849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.994093 (+   244us) service_pool.cc:224] Handling call
0709 13:07:02.079782 (+ 85689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.080052 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:02.431318 (+351266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.436782 (+1005464us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800317b60. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a
0709 13:07:03.453260 (+ 16478us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.578227 (+1124967us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b1800317b60. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:07:04.578366 (+   139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.578413 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:04.578471 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.578530 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.578642 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1134095,"prepare.queue_time_us":422244,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":2992,"raft.queue_time_us":1141574,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6304,"spinlock_wait_cycles":5716608,"thread_start_us":509923,"threads_started":2,"wal-append.queue_time_us":205153,"wal-append.run_cpu_time_us":1698,"wal-append.run_wall_time_us":1821472}
I20260709 13:07:04.619576 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 659) took 1137 ms. Trace:
I20260709 13:07:04.620170 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.637326 15726 raft_consensus.cc:2410] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:04.620739 17871 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.355s	user 0.000s	sys 0.012s
W20260709 13:07:04.623397 17876 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.481s	user 0.003s	sys 0.024s
I20260709 13:07:04.624094 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.624944 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.625715 17704 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.642582 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:04.626271 17850 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:04.626634 15723 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:04.627331 15692 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.628094 17847 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.612982 17846 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.628252 17892 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:04.636343 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:04.638618 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.656369 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.656836 15654 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:04.657008 15720 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:04.644812 15722 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:04.642560 17704 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.636895 16275 rpcz_store.cc:276] 0709 13:07:03.482254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.482662 (+   408us) service_pool.cc:224] Handling call
0709 13:07:03.495932 (+ 13270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.496314 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.496370 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.496871 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.865471 (+368600us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:04.128370 (+262899us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.354121 (+225751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.363406 (+  9285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.513913 (+150507us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:04.619293 (+105380us) raft_consensus.cc:1685] finished
0709 13:07:04.619390 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.619521 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8048,"prepare.queue_time_us":303684,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":27890,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":2330,"spinlock_wait_cycles":44971392,"thread_start_us":845189,"threads_started":3,"wal-append.queue_time_us":671873}
I20260709 13:07:04.653653 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.660982 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.662927 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.663556 15726 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:04.663621 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.662492 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.664391 15723 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.665942 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:04.666932 16236 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.772s (SENT)
I20260709 13:07:04.667369 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.638497 17582 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.676334 15720 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:04.679031 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.680006 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.680675 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.684764 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.686316 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.687009 15726 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.689353 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.690085 17781 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.694293 15720 raft_consensus.cc:2410] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:04.694906 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:04.696097 15728 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.648219 17847 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.659076 17511 raft_consensus.cc:2764] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:04.704835 17522 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.735826 15726 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:04.708374 15728 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:04.713653 15723 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:04.709829 15721 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:04.742623 15725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2089) took 2923 ms (client timeout 2551 ms). Trace:
W20260709 13:07:04.743074 15725 rpcz_store.cc:269] 0709 13:07:01.819239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.819382 (+   143us) service_pool.cc:224] Handling call
0709 13:07:04.742415 (+2923033us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001a4fd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:04.742542 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147534208}
I20260709 13:07:04.708945 17840 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.748598 17615 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:04.749027 17615 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.754287 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:04.755978 17875 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.587s	user 0.007s	sys 0.014s
I20260709 13:07:04.756276 17781 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:04.757158 17873 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.491s	user 0.004s	sys 0.009s
I20260709 13:07:04.757808 17861 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:04.758375 17861 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.759222 17861 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.675717 17753 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:04.710219 17895 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:04.707235 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:04.771744 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64595.3us
I20260709 13:07:04.772763 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:04.768584 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 159919us
I20260709 13:07:04.775102 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 658) took 1293 ms. Trace:
I20260709 13:07:04.775640 16272 rpcz_store.cc:276] 0709 13:07:03.481386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.481568 (+   182us) service_pool.cc:224] Handling call
0709 13:07:03.497726 (+ 16158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.515039 (+ 17313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.515071 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.515570 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.931162 (+415592us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:04.354640 (+423478us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.355095 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.355186 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.622711 (+267525us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:04.769276 (+146565us) raft_consensus.cc:1685] finished
0709 13:07:04.774844 (+  5568us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.775025 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238327,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":8830,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":31387,"spinlock_wait_cycles":14648576,"thread_start_us":767671,"threads_started":2,"wal-append.queue_time_us":537011}
W20260709 13:07:04.766235 17888 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:04.659622 17850 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:04.706379 17847 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.674126 17892 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:07:04.781481 17806 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.766806 17753 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.789649 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 655) took 1434 ms. Trace:
I20260709 13:07:04.809765 16276 rpcz_store.cc:276] 0709 13:07:03.355193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.356019 (+   826us) service_pool.cc:224] Handling call
0709 13:07:04.789481 (+1433462us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b540053a054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:04.789588 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66417408}
I20260709 13:07:04.749895 17615 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:04.797956 15573 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.799829 15575 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:04.801165 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.812824 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.802713 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:04.813630 15572 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.805038 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.814337 15576 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:04.795150 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.808419 15720 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.818583 16276 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:04.820470 16278 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:04.820829 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.823506 15722 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:07:04.825789 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.806646 17698 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.824890 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:04.830207 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57496.5us
I20260709 13:07:04.831303 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.833724 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.806874 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 656) took 1327 ms. Trace:
I20260709 13:07:04.812059 17753 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.848819 17468 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.852458 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:04.848968 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.846161 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.859858 15572 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:04.860023 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.826550 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:04.825034 17676 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:04.866484 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91723.3us
I20260709 13:07:04.846627 17724 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.852051 17615 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.847334 17368 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.855757 17789 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.849749 17816 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:07:04.851058 17883 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.879777 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:04.881438 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.852206 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:04.924592 15574 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:04.857424 17906 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.847177 17840 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:07:04.925920 17906 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:04.863897 17808 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.927153 17808 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.927686 17808 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.928802 17906 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:04.866091 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:04.929692 17906 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.930472 15721 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:04.931185 17906 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:04.932561 15721 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:04.912092 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46814.4us
I20260709 13:07:04.847038 17778 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:07:04.941332 16277 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:04.880043 17821 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.847771 17698 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:04.935760 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:04.896549 17368 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:04.865844 17836 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:04.878616 17724 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.946822 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 129764us
I20260709 13:07:04.916170 17911 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.953107 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:04.936579 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56931.9us
I20260709 13:07:04.956969 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.947582 15577 pending_rounds.cc:85] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 2
I20260709 13:07:04.960891 15577 pending_rounds.cc:107] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:04.961231 15577 raft_consensus.cc:2889] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.950249 17781 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.947844 17782 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:04.969976 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:04.970768 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103520us
I20260709 13:07:04.951591 16271 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:04.955574 17789 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.956702 17368 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.976281 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:04.936748 17582 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:04.958725 17724 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.982169 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:04.985345 17861 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.986276 17861 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.986600 17861 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.968895 17704 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:04.946403 17913 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:04.973439 17669 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.997361 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.998342 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.999176 15651 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:04.969524 17778 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:04.969389 17468 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:04.977813 17781 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:04.981544 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 403) took 1077 ms. Trace:
I20260709 13:07:04.979406 17912 raft_consensus.cc:2764] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:04.997997 15574 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.994779 17883 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.005875 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:04.987399 17861 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.054569 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.055449 15721 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:07:05.054804 17904 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:07:05.058418 17905 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:07:05.041309 15571 rpcz_store.cc:276] 0709 13:07:03.904139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.913263 (+  9124us) service_pool.cc:224] Handling call
0709 13:07:03.952627 (+ 39364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.998600 (+ 45973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.998640 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.998708 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.998751 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.971214 (+972463us) spinlock_profiling.cc:243] Waited 9.69 ms on lock 0x7b5400292554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:04.974007 (+  2793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.978782 (+  4775us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22288128}
I20260709 13:07:05.059265 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:05.060560 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:05.061133 15571 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:04.847409 16270 rpcz_store.cc:276] 0709 13:07:03.479848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.482626 (+  2778us) service_pool.cc:224] Handling call
0709 13:07:03.496151 (+ 13525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.496556 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.496584 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.510910 (+ 14326us) log.cc:844] Serialized 564 byte log entry
0709 13:07:04.002913 (+492003us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:04.013902 (+ 10989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.018453 (+  4551us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.755275 (+736822us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:04.761343 (+  6068us) raft_consensus.cc:1685] finished
0709 13:07:04.761361 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.794342 (+ 32981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44239104,"thread_start_us":480211,"threads_started":1,"wal-append.queue_time_us":657229}
I20260709 13:07:04.989226 17840 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:07:04.975878 17836 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:07:04.970108 17911 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:04.993572 17669 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:05.045385 17909 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:05.003466 17857 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:07:05.082479 17781 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.006409 17783 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:04.999051 17725 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:07:05.093955 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93562.9us
I20260709 13:07:05.004858 17914 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:07:05.043625 17577 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:07:05.071697 17704 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.106462 15574 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:05.107200 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.083976 17912 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:07:05.105938 17908 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:07:05.074123 17922 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.071991 17850 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:05.097572 15571 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:05.124964 17778 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:05.132571 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:05.135774 17869 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.788s	user 0.002s	sys 0.002s
I20260709 13:07:05.113524 17704 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:05.145969 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:05.154946 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 164221us
W20260709 13:07:05.157356 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.160297 17903 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:07:05.152426 17704 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.158324 16269 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.158504 16271 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:05.170692 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 188624us
I20260709 13:07:05.161805 17698 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.173488 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:05.175271 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:05.181895 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 65160.3us
I20260709 13:07:05.130270 17669 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.171388 17847 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.183364 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.192216 15727 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.183619 17926 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:05.184443 17850 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.199234 17850 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.200142 17806 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.200875 17911 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:05.201603 17850 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:05.197635 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.203001 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.203673 15727 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:05.204391 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.205502 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:05.188416 17870 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.080s	user 0.004s	sys 0.000s
W20260709 13:07:05.188911 17818 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.002s
I20260709 13:07:05.206961 17818 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.208591 15578 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.197724 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.209515 15721 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.209744 17783 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:05.210173 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.210394 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.211176 15721 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:05.210742 17783 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.211928 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.212652 15721 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:05.197999 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.213078 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.213644 16273 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:05.214133 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 649) took 1861 ms. Trace:
I20260709 13:07:05.214231 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:05.214514 16273 rpcz_store.cc:276] 0709 13:07:03.352533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.363665 (+ 11132us) service_pool.cc:224] Handling call
0709 13:07:05.197843 (+1834178us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:05.213980 (+ 16137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12794112}
I20260709 13:07:05.215167 17705 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:05.215606 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.217190 16273 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:05.219545 16273 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:05.184895 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:05.218120 17818 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:05.191465 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:05.219754 17821 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.179646 17922 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.235737 15573 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:05.242044 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:05.244045 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 52656.5us
I20260709 13:07:05.246434 15575 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:05.248452 17808 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.248988 17724 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.250550 17808 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.251031 17821 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.251619 17577 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.252080 17577 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.252408 17577 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.253340 17821 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:05.242799 17781 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:07:05.255040 15727 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.255857 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.257869 15724 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.258103 15571 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:05.259016 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:05.256808 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.260826 15727 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:05.263500 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.265301 17791 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:05.266711 17846 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:05.267191 17846 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.243852 17669 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.205745 17753 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.274211 17781 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.274700 17781 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.277346 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.277988 15727 raft_consensus.cc:2410] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:05.271463 17924 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:07:05.271763 17615 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:05.284327 17847 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:05.287571 17907 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:07:05.297320 16275 raft_consensus.cc:2368] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4.
I20260709 13:07:05.279481 17698 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.289754 17724 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.279529 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.305414 15721 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:05.303025 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.282840 17615 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:05.307566 15727 raft_consensus.cc:2368] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:07:05.279657 17368 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.308991 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:05.317309 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.317855 15727 raft_consensus.cc:2376] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4. Re-sending same reply.
W20260709 13:07:05.312227 17851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.006s	sys 0.006s
I20260709 13:07:05.327525 15572 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.330847 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.331727 15727 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 1.
W20260709 13:07:05.324092 17851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.006s	sys 0.007s
I20260709 13:07:05.306200 17698 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.323532 16269 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:05.338717 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.340878 15727 raft_consensus.cc:2410] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:05.334803 17783 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.350821 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.338627 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.351442 15727 raft_consensus.cc:2368] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4.
I20260709 13:07:05.337633 17615 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.360378 17615 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.367338 15721 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:05.368769 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.369354 15721 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.371986 17670 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:05.372509 17670 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.374184 17781 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.374678 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.375223 15726 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:05.375996 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.376662 15726 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:05.376471 17577 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.379047 17698 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:05.379292 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 497899us
W20260709 13:07:05.379532 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 433269us
I20260709 13:07:05.380033 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:05.380929 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.381474 15726 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:05.384723 16272 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.387327 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.388233 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.388443 15726 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:05.388903 15727 raft_consensus.cc:2368] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3.
I20260709 13:07:05.389294 15720 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:05.391528 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.391750 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:05.394447 17754 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.394896 17754 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.395259 17754 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:05.396898 17929 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:07:05.379179 17893 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.420351 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.387603 17753 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:05.416363 17932 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:05.442539 17698 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:05.443838 17377 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:05.444253 17377 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:05.443984 17846 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.445204 17577 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:05.445092 17377 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.446604 17377 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.451094 17368 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.462280 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:05.464123 17783 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.464376 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:05.465046 17783 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:05.465328 17818 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.466388 17377 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:05.467507 17806 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:05.467948 17806 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:05.468972 17806 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.473479 17704 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:05.474697 15726 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:05.476347 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.476658 17893 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.477115 17893 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.478190 15647 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:05.478796 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:05.479712 15653 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:05.465093 17368 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:05.481505 17671 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.482892 17704 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:05.484830 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.488329 17806 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.466562 17818 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:05.490389 17818 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:05.493273 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:05.493505 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:05.494588 15648 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.494009 15653 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:05.503633 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.505378 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 125413us
I20260709 13:07:05.506429 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:05.531059 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.531916 15651 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:07:05.531438 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.516137 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.517976 17846 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:05.540267 15647 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:05.540375 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.564438 17939 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:05.516088 17522 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.547351 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.551375 17670 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:05.553333 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.560263 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:05.561508 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:05.561997 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.562772 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.576331 15722 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.543401 17893 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:05.568622 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.570585 15576 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:05.579082 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:05.579944 15578 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.581326 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:05.565989 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:05.586990 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:05.589859 16272 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:05.591208 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.598100 15648 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:05.608525 15651 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:07:05.610471 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:05.586701 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:05.628011 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.628754 15726 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.636368 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:05.637072 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.637125 15651 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:07:05.609597 15578 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:05.606573 17670 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:05.644932 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 136129us
I20260709 13:07:05.645753 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:05.646865 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:05.650291 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:05.651638 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:05.605994 17754 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:05.660683 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92180us
I20260709 13:07:05.664156 17940 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.667551 15726 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:05.667620 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:05.663224 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:05.671499 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.672194 15727 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:05.672186 17535 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.644446 15574 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:05.646236 17589 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:05.672756 17535 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:05.687441 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:05.670321 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.888s (SENT)
I20260709 13:07:05.657078 17893 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.656803 17872 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.673053 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:05.688248 15726 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.654454 15721 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:07:05.692837 16236 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.386s (SENT)
I20260709 13:07:05.697371 15729 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:05.649031 17753 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:05.693005 15727 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:05.648389 17522 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:05.649194 17291 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:05.707826 15576 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:05.708276 15576 pending_rounds.cc:85] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 5
I20260709 13:07:05.708304 15726 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:05.708643 15576 pending_rounds.cc:107] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:05.708946 15576 raft_consensus.cc:2889] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.679148 17704 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:05.712709 15575 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.691666 17535 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.716665 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:05.717335 15578 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.717069 15619 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:05.697539 17872 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:05.691664 17589 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:05.689455 17920 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:07:05.690272 17778 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:05.699411 17724 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:07:05.930399 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.462340 17753 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:06.149560 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.872936 15578 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:06.055019 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 338796us
I20260709 13:07:06.562085 15578 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:06.562389 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:06.581233 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 734466us
W20260709 13:07:06.559580 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.623463 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:06.562368 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:06.625980 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 64349.5us
I20260709 13:07:06.626976 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:05.811225 17945 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:07:06.409372 17648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.014s	sys 0.041s
I20260709 13:07:05.725953 17852 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.427871 17915 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:05.728430 17872 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.388103 16271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.005s	sys 0.004s
I20260709 13:07:06.683748 15579 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:06.587464 17754 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:06.022326 17818 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.791960 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.716110 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:06.722750 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:06.723615 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 865) took 1638 ms. Trace:
I20260709 13:07:06.723954 16270 rpcz_store.cc:276] 0709 13:07:05.085615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.099588 (+ 13973us) service_pool.cc:224] Handling call
0709 13:07:06.722631 (+1623043us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eeeee 0000000000375939 00007f2d9a9621e0 00007f2d9aa2b0c4 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:06.723553 (+   922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17552640}
I20260709 13:07:06.725538 16270 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:06.691540 17852 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.726482 17852 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.726701 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 674) took 1009 ms. Trace:
I20260709 13:07:06.727110 16270 rpcz_store.cc:276] 0709 13:07:05.717491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.724953 (+1007462us) service_pool.cc:224] Handling call
0709 13:07:06.725339 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.725888 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.726516 (+   628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.728753 16270 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:06.729341 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 675) took 1011 ms. Trace:
I20260709 13:07:06.729664 16270 rpcz_store.cc:276] 0709 13:07:05.717762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.728100 (+1010338us) service_pool.cc:224] Handling call
0709 13:07:06.728412 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.729104 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.729290 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.730568 17901 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 2.173s	user 0.010s	sys 0.044s
I20260709 13:07:06.730898 16270 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEARNER]: Advancing to term 4
W20260709 13:07:06.731318 17806 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.242s	user 0.010s	sys 0.000s
I20260709 13:07:06.732518 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:06.733325 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 471) took 1042 ms. Trace:
I20260709 13:07:06.735093 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 892) took 1174 ms. Trace:
I20260709 13:07:06.735455 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 677) took 1014 ms. Trace:
I20260709 13:07:06.735608 16278 rpcz_store.cc:276] 0709 13:07:05.560853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.734087 (+1173234us) service_pool.cc:224] Handling call
0709 13:07:06.734477 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.734716 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.734755 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.734798 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.734831 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.734896 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.735028 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.735952 16276 rpcz_store.cc:276] 0709 13:07:05.721824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.734678 (+1012854us) service_pool.cc:224] Handling call
0709 13:07:06.734963 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.735137 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.735164 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.735203 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:06.735239 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.735292 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.735390 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.737985 16278 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:06.739957 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 678) took 1017 ms. Trace:
W20260709 13:07:06.250056 17880 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.523s	user 0.000s	sys 0.016s
I20260709 13:07:06.020534 17933 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:05.716794 17704 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:06.707705 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1527) took 1887 ms. Trace:
I20260709 13:07:06.752767 15579 rpcz_store.cc:276] 0709 13:07:04.832168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.832317 (+   149us) service_pool.cc:224] Handling call
0709 13:07:06.676916 (+1844599us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:06.677121 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.707407 (+ 30286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.707637 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32432512}
I20260709 13:07:06.622387 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:06.688875 17648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.018s	sys 0.043s
W20260709 13:07:06.389838 17940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.031s	sys 0.017s
I20260709 13:07:06.156854 17615 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.545s
I20260709 13:07:05.809924 17949 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 1.003s
I20260709 13:07:06.680930 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 890) took 1119 ms. Trace:
I20260709 13:07:06.740527 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1529) took 1861 ms. Trace:
W20260709 13:07:06.759907 16237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.016s	sys 0.016s
I20260709 13:07:06.750713 17724 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.733650 15726 rpcz_store.cc:276] 0709 13:07:05.691192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.732256 (+1041064us) service_pool.cc:224] Handling call
0709 13:07:06.733269 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.762704 16237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.016s	sys 0.016s
W20260709 13:07:06.758833 17940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.031s	sys 0.017s
I20260709 13:07:06.740326 16278 rpcz_store.cc:276] 0709 13:07:05.722642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.737205 (+1014563us) service_pool.cc:224] Handling call
0709 13:07:06.737586 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.739669 (+  2083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.739896 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.718245 16271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.005s	sys 0.005s
I20260709 13:07:06.566215 17753 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:06.749523 16276 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:06.760691 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.762543 15572 rpcz_store.cc:276] 0709 13:07:04.879011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.910060 (+ 31049us) service_pool.cc:224] Handling call
0709 13:07:04.910467 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.327979 (+417512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.740217 (+1412238us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54003f9dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:06.740448 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958720768}
I20260709 13:07:06.742152 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 886) took 1356 ms. Trace:
W20260709 13:07:06.754855 17945 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:06.712325 17915 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:06.765312 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:06.833578 15726 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:06.750156 17818 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:06.827605 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 680) took 1051 ms. Trace:
I20260709 13:07:06.827049 16272 rpcz_store.cc:276] 0709 13:07:05.385340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.387411 (+  2071us) service_pool.cc:224] Handling call
0709 13:07:05.553135 (+165724us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:06.741964 (+1188829us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54005f1c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:06.742095 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38888704}
I20260709 13:07:06.749110 17780 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:06.835541 16276 rpcz_store.cc:276] 0709 13:07:05.776407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.737596 (+961189us) service_pool.cc:224] Handling call
0709 13:07:06.737946 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.827190 (+ 89244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.827523 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.831763 15727 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:06.836695 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 473) took 1055 ms. Trace:
I20260709 13:07:06.838193 15726 rpcz_store.cc:276] 0709 13:07:05.781065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.765005 (+983940us) service_pool.cc:224] Handling call
0709 13:07:06.836629 (+ 71624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.839346 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:06.840005 15726 raft_consensus.cc:2376] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4. Re-sending same reply.
I20260709 13:07:06.768150 15721 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:06.841684 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 470) took 1153 ms. Trace:
I20260709 13:07:06.843700 17818 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:06.843794 15727 rpcz_store.cc:276] 0709 13:07:05.688150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.750450 (+1062300us) service_pool.cc:224] Handling call
0709 13:07:06.841627 (+ 91177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.844653 17753 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:06.857066 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.845017 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.866766 15727 raft_consensus.cc:2410] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:06.867540 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.868672 15726 raft_consensus.cc:2410] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:06.869659 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.871548 15726 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 3: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:06.829658 17648 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.766588 17940 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:06.765290 17783 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:06.772447 17589 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:06.883009 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 396) took 4986 ms. Trace:
I20260709 13:07:06.773027 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 679) took 1050 ms. Trace:
I20260709 13:07:06.885560 15580 rpcz_store.cc:276] 0709 13:07:01.887052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.970940 (+ 83888us) service_pool.cc:224] Handling call
0709 13:07:02.007769 (+ 36829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.074510 (+ 66741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.074542 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.078678 (+  4136us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.699843 (+1621165us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800359ce0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:07:03.975791 (+275948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.975831 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.975915 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.691865 (+1715950us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:06.872824 (+1180959us) raft_consensus.cc:1685] finished
0709 13:07:06.872846 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.872982 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83333,"raft.queue_time_us":78980,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":87863,"spinlock_wait_cycles":32986112,"thread_start_us":275769,"threads_started":1,"wal-append.queue_time_us":2078205}
I20260709 13:07:06.833205 17724 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:06.757091 17933 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:06.870198 17818 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.902632 16236 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.052s	sys 0.075s
W20260709 13:07:06.903117 16236 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.052s	sys 0.075s
W20260709 13:07:06.903445 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 892020us
W20260709 13:07:06.867551 17577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.015s	sys 0.015s
I20260709 13:07:06.919166 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:06.904533 17836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.023s	sys 0.023s
I20260709 13:07:06.919965 15723 raft_consensus.cc:2368] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5.
I20260709 13:07:06.894559 17648 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:06.925272 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:06.891096 17783 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:06.974131 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.977195 15723 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:06.919124 15621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.012s	sys 0.031s
W20260709 13:07:06.984869 15621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.037s
I20260709 13:07:06.890692 16275 rpcz_store.cc:276] 0709 13:07:05.724224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.541408 (+817184us) service_pool.cc:224] Handling call
0709 13:07:06.772940 (+231532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.061298 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:06.919723 17949 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.061954 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 136769us
W20260709 13:07:07.100186 16236 connection.cc:256] RPC call timeout handler was delayed by -1.0430745690000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:07:07.100610 16236 connection.cc:256] RPC call timeout handler was delayed by -1.0169745690000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:07:07.072609 17954 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:07.103202 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.104140 16276 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:07.073410 17956 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:07:07.073529 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.075771 17933 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.076197 17940 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.076455 17852 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.082767 17704 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.084568 17583 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.089269 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:07.124477 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.091002 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:07.124598 15580 raft_consensus.cc:2368] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:07.125365 15572 raft_consensus.cc:2368] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
W20260709 13:07:07.092168 15473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 251) took 12274 ms (client timeout 15000 ms). Trace:
I20260709 13:07:07.092459 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:07.124670 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 496524us
I20260709 13:07:07.092938 17427 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.093560 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.094123 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.095129 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.127652 15575 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:07.128042 15577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.003s	sys 0.024s
W20260709 13:07:06.926257 17836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.023s	sys 0.023s
W20260709 13:07:07.104959 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 476209us
I20260709 13:07:07.150384 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:07.107625 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.151398 16276 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:07.152222 17725 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.152347 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.152690 17725 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:06.933177 17920 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.975780 17958 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.199s
I20260709 13:07:07.112035 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.163699 15723 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:07:07.127744 17933 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:07.134706 17848 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:06.905908 17818 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.090850 17915 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:06.922773 17577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.015s	sys 0.015s
I20260709 13:07:07.061161 17698 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.129721 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.173246 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:07.130311 15579 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:07.129052 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:07.132256 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.133196 17783 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.133314 17427 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.134063 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.125394 17724 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.134545 17583 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.135057 17806 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:07.135397 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:06.765074 16273 rpcz_store.cc:276] 0709 13:07:05.560340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.566743 (+  6403us) service_pool.cc:224] Handling call
0709 13:07:05.567109 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.567475 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.567507 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.567988 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.665246 (+ 97258us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.668631 (+  3385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.686453 (+ 17822us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.838326 (+151873us) raft_consensus.cc:1685] finished
0709 13:07:05.838363 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.679234 (+840871us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":82665,"threads_started":1,"wal-append.queue_time_us":242151}
I20260709 13:07:07.133308 17852 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.136715 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:07.207401 15648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1572) took 1510 ms (client timeout 1976 ms). Trace:
W20260709 13:07:07.207881 15648 rpcz_store.cc:269] 0709 13:07:05.696992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.697204 (+   212us) service_pool.cc:224] Handling call
0709 13:07:07.136567 (+1439363us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:07.207332 (+ 70765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542976}
I20260709 13:07:07.137648 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.106524 17789 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.972097 17753 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
W20260709 13:07:07.126185 15473 rpcz_store.cc:269] 0709 13:06:54.818247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.818405 (+   158us) service_pool.cc:224] Handling call
0709 13:07:07.092070 (+12273665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:01.975280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:01.975939 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:01.975983 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:01.976000 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:01.976841 (+   841us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:01.976936 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:01.976962 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:02.243449 (+266487us) tablet.cc:701] Row locks acquired
0709 13:07:02.276281 (+ 32832us) write_op.cc:260] PREPARE: finished
0709 13:07:02.276515 (+   234us) write_op.cc:270] Start()
0709 13:07:02.276704 (+   189us) write_op.cc:276] Timestamp: P: 1783602422276417 usec, L: 0
0709 13:07:02.276729 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:02.277529 (+   800us) log.cc:844] Serialized 2452 byte log entry
0709 13:07:03.313151 (+1035622us) op_driver.cc:464] REPLICATION: finished
0709 13:07:04.106554 (+793403us) write_op.cc:301] APPLY: starting
0709 13:07:04.108411 (+  1857us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:04.158753 (+ 50342us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:04.346913 (+188160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:04.449393 (+102480us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:04.449721 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:04.449764 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:04.450015 (+   251us) log.cc:844] Serialized 53 byte log entry
0709 13:07:04.500483 (+ 50468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.500826 (+   343us) write_op.cc:454] Released schema lock
0709 13:07:04.500967 (+   141us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:04.502862 (+  1895us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.503038 (+   176us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":850138,"reported_tablets":13,"spinlock_wait_cycles":407680,"child_traces":[["op",{"apply.queue_time_us":716741,"apply.run_cpu_time_us":29322,"apply.run_wall_time_us":433688,"num_ops":6,"prepare.queue_time_us":571638,"prepare.run_cpu_time_us":25470,"prepare.run_wall_time_us":815094,"raft.queue_time_us":227261,"raft.run_cpu_time_us":53361,"raft.run_wall_time_us":677346,"replication_time_us":1036253,"thread_start_us":1476262,"threads_started":5,"wal-append.queue_time_us":683497,"wal-append.run_cpu_time_us":21335,"wal-append.run_wall_time_us":2394844}]]}
I20260709 13:07:07.139010 17670 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.139724 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:07.147287 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.147325 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:07.216122 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 68905.1us
W20260709 13:07:06.975996 17535 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.200s	user 0.009s	sys 0.002s
I20260709 13:07:07.153595 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:07.224529 16276 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.155117 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 420) took 1438 ms. Trace:
I20260709 13:07:07.153764 17920 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:07.125727 17954 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:07.113070 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 417) took 2627 ms. Trace:
W20260709 13:07:07.145953 17851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.018s	sys 0.010s
I20260709 13:07:07.112120 17949 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.174269 15543 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.618s (SENT)
W20260709 13:07:07.245635 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71412.4us
I20260709 13:07:07.155984 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.178243 15575 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:07.180562 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1644) took 1917 ms. Trace:
I20260709 13:07:07.175516 17704 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:07.181948 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.183531 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.182263 17427 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:07.185392 15572 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.217636 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:07.220232 15651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1571) took 1553 ms (client timeout 1912 ms). Trace:
I20260709 13:07:07.220788 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:07.225488 15577 rpcz_store.cc:276] 0709 13:07:05.716216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.720293 (+  4077us) service_pool.cc:224] Handling call
0709 13:07:05.771667 (+ 51374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.771938 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:06.580789 (+808851us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.150391 (+569602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.154772 (+  4381us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.154829 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.154899 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.155038 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":808629,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":20784,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7472,"thread_start_us":569229,"threads_started":1}
I20260709 13:07:07.153570 17725 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.171622 17968 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:07.240618 15655 rpcz_store.cc:276] 0709 13:07:04.485972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.486164 (+   192us) service_pool.cc:224] Handling call
0709 13:07:04.527743 (+ 41579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.557542 (+ 29799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.112781 (+2555239us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b540006a9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:07.112991 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67100416}
W20260709 13:07:07.247094 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 107476us
I20260709 13:07:07.250547 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.249981 15728 rpcz_store.cc:276] 0709 13:07:05.262923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.575709 (+312786us) service_pool.cc:224] Handling call
0709 13:07:05.576105 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.587805 (+ 11700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.587853 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.607153 (+ 19300us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.022087 (+414934us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.022144 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.022244 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.180360 (+1158116us) raft_consensus.cc:1685] finished
0709 13:07:07.180380 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.180501 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8406,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":19296,"thread_start_us":372685,"threads_started":1,"wal-append.queue_time_us":1122557}
I20260709 13:07:07.165815 17848 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:07.258589 15579 raft_consensus.cc:2410] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:07.235147 17959 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:07.245251 17851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.018s	sys 0.011s
I20260709 13:07:07.182364 17698 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.166646 17933 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.214957 17806 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.214681 17583 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.262434 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:07.320084 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:07.321606 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:07.259536 15618 connection.cc:256] RPC call timeout handler was delayed by -1.3630976540000574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3014s for a response
W20260709 13:07:07.390013 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 169315us
I20260709 13:07:07.391402 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:07.218374 17965 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.233911 17789 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:07.298890 15651 rpcz_store.cc:269] 0709 13:07:05.666420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.666578 (+   158us) service_pool.cc:224] Handling call
0709 13:07:07.137516 (+1470938us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:07.220156 (+ 82640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9624960}
I20260709 13:07:07.300237 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:07.301080 15723 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:07.402536 15579 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:07.404469 15692 connection.cc:256] RPC call timeout handler was delayed by -3.9493082000000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:07:07.404299 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.405592 15728 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:07:07.408164 15692 connection.cc:256] RPC call timeout handler was delayed by -3.8323081999999431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:07:07.408758 15692 connection.cc:256] RPC call timeout handler was delayed by -3.8215081999999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:07:07.409235 15692 connection.cc:256] RPC call timeout handler was delayed by -3.8026082000000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:07:07.407773 15572 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:07.260133 16275 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
W20260709 13:07:07.411886 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 282917us
I20260709 13:07:07.251531 17816 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:07.429011 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:07.430285 15728 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:07.430495 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:07.431021 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1649) took 2166 ms. Trace:
I20260709 13:07:07.431593 15728 rpcz_store.cc:276] 0709 13:07:05.264102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.429555 (+2165453us) service_pool.cc:224] Handling call
0709 13:07:07.429915 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.430740 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.430961 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.432329 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:07.433478 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1411856699999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:07:07.417311 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 95818.4us
I20260709 13:07:07.437383 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:07.433539 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.414261 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:07.439249 15572 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:07.235524 17535 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:07.409760 15692 connection.cc:256] RPC call timeout handler was delayed by -3.6595082000000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:07:07.445963 15692 connection.cc:256] RPC call timeout handler was delayed by -3.5623081999999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:07:07.446480 15692 connection.cc:256] RPC call timeout handler was delayed by -3.4885081999999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:07:07.446913 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3823082000000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:07:07.447304 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3697081999999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 13:07:07.447492 15578 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
W20260709 13:07:07.447701 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3688081999999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:07:07.448165 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3661081999999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:07:07.369686 17725 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.442150 15575 raft_consensus.cc:2410] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:07.448563 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3418081999999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:07:07.454512 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.449765 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:07.463064 15579 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:07.400218 17965 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.449774 15577 raft_consensus.cc:2368] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:07.451419 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.234730 17670 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.454427 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3265081999999211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 13:07:07.466609 15692 connection.cc:256] RPC call timeout handler was delayed by -3.3193082000000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:07:07.255465 17970 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.409145 17958 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.400264 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:07.407981 17783 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.260318 17704 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.472102 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.412037 17982 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:07.480383 17982 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.440318 17753 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.451195 17959 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.445565 17955 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.484308 15580 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:07.505908 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:07.467788 17915 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.455929 17836 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.401190 17968 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.511886 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.513845 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.474731 17783 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.303928 17920 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.446427 17816 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.471063 17965 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.555341 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:07.516325 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 83930.1us
I20260709 13:07:07.567121 15650 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:07.557777 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:07.567802 15572 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:07.568650 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:07.569201 15572 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:07.574263 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 144413us
I20260709 13:07:07.575174 16236 leader_election.cc:400] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5.
W20260709 13:07:07.575892 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.576416 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:07.577973 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:07.522476 15652 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.515416 17958 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.523108 17975 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.515102 17987 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.588971 17949 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:07.554895 17982 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.562327 17915 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.446061 17954 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.558670 17851 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.558856 17783 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.477517 17427 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.508097 17990 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:07.699523 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 91487.9us
I20260709 13:07:07.723925 15572 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:07.726238 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.741498 15650 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:07.726596 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 150118us
I20260709 13:07:07.567741 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:07.590247 17959 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.591362 17955 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.515161 17848 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.605350 17976 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:07.604583 17818 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.590430 17988 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.646311 17915 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:07.772185 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 174097us
I20260709 13:07:07.726581 17851 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.773416 17994 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.596751 17836 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:07.593568 17970 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:07.820860 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43544.9us
W20260709 13:07:07.806164 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 371614us
W20260709 13:07:07.819628 15724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2107) took 3139 ms (client timeout 1618 ms). Trace:
W20260709 13:07:07.822152 15724 rpcz_store.cc:269] 0709 13:07:04.679701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.680425 (+   724us) service_pool.cc:224] Handling call
0709 13:07:07.819384 (+3138959us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:07.819545 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320454400}
W20260709 13:07:07.800485 17966 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 13:07:07.789896 17427 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.598929 17975 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.806460 17973 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.502s	user 0.001s	sys 0.001s
I20260709 13:07:07.835538 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:07.799515 17990 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.793990 17991 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.869801 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.809953 17806 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.875439 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.777920 17864 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:07:07.880131 15724 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:07.831430 17535 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.885174 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:07.827553 18001 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:07.726428 17987 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.833921 17698 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.825234 17583 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.794787 17993 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:07.830579 17955 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:07:07.801386 17976 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.828194 17970 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.811895 17988 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:07.876099 17724 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:07:07.875075 17849 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:07:07.973667 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.829533 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2116) took 2464 ms. Trace:
W20260709 13:07:07.878249 17974 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:07:07.834259 17789 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:07.879684 17990 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:08.010990 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 134757us
W20260709 13:07:08.013592 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.976861 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1524) took 3166 ms (client timeout 2110 ms). Trace:
I20260709 13:07:07.830729 17994 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.978209 17872 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.258s	user 0.008s	sys 0.004s
I20260709 13:07:08.045122 17975 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:08.058312 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.058204 17872 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.930342 17981 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
W20260709 13:07:08.059744 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 472) took 2346 ms (client timeout 1940 ms). Trace:
W20260709 13:07:08.060231 15721 rpcz_store.cc:269] 0709 13:07:05.713076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.721796 (+  8720us) service_pool.cc:224] Handling call
0709 13:07:08.059545 (+2337749us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54001fcf54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.059668 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96809344}
I20260709 13:07:08.061331 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1646) took 2797 ms. Trace:
I20260709 13:07:08.061933 15726 rpcz_store.cc:276] 0709 13:07:05.263386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.878191 (+1614805us) service_pool.cc:224] Handling call
0709 13:07:06.885066 (+  6875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.164693 (+279627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.164735 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.167802 (+  3067us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.223546 (+ 55744us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:07.223764 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.223845 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.061077 (+837232us) raft_consensus.cc:1685] finished
0709 13:07:08.061101 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.061261 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242371,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":9980,"thread_start_us":329498,"threads_started":2,"wal-append.queue_time_us":294958}
I20260709 13:07:08.061487 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:07.980997 17816 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.063724 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:07.910360 17670 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.055462 17970 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:07.886475 17806 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.178807 15726 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:08.015355 18001 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:07:08.010087 16270 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.279s	user 0.013s	sys 0.000s
I20260709 13:07:08.179499 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2118) took 2814 ms. Trace:
I20260709 13:07:08.179738 16270 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:08.179864 15726 rpcz_store.cc:276] 0709 13:07:05.365367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.178332 (+2812965us) service_pool.cc:224] Handling call
0709 13:07:08.178644 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.179257 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.179447 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.180500 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 676) took 2462 ms. Trace:
I20260709 13:07:07.888414 17996 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.180653 17990 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.057595 17933 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:08.178448 17806 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:07.955255 17978 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
W20260709 13:07:08.059713 15573 rpcz_store.cc:269] 0709 13:07:04.809781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.824649 (+ 14868us) service_pool.cc:224] Handling call
0709 13:07:07.973729 (+3149080us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54000c7bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:07.973895 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855914752}
I20260709 13:07:08.181659 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2119) took 2816 ms. Trace:
I20260709 13:07:08.212389 15726 rpcz_store.cc:276] 0709 13:07:05.365581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.180764 (+2815183us) service_pool.cc:224] Handling call
0709 13:07:08.181126 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.181336 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.181373 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.181430 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.181471 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.181519 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.181611 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.134924 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 3.112s (SENT)
I20260709 13:07:07.879000 17991 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:07.954967 17704 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.054980 16269 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
W20260709 13:07:08.044514 17989 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
W20260709 13:07:08.043782 17972 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
W20260709 13:07:08.213680 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 78818.9us
I20260709 13:07:08.049096 17851 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.209420 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.230408 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1532) took 1078 ms. Trace:
I20260709 13:07:08.230756 15573 rpcz_store.cc:276] 0709 13:07:07.151857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.209148 (+1057291us) service_pool.cc:224] Handling call
0709 13:07:08.230348 (+ 21200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.231667 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.232352 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1516) took 1134 ms. Trace:
I20260709 13:07:08.232635 15573 rpcz_store.cc:276] 0709 13:07:07.097737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.231413 (+1133676us) service_pool.cc:224] Handling call
0709 13:07:08.232303 (+   890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.233455 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:08.214272 16272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.012s	sys 0.016s
I20260709 13:07:08.211534 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:08.234341 16272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.012s	sys 0.017s
I20260709 13:07:08.235318 17999 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.235754 15618 leader_election.cc:400] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4.
I20260709 13:07:08.236146 15618 leader_election.cc:403] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:07:08.237340 17535 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4.
I20260709 13:07:08.238528 16278 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:08.053428 17914 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:08.044314 17968 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.212131 17724 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:08.235423 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 505) took 1133 ms. Trace:
I20260709 13:07:08.245204 16272 rpcz_store.cc:276] 0709 13:07:07.102280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.102510 (+   230us) service_pool.cc:224] Handling call
0709 13:07:07.124224 (+ 21714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.124456 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:07.273618 (+149162us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.234972 (+961354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.235067 (+    95us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.235130 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.235210 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.235357 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267749,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":5448,"thread_start_us":1069966,"threads_started":2}
I20260709 13:07:08.046087 17987 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:08.017194 17852 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.202s
I20260709 13:07:08.057528 17976 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:08.180956 18001 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:08.241282 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.242527 15721 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:08.269408 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.012s	sys 0.006s
W20260709 13:07:08.270744 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.012s	sys 0.006s
I20260709 13:07:08.244246 15726 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:08.180860 16270 rpcz_store.cc:276] 0709 13:07:05.717993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.730443 (+1012450us) service_pool.cc:224] Handling call
0709 13:07:06.730745 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.180213 (+1449468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.180443 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.233950 15573 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:08.271283 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 803938us
I20260709 13:07:08.271612 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2121) took 2905 ms. Trace:
I20260709 13:07:08.276895 15726 rpcz_store.cc:276] 0709 13:07:05.366138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.229926 (+2863788us) service_pool.cc:224] Handling call
0709 13:07:08.243439 (+ 13513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.271342 (+ 27903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.271555 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.272578 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.241357 17914 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:08.274293 17994 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.280068 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:08.212013 18000 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:08.282282 15649 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:08.306574 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1647) took 3043 ms. Trace:
I20260709 13:07:08.307053 15727 rpcz_store.cc:276] 0709 13:07:05.263631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.885369 (+1621738us) service_pool.cc:224] Handling call
0709 13:07:06.903004 (+ 17635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.191694 (+288690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.191742 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.246747 (+ 55005us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.452004 (+205257us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.452062 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.452363 (+   301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.306403 (+854040us) raft_consensus.cc:1685] finished
0709 13:07:08.306419 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.306518 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":229699,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"thread_start_us":374383,"threads_started":2,"wal-append.queue_time_us":278426}
I20260709 13:07:07.929255 17836 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.251811 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 504) took 1150 ms. Trace:
I20260709 13:07:08.278860 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:08.343374 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64610.6us
I20260709 13:07:08.344285 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:08.309386 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:08.314527 15727 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.369563 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 464) took 2807 ms. Trace:
I20260709 13:07:08.370098 15727 rpcz_store.cc:276] 0709 13:07:05.561702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.308665 (+2746963us) service_pool.cc:224] Handling call
0709 13:07:08.314353 (+  5688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.369171 (+ 54818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.369477 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.177341 15725 rpcz_store.cc:276] 0709 13:07:05.364867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.558553 (+2193686us) service_pool.cc:224] Handling call
0709 13:07:07.647641 (+ 89088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.765287 (+117646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.771421 (+  6134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.777346 (+  5925us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.794836 (+ 17490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.806671 (+ 11835us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.825827 (+ 19156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.340195 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 69760.4us
W20260709 13:07:08.371793 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.311877 15544 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.018s	sys 0.001s
W20260709 13:07:08.373337 15544 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.019s	sys 0.001s
W20260709 13:07:08.373720 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 576192us
W20260709 13:07:08.374401 15544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.045s (SENT) [suppressed 34 similar messages]
I20260709 13:07:08.403942 15726 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:08.404671 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 463) took 2843 ms. Trace:
I20260709 13:07:08.404979 15726 rpcz_store.cc:276] 0709 13:07:05.561428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.288164 (+2726736us) service_pool.cc:224] Handling call
0709 13:07:08.403755 (+115591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.404433 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.404616 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.409251 15727 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.410171 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 465) took 2848 ms. Trace:
I20260709 13:07:08.410573 15727 rpcz_store.cc:276] 0709 13:07:05.561970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.371252 (+2809282us) service_pool.cc:224] Handling call
0709 13:07:08.408987 (+ 37735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.409801 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.410102 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.415256 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71088.9us
I20260709 13:07:08.181901 17996 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.416530 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:08.416754 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:08.308151 17940 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.247954 17724 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.429188 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:08.422879 15727 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:08.414667 18004 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.495s	user 0.001s	sys 0.000s
I20260709 13:07:08.423899 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:08.419732 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:08.441962 15726 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:08.443234 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.445220 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.423674 17933 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:08.447620 18011 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:08.447862 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.447984 17933 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.448457 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:08.448983 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.449220 15727 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:08.449601 17670 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:08.450111 17670 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:08.450277 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:08.451012 17670 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:08.453213 17975 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:08.435073 17982 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:08.314464 16269 rpcz_store.cc:276] 0709 13:07:07.101608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.105934 (+  4326us) service_pool.cc:224] Handling call
0709 13:07:08.054386 (+948452us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:08.054628 (+   242us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:08.227491 (+172863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.250750 (+ 23259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23531392}
I20260709 13:07:08.447685 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:08.454502 17982 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.456326 15573 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:07:08.456871 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1529) took 1305 ms. Trace:
I20260709 13:07:08.457247 15573 rpcz_store.cc:276] 0709 13:07:07.150959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.233247 (+1082288us) service_pool.cc:224] Handling call
0709 13:07:08.456790 (+223543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.435284 17704 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:08.458268 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.459396 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:08.459888 15573 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.447080 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.450359 15727 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:08.408102 17976 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.462633 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 466) took 2878 ms. Trace:
I20260709 13:07:08.462682 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.472622 15727 rpcz_store.cc:276] 0709 13:07:05.584303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.449799 (+2865496us) service_pool.cc:224] Handling call
0709 13:07:08.450088 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.462398 (+ 12310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.462583 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.466679 18006 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:08.467344 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:08.477264 17952 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 2.444s	user 0.011s	sys 0.003s
I20260709 13:07:08.316489 17994 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:07:08.426261 17940 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.457785 17982 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:08.499691 18007 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:07:08.499588 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1573) took 2779 ms. Trace:
W20260709 13:07:08.474493 18003 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:07:08.464867 17698 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.471720 17970 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.512403 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.481159 17933 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.502126 17940 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:08.545521 18008 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:08.546120 17724 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:08.548983 17965 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.000s
I20260709 13:07:08.549757 17991 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:08.551498 15573 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:08.551828 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.561587 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.562893 15573 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:08.564200 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.514636 17698 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.558637 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.523201 17970 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.487133 17789 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:08.564940 15573 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:08.553128 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 102037us
I20260709 13:07:08.569484 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1648) took 3305 ms. Trace:
I20260709 13:07:08.570976 15723 rpcz_store.cc:276] 0709 13:07:05.263870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.427229 (+2163359us) service_pool.cc:224] Handling call
0709 13:07:07.455678 (+ 28449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.718381 (+262703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.718425 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.719042 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.820978 (+101936us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:07.821303 (+   325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.821518 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.569197 (+747679us) raft_consensus.cc:1685] finished
0709 13:07:08.569224 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.569404 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191281,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":26014,"thread_start_us":300250,"threads_started":2,"wal-append.queue_time_us":134823}
I20260709 13:07:08.572958 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1645) took 3309 ms. Trace:
W20260709 13:07:08.555507 18005 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:07:08.573427 15722 rpcz_store.cc:276] 0709 13:07:05.263162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.597973 (+334811us) service_pool.cc:224] Handling call
0709 13:07:05.598399 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.598838 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.598893 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.606853 (+  7960us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.686731 (+ 79878us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:05.686768 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.686827 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.468070 (+2781243us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:08.566142 (+ 98072us) raft_consensus.cc:1685] finished
0709 13:07:08.566161 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.572900 (+  6739us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5008,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5038,"spinlock_wait_cycles":286014208,"thread_start_us":43353,"threads_started":1,"wal-append.queue_time_us":145643}
I20260709 13:07:08.571638 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.527770 17729 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:08.579177 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:08.579304 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.583325 15573 raft_consensus.cc:2368] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:07:08.583981 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1517) took 1486 ms. Trace:
I20260709 13:07:08.584445 15573 rpcz_store.cc:276] 0709 13:07:07.097991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.578988 (+1480997us) service_pool.cc:224] Handling call
0709 13:07:08.583906 (+  4918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.585665 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.586709 15573 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:08.587356 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1522) took 1484 ms. Trace:
I20260709 13:07:08.587836 15573 rpcz_store.cc:276] 0709 13:07:07.102612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.585416 (+1482804us) service_pool.cc:224] Handling call
0709 13:07:08.587289 (+  1873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.589035 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:08.589823 15573 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.559607 17806 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.569950 17698 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.637097 17971 raft_consensus.cc:1064] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:07:08.637665 17893 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.597219 17976 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.601720 15723 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:08.513027 15647 rpcz_store.cc:276] 0709 13:07:05.720525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.723308 (+  2783us) service_pool.cc:224] Handling call
0709 13:07:06.020343 (+297035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.721770 (+701427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.721813 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.723246 (+  1433us) log.cc:844] Serialized 564 byte log entry
0709 13:07:07.161671 (+438425us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.164393 (+  2722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.499105 (+1334712us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400156154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:08.499166 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.499245 (+    79us) raft_consensus.cc:1685] finished
0709 13:07:08.499265 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.499520 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517466496,"thread_start_us":421294,"threads_started":1,"wal-append.queue_time_us":732121}
I20260709 13:07:08.590961 17729 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.564884 17965 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:08.576539 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 891) took 3005 ms. Trace:
W20260709 13:07:08.620419 17915 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.794s	user 0.007s	sys 0.001s
W20260709 13:07:08.625363 17427 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.003s
I20260709 13:07:08.628162 17648 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:08.629504 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1528) took 1479 ms. Trace:
W20260709 13:07:08.633194 17947 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 2.920s	user 0.012s	sys 0.019s
I20260709 13:07:08.634619 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.573508 17970 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.639611 17971 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:08.640600 15543 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.341s (SENT)
I20260709 13:07:08.577339 17988 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.644073 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.672353 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.673177 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 869) took 3550 ms. Trace:
I20260709 13:07:08.673458 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.674129 15650 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:08.673593 16274 rpcz_store.cc:276] 0709 13:07:05.122869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.123134 (+   265us) service_pool.cc:224] Handling call
0709 13:07:05.148876 (+ 25742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.386677 (+237801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.386706 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.465356 (+3078650us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c00012c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:07:08.465737 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.659562 (+193825us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.659599 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.659661 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.672919 (+ 13258us) raft_consensus.cc:1685] finished
0709 13:07:08.672936 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.673120 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233596,"raft.queue_time_us":233150,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5916,"spinlock_wait_cycles":24595840,"thread_start_us":158915,"threads_started":1,"wal-append.queue_time_us":184675}
I20260709 13:07:08.675067 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.676157 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.592542 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2115) took 3228 ms. Trace:
I20260709 13:07:08.678315 15728 rpcz_store.cc:276] 0709 13:07:05.364615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.449190 (+2084575us) service_pool.cc:224] Handling call
0709 13:07:07.470521 (+ 21331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.570461 (+ 99940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.570492 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.572609 (+  2117us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.819100 (+246491us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.819152 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.819225 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.592259 (+773034us) raft_consensus.cc:1685] finished
0709 13:07:08.592289 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.592466 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":361360,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":46613,"thread_start_us":271521,"threads_started":2,"wal-append.queue_time_us":345819}
I20260709 13:07:08.680711 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1656) took 3035 ms. Trace:
I20260709 13:07:08.669324 17994 raft_consensus.cc:2764] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:08.688840 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:08.647010 15722 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:08.690971 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.691205 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1653) took 3047 ms. Trace:
I20260709 13:07:08.591883 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:08.661672 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.691717 15722 rpcz_store.cc:276] 0709 13:07:05.644295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.581991 (+2937696us) service_pool.cc:224] Handling call
0709 13:07:08.582397 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.690887 (+108490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.691138 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.648175 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 468) took 3004 ms. Trace:
I20260709 13:07:08.647300 17893 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:08.662115 17915 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.664114 17965 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:08.665715 15724 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:08.666440 15575 rpcz_store.cc:276] 0709 13:07:07.150621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.250284 (+ 99663us) service_pool.cc:224] Handling call
0709 13:07:08.629295 (+1379011us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000c6cd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.629448 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273832320}
I20260709 13:07:08.668259 15573 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:08.669374 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.713794 15572 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:07:08.714110 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:08.713927 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:08.714681 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:08.691426 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.715168 15572 raft_consensus.cc:2376] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4. Re-sending same reply.
W20260709 13:07:08.715351 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.693475 15723 rpcz_store.cc:276] 0709 13:07:05.644039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.580200 (+2936161us) service_pool.cc:224] Handling call
0709 13:07:08.601485 (+ 21285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.647812 (+ 46327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.648099 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.662213 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.694936 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1657) took 3040 ms. Trace:
I20260709 13:07:08.716552 15722 rpcz_store.cc:276] 0709 13:07:05.655090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.692906 (+3037816us) service_pool.cc:224] Handling call
0709 13:07:08.694288 (+  1382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.694511 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.694548 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.694603 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:08.694648 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.694719 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.694869 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.717835 15722 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.681100 15728 rpcz_store.cc:276] 0709 13:07:05.645110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.679865 (+3034755us) service_pool.cc:224] Handling call
0709 13:07:08.680188 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.680377 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.680405 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.680452 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:08.680489 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.680543 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.680655 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.696816 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 105036us
I20260709 13:07:08.719743 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:08.720805 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.667918 17999 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.712224 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1643) took 3449 ms. Trace:
I20260709 13:07:08.726617 15720 rpcz_store.cc:276] 0709 13:07:05.262674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.563146 (+300472us) service_pool.cc:224] Handling call
0709 13:07:05.563486 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.563848 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.563877 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.564334 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.645252 (+ 80918us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.645295 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.645361 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.632611 (+2987250us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:08.690093 (+ 57482us) raft_consensus.cc:1685] finished
0709 13:07:08.690114 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.712147 (+ 22033us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1047,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":11836672,"thread_start_us":80564,"threads_started":1,"wal-append.queue_time_us":104722}
I20260709 13:07:08.721800 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:08.728652 15578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1518) took 1627 ms (client timeout 2164 ms). Trace:
I20260709 13:07:08.728670 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1659) took 3071 ms. Trace:
W20260709 13:07:08.729104 15578 rpcz_store.cc:269] 0709 13:07:07.101382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.130484 (+ 29102us) service_pool.cc:224] Handling call
0709 13:07:08.728505 (+1598021us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001351d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.728601 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533666560}
I20260709 13:07:08.729296 15722 rpcz_store.cc:276] 0709 13:07:05.657335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.717438 (+3060103us) service_pool.cc:224] Handling call
0709 13:07:08.717680 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.728478 (+ 10798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.728625 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.721995 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:08.731462 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1662) took 3066 ms. Trace:
I20260709 13:07:08.731961 15722 rpcz_store.cc:276] 0709 13:07:05.664641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.730545 (+3065904us) service_pool.cc:224] Handling call
0709 13:07:08.730875 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.731072 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.731108 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.731163 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.731210 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.731275 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.731402 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.733840 15722 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:08.734575 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1663) took 3069 ms. Trace:
I20260709 13:07:08.734994 15722 rpcz_store.cc:276] 0709 13:07:05.664915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.733126 (+3068211us) service_pool.cc:224] Handling call
0709 13:07:08.733460 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.734313 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.734518 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.737838 15576 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:08.738479 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1523) took 1635 ms. Trace:
I20260709 13:07:08.738862 15575 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:08.738756 15576 rpcz_store.cc:276] 0709 13:07:07.102842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.737275 (+1634433us) service_pool.cc:224] Handling call
0709 13:07:08.737586 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.738261 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.738433 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.739585 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1525) took 1625 ms. Trace:
I20260709 13:07:08.739935 15575 rpcz_store.cc:276] 0709 13:07:07.114285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.738385 (+1624100us) service_pool.cc:224] Handling call
0709 13:07:08.738663 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.739348 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.739539 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.749465 15722 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:08.751881 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:08.753365 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:08.753892 17965 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.754936 17965 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:08.755324 17965 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.758373 18001 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.759688 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:08.760284 17840 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:08.765903 17840 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:08.766767 17840 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:08.760699 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:08.772532 18001 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.774652 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:08.775252 17857 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:08.776063 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:08.780946 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:08.782811 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1658) took 3126 ms. Trace:
I20260709 13:07:08.783077 15572 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:08.783630 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1520) took 1681 ms. Trace:
I20260709 13:07:08.783979 15572 rpcz_store.cc:276] 0709 13:07:07.102068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.737444 (+1635376us) service_pool.cc:224] Handling call
0709 13:07:08.782760 (+ 45316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.783416 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.783582 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.783234 15723 rpcz_store.cc:276] 0709 13:07:05.656443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.716227 (+3059784us) service_pool.cc:224] Handling call
0709 13:07:08.782324 (+ 66097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.782524 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.782545 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.782584 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.782616 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.782666 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.782760 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.790231 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1664) took 3076 ms. Trace:
I20260709 13:07:08.700771 17988 raft_consensus.cc:2764] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:07:08.712689 15646 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:08.792076 15722 rpcz_store.cc:276] 0709 13:07:05.713956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.735932 (+3021976us) service_pool.cc:224] Handling call
0709 13:07:08.736236 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.750609 (+ 14373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.790173 (+ 39564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.725026 17789 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.793287 15720 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:08.804435 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1661) took 3140 ms. Trace:
I20260709 13:07:08.804759 15720 rpcz_store.cc:276] 0709 13:07:05.664405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.728231 (+3063826us) service_pool.cc:224] Handling call
0709 13:07:08.790998 (+ 62767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.804173 (+ 13175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.804379 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.795637 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.739830 17976 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.737699 17427 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.817378 15578 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:08.821887 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1544) took 1694 ms. Trace:
I20260709 13:07:08.822258 15578 rpcz_store.cc:276] 0709 13:07:07.127735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.785258 (+1657523us) service_pool.cc:224] Handling call
0709 13:07:08.816961 (+ 31703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.821642 (+  4681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.821832 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.819271 15722 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.828470 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1666) took 1856 ms. Trace:
I20260709 13:07:08.828235 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.784591 17987 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:08.794840 17725 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.326s	user 0.007s	sys 0.005s
W20260709 13:07:08.803907 17783 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.063s	user 0.011s	sys 0.004s
I20260709 13:07:08.792179 17589 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.785403 17857 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:08.816306 18016 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:07:08.750123 17995 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:08.793143 18001 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.802716 17982 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:08.838179 15723 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:08.910167 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2123) took 2736 ms. Trace:
I20260709 13:07:08.910604 15723 rpcz_store.cc:276] 0709 13:07:06.173652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.793784 (+2620132us) service_pool.cc:224] Handling call
0709 13:07:08.830755 (+ 36971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.909844 (+ 79089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.910103 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.915845 15577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1513) took 1820 ms (client timeout 2216 ms). Trace:
W20260709 13:07:08.916271 15577 rpcz_store.cc:269] 0709 13:07:07.095080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.413841 (+318761us) service_pool.cc:224] Handling call
0709 13:07:08.915655 (+1501814us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b5400293e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.915778 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22863616}
I20260709 13:07:08.829561 15722 rpcz_store.cc:276] 0709 13:07:06.972226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.817773 (+1845547us) service_pool.cc:224] Handling call
0709 13:07:08.819109 (+  1336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.828238 (+  9129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.828420 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.851137 17729 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:08.851305 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:08.853328 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1668) took 1104 ms. Trace:
I20260709 13:07:08.854553 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:08.929415 15654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2109) took 1411 ms (client timeout 1682 ms). Trace:
I20260709 13:07:08.802531 18006 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.816905 17789 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.900281 15720 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.905623 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:08.936435 15720 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:08.908896 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1642) took 3646 ms. Trace:
I20260709 13:07:08.937026 15729 rpcz_store.cc:276] 0709 13:07:05.262419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.432707 (+170288us) service_pool.cc:224] Handling call
0709 13:07:05.697154 (+264447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.697737 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.908651 (+3210914us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003becd0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.908823 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607060224}
I20260709 13:07:08.926326 15724 rpcz_store.cc:276] 0709 13:07:07.748518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.884921 (+136403us) service_pool.cc:224] Handling call
0709 13:07:08.853140 (+968219us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540011a8d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:08.853269 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512918272}
W20260709 13:07:08.929968 15654 rpcz_store.cc:269] 0709 13:07:07.518424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.522098 (+  3674us) service_pool.cc:224] Handling call
0709 13:07:08.851164 (+1329066us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:08.929341 (+ 78177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18390272}
I20260709 13:07:08.832168 17976 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:08.834519 17987 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:08.859524 17857 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.911828 17986 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:08.943991 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:08.932688 18022 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:07:08.836987 17427 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:08.904620 18001 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:08.911701 17583 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.946430 15723 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:08.960522 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1667) took 1216 ms. Trace:
I20260709 13:07:08.960959 15723 rpcz_store.cc:276] 0709 13:07:07.743882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.911489 (+1167607us) service_pool.cc:224] Handling call
0709 13:07:08.935574 (+ 24085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.960206 (+ 24632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.960453 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.937151 15720 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.945863 17987 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.836447 17940 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.951881 17976 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.962778 15720 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.654770 16271 rpcz_store.cc:276] 0709 13:07:05.560624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.628349 (+ 67725us) service_pool.cc:224] Handling call
0709 13:07:05.655788 (+ 27439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.841874 (+1186086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.841915 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.842508 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.167670 (+325162us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.239410 (+ 71740us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.260623 (+ 21213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.521598 (+1260975us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800297c40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928f42a6 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419
0709 13:07:08.522177 (+   579us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:08.522226 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.550731 (+ 28505us) raft_consensus.cc:1685] finished
0709 13:07:08.550749 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.565990 (+ 15241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":988,"prepare.queue_time_us":294520,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2556,"raft.queue_time_us":59475,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":114149,"spinlock_wait_cycles":147127552,"thread_start_us":1487122,"threads_started":3,"wal-append.queue_time_us":454825}
I20260709 13:07:08.861280 17783 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.834108 17965 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:08.878082 17985 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:07:08.954226 18017 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:07:08.928721 17704 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.955821 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 241469us
I20260709 13:07:08.909638 17982 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:08.929347 17975 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.929153 17988 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.942132 17789 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.962116 18001 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.979553 18023 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:08.994472 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.544s (SENT)
I20260709 13:07:08.966334 17729 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.959111 17986 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.008426 17704 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.052599 17704 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.924157 17893 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.053683 17893 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.042426 17988 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.057456 17988 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.038887 17915 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.026996 17427 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.059911 17914 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.061542 17914 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.062505 17783 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.048306 17954 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:09.064000 17954 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.066435 18023 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.048064 17996 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:08.982355 17615 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.068025 17615 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.068642 18023 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:08.942303 18006 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.066725 17848 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.008620 17982 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:09.031448 17953 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 2.764s	user 0.004s	sys 0.026s
I20260709 13:07:09.039525 17940 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:09.043694 17965 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.044688 17958 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:09.083745 17872 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:09.042188 17975 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:09.106215 17986 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.110306 18006 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.112005 17975 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:09.115162 17970 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.155833 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.243049 15577 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.245167 17970 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.098086 17958 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.158061 15578 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:07:09.160283 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.970198 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.161298 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 337079us
I20260709 13:07:09.161592 15648 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:09.167795 15692 leader_election.cc:400] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
I20260709 13:07:09.258060 15692 leader_election.cc:403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:07:09.259899 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 92782.3us
I20260709 13:07:09.261212 15692 leader_election.cc:400] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:08.955384 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1650) took 3312 ms. Trace:
I20260709 13:07:09.262461 15721 rpcz_store.cc:276] 0709 13:07:05.643369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.451254 (+2807885us) service_pool.cc:224] Handling call
0709 13:07:08.451600 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.452005 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.452041 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.452565 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.572149 (+119584us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:08.582686 (+ 10537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.597003 (+ 14317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.955090 (+358087us) raft_consensus.cc:1685] finished
0709 13:07:08.955117 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.955308 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1982,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":112914,"threads_started":1,"wal-append.queue_time_us":211847}
I20260709 13:07:09.266144 17975 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
I20260709 13:07:09.175129 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1651) took 3531 ms. Trace:
I20260709 13:07:09.176815 15728 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:09.177439 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 182879us
I20260709 13:07:09.183482 17615 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.184913 17783 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.965931 17583 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.271646 17783 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.267411 15725 rpcz_store.cc:276] 0709 13:07:05.643707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.455709 (+2812002us) service_pool.cc:224] Handling call
0709 13:07:08.456105 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.456491 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.456520 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.457144 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.661817 (+204673us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.668040 (+  6223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.669353 (+  1313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.174320 (+504967us) raft_consensus.cc:1685] finished
0709 13:07:09.174377 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.174798 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2158,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":192374,"threads_started":1,"wal-append.queue_time_us":213210}
I20260709 13:07:09.273590 17583 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.049808 17698 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.083401 17729 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.195742 17789 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.274816 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.280517 16269 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:09.280937 17789 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.118453 17982 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.283653 17698 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.284045 17982 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.283635 16271 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:09.120684 17987 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.287201 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:09.288862 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.289134 17987 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.122189 18001 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.290159 17958 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:09.290701 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.291803 16269 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:09.292380 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.293370 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.293529 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.231437 18027 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.233326 17954 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.237668 17589 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:09.239115 15720 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 13:07:09.270892 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.274765 15573 raft_consensus.cc:2368] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8.
I20260709 13:07:09.285777 15571 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:09.297197 15577 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:09.296877 15720 pending_rounds.cc:85] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
W20260709 13:07:09.289155 16235 connection.cc:256] RPC call timeout handler was delayed by -1.3486668230000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 13:07:09.302168 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.302789 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.303228 15575 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.304733 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.305567 15572 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:09.307435 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.308454 15574 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:09.310624 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.310406 17589 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.311127 17954 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:09.311980 17954 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.314390 17958 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.316344 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 430) took 1867 ms. Trace:
I20260709 13:07:09.316789 15651 rpcz_store.cc:276] 0709 13:07:07.448694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.448856 (+   162us) service_pool.cc:224] Handling call
0709 13:07:07.470236 (+ 21380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.597557 (+127321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.597587 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.597635 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.597666 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.315752 (+1718086us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002e2a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.315834 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.316045 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292334848}
I20260709 13:07:09.318614 17783 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.314620 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.299619 15720 pending_rounds.cc:107] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:09.326354 15720 raft_consensus.cc:2889] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.327703 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2125) took 1770 ms. Trace:
I20260709 13:07:09.328187 15720 rpcz_store.cc:276] 0709 13:07:07.557332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.823601 (+1266269us) service_pool.cc:224] Handling call
0709 13:07:08.900127 (+ 76526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.327175 (+427048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.327555 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.330310 18027 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.334667 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:09.340270 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1546) took 2179 ms. Trace:
I20260709 13:07:09.340831 15576 rpcz_store.cc:276] 0709 13:07:07.160479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.311113 (+2150634us) service_pool.cc:224] Handling call
0709 13:07:09.311518 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.312002 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:09.312519 (+   517us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.339720 (+ 27201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.339773 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:09.339817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.339879 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.340008 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":764,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":110,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":74624,"thread_start_us":26403,"threads_started":1,"wal-append.queue_time_us":26835}
I20260709 13:07:09.343175 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.346617 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.348467 18041 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.349005 18041 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:09.350080 18041 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.355461 18041 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.356890 16274 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:09.357015 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.357955 17725 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:09.359161 17615 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.360127 17987 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.360809 17725 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:09.362115 15726 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:09.367422 17729 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.344563 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.368747 16269 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:09.369742 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.370307 16277 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:09.371290 17857 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.372452 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.373296 16276 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:09.376447 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1579) took 1093 ms. Trace:
I20260709 13:07:09.376896 15649 rpcz_store.cc:276] 0709 13:07:08.282851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.311250 (+ 28399us) service_pool.cc:224] Handling call
0709 13:07:09.314159 (+1002909us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:09.376344 (+ 62185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26589056}
I20260709 13:07:09.374995 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:09.378139 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.378825 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.379141 17725 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.379735 16272 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:09.381050 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.381793 16272 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:09.383126 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.384661 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.385536 16276 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:09.386435 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.387163 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 510) took 2277 ms. Trace:
I20260709 13:07:09.387827 17954 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.390224 18001 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.379681 17725 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.397432 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.401162 16276 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:09.387604 16278 rpcz_store.cc:276] 0709 13:07:07.109142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.178886 (+ 69744us) service_pool.cc:224] Handling call
0709 13:07:08.238126 (+1059240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.238989 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.386715 (+1147726us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006f9d50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:09.386952 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2435192192}
I20260709 13:07:09.403108 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.403707 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.404281 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.404646 16278 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.410633 16271 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:07:09.411728 17729 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.413059 17840 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.413543 17729 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:09.408514 17976 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.414372 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.415068 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.415674 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:09.414827 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 80371us
I20260709 13:07:09.313835 17872 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:07:09.398838 17725 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.350908 17982 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:09.432109 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.432713 17848 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.436719 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.406484 17915 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:09.446211 16278 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:09.445264 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.427263 17729 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:09.449723 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.450170 17729 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.433779 17857 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:09.451962 17729 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.451867 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:09.452704 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.453521 15651 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.454375 17915 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.454582 15580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1521) took 2352 ms (client timeout 1611 ms). Trace:
W20260709 13:07:09.455092 15580 rpcz_store.cc:269] 0709 13:07:07.102369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.126195 (+ 23826us) service_pool.cc:224] Handling call
0709 13:07:09.454111 (+2327916us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:09.454352 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693626752}
I20260709 13:07:09.456629 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.457482 15580 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:07:09.453760 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:09.413573 17840 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:09.461134 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:09.461356 17840 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.462064 17583 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.463176 17840 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.463516 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1540) took 3894 ms. Trace:
I20260709 13:07:09.463835 17915 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:09.464341 17915 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.463943 15571 rpcz_store.cc:276] 0709 13:07:05.568899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.573224 (+  4325us) service_pool.cc:224] Handling call
0709 13:07:09.153614 (+3580390us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:09.154380 (+   766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.300148 (+145768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.463190 (+163042us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000c71d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.463441 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306625792}
I20260709 13:07:09.464860 17915 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.463294 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:09.472558 15651 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:09.473224 15575 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:09.466481 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.474365 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:09.477790 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44013.6us
I20260709 13:07:09.458546 18027 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.465726 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.477873 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1545) took 2317 ms. Trace:
I20260709 13:07:09.481122 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.481168 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.491504 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.484282 15571 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:09.498934 18027 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.499651 18027 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:09.500527 17861 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:09.500711 18027 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.498864 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.502746 15650 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.503157 15654 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.504462 15580 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:09.505460 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.498783 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.478829 17698 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.511541 15575 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.512456 17976 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.513531 17892 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.514643 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:09.515815 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.516323 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.516446 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 83180.6us
I20260709 13:07:09.518612 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.519217 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.519502 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:09.519657 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.520247 15579 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:09.520435 16273 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:09.521093 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:09.522903 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 431) took 2073 ms. Trace:
W20260709 13:07:09.522966 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 76855us
I20260709 13:07:09.524039 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.523298 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1563) took 1008 ms. Trace:
I20260709 13:07:09.524871 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1570) took 3875 ms. Trace:
I20260709 13:07:09.525355 15573 rpcz_store.cc:276] 0709 13:07:08.515400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.713859 (+198459us) service_pool.cc:224] Handling call
0709 13:07:09.523082 (+809223us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54000c7bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:09.523233 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229864704}
I20260709 13:07:09.525786 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:09.526322 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:09.526680 15725 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:09.519281 16277 raft_consensus.cc:2376] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7. Re-sending same reply.
I20260709 13:07:09.528155 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:09.528529 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 65376.3us
I20260709 13:07:09.521775 15579 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:09.523408 15655 rpcz_store.cc:276] 0709 13:07:07.449043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.449162 (+   119us) service_pool.cc:224] Handling call
0709 13:07:07.475416 (+ 26254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.485340 (+  9924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.485369 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.485411 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.485443 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.522351 (+2036908us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b540017cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.522431 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.522664 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22364032}
I20260709 13:07:09.525441 15652 rpcz_store.cc:276] 0709 13:07:05.649422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.655846 (+  6424us) service_pool.cc:224] Handling call
0709 13:07:05.703478 (+ 47632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.593159 (+1889681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.524341 (+1931182us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540017c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.524648 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4062096768}
I20260709 13:07:09.525252 17976 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.534788 17976 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:09.535240 17976 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.535312 17848 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.535799 17848 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:09.536264 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2129) took 1159 ms. Trace:
I20260709 13:07:09.536792 17848 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.537168 17725 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:09.537681 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 436) took 1256 ms. Trace:
I20260709 13:07:09.538220 15646 rpcz_store.cc:276] 0709 13:07:08.280940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.283726 (+  2786us) service_pool.cc:224] Handling call
0709 13:07:08.416046 (+132320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.817217 (+401171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.537206 (+719989us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540006a9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.537516 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567395712}
I20260709 13:07:09.534528 17892 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.542765 16272 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:09.534391 17427 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.544715 18050 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:09.545364 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.546587 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:09.547406 17991 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.550247 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.005s	sys 0.009s
W20260709 13:07:09.550578 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.005s	sys 0.009s
I20260709 13:07:09.484181 18040 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:09.550274 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.554005 16276 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:09.556305 17920 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.563304 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2111) took 1157 ms. Trace:
I20260709 13:07:09.563655 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.564635 15655 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.564855 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.567878 17991 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.568440 17991 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:09.568249 15648 rpcz_store.cc:276] 0709 13:07:08.403801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.551502 (+147701us) service_pool.cc:224] Handling call
0709 13:07:09.560854 (+1009352us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400085a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:09.561014 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381060864}
I20260709 13:07:09.569020 17991 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.580497 17857 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.581261 17857 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:09.582386 17857 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.583931 17857 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.584824 15579 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:09.536661 15726 rpcz_store.cc:276] 0709 13:07:08.377189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.442721 (+ 65532us) service_pool.cc:224] Handling call
0709 13:07:09.535946 (+1093225us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540011c1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:09.536185 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031667072}
I20260709 13:07:09.587641 17848 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.590632 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1660) took 3926 ms. Trace:
I20260709 13:07:09.591398 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:09.583853 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57647.1us
I20260709 13:07:09.595021 15580 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.596787 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.596958 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:09.597764 16278 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:09.600032 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:09.603099 15646 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.591068 15728 rpcz_store.cc:276] 0709 13:07:05.664093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.718431 (+3054338us) service_pool.cc:224] Handling call
0709 13:07:08.777993 (+ 59562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.270205 (+492212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.590373 (+320168us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003bf1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.590576 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914938624}
I20260709 13:07:09.614017 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1551) took 2424 ms. Trace:
I20260709 13:07:09.607431 15576 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:09.615491 15579 rpcz_store.cc:276] 0709 13:07:07.171074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.533549 (+2362475us) service_pool.cc:224] Handling call
0709 13:07:09.583402 (+ 49853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.586974 (+  3572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.595303 (+  8329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.580353 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:09.642939 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.645749 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:09.655055 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93664.9us
I20260709 13:07:09.652146 16276 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:09.660521 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1526) took 2523 ms. Trace:
I20260709 13:07:09.619215 18040 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:09.588685 15474 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 4, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.661126 15578 rpcz_store.cc:276] 0709 13:07:07.128299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.823078 (+1694779us) service_pool.cc:224] Handling call
0709 13:07:08.875557 (+ 52479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.255706 (+380149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.635722 (+380016us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400175f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:09.651311 (+ 15589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647734016}
I20260709 13:07:09.676736 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1553) took 1434 ms. Trace:
I20260709 13:07:09.677229 15579 rpcz_store.cc:276] 0709 13:07:08.242847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.637964 (+1395117us) service_pool.cc:224] Handling call
0709 13:07:09.666572 (+ 28608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.676347 (+  9775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.676384 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.676440 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.676479 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.676536 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.676672 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.681434 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:09.684242 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.672013 18040 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:09.712991 15576 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:09.714051 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1554) took 1469 ms. Trace:
I20260709 13:07:09.714479 15576 rpcz_store.cc:276] 0709 13:07:08.244267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.650369 (+1406102us) service_pool.cc:224] Handling call
0709 13:07:09.705701 (+ 55332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.713656 (+  7955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.713947 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.722295 15579 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.725147 17583 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.726583 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1555) took 1476 ms. Trace:
I20260709 13:07:09.724233 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.727041 15579 rpcz_store.cc:276] 0709 13:07:08.250616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.678331 (+1427715us) service_pool.cc:224] Handling call
0709 13:07:09.698561 (+ 20230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.726287 (+ 27726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.726519 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:09.790745 18051 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:09.791257 17427 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:09.791945 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.792332 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.792816 15576 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:09.793049 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1548) took 2628 ms. Trace:
I20260709 13:07:09.491655 15574 rpcz_store.cc:276] 0709 13:07:07.157200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.309383 (+2152183us) service_pool.cc:224] Handling call
0709 13:07:09.309990 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.313824 (+  3834us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:09.314645 (+   821us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.410192 (+ 95547us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.433410 (+ 23218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.444242 (+ 10832us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.446230 (+  1988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.448773 (+  2543us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.474236 (+ 25463us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8963,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":7236,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":236,"thread_start_us":30708,"threads_started":1,"wal-append.queue_time_us":26978}
I20260709 13:07:09.793449 15577 rpcz_store.cc:276] 0709 13:07:07.164678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.331814 (+2167136us) service_pool.cc:224] Handling call
0709 13:07:09.348624 (+ 16810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.349238 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:09.349607 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.429314 (+ 79707us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.447183 (+ 17869us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.447311 (+   128us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.447345 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.447402 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:09.552803 (+105401us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b1800366c40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:09.792750 (+239947us) raft_consensus.cc:1685] finished
0709 13:07:09.792837 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.792976 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":598,"prepare.queue_time_us":5389,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":5526,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":35177,"spinlock_wait_cycles":17864064,"thread_start_us":78590,"threads_started":1,"wal-append.queue_time_us":140466}
I20260709 13:07:09.795850 15574 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:09.799206 18053 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:07:09.802277 15618 leader_election.cc:336] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.964s (SENT)
W20260709 13:07:09.803356 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.803949 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.807677 17962 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.803856 15728 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:09.791894 17427 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:09.811025 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.793462 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1566) took 1162 ms. Trace:
I20260709 13:07:09.812148 15576 rpcz_store.cc:276] 0709 13:07:08.630982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.729913 (+1098931us) service_pool.cc:224] Handling call
0709 13:07:09.792479 (+ 62566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.793203 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.793380 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.811129 15577 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 1. Current term is 2. Ops: []
W20260709 13:07:09.813690 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.817036 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 192402us
I20260709 13:07:09.797828 15574 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.821872 15575 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:09.811031 15728 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 3
I20260709 13:07:09.828939 15728 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:09.829250 15728 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:09.829399 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 155842us
I20260709 13:07:09.827885 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.840971 15728 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:09.841351 15728 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.777067 15646 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:09.843099 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 280724us
I20260709 13:07:09.863090 15576 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 8. Ops: []
I20260709 13:07:09.868172 16275 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:09.877144 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:09.900274 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:09.900985 16275 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Advancing to term 7
W20260709 13:07:09.911391 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.911345 15654 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:09.912729 15655 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:09.925329 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55857us
W20260709 13:07:09.926946 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.932678 15575 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:07:09.936039 18052 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.003s
I20260709 13:07:09.943925 15543 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:09.936293 15618 leader_election.cc:400] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8.
I20260709 13:07:09.952054 15618 leader_election.cc:403] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:07:09.921950 18041 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.012s
I20260709 13:07:09.937227 15574 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:07:09.932229 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 53529.7us
I20260709 13:07:09.953367 15721 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:09.953189 18042 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:07:09.953477 15727 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:09.958354 17778 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.958567 17427 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:09.949203 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:09.977828 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.978825 15654 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:09.992369 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:09.997571 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 61533.6us
I20260709 13:07:09.929414 17783 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.997624 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:09.998468 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63115.1us
I20260709 13:07:09.938006 17725 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:09.985620 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:10.027248 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 148642us
I20260709 13:07:09.896245 18040 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.021250 17806 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:10.010650 17729 consensus_meta.cc:287] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.026s
W20260709 13:07:10.005591 15571 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:07:10.034735 15474 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 3 to 4, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.010003 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:09.998240 16270 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:10.043965 15726 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:10.048771 15474 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:09.987633 17778 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.089484 15655 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.044678 15571 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:10.043918 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:10.021515 17783 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:10.095896 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 368596us
I20260709 13:07:10.108539 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:10.146979 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.148370 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:10.151067 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1547) took 2989 ms. Trace:
I20260709 13:07:10.084000 15652 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:07:10.163667 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72723.8us
W20260709 13:07:10.106629 17915 consensus_meta.cc:287] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.641s	user 0.017s	sys 0.016s
I20260709 13:07:10.151652 15572 rpcz_store.cc:276] 0709 13:07:07.162141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.315580 (+2153439us) service_pool.cc:224] Handling call
0709 13:07:09.316070 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.318668 (+  2598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.318700 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.319402 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.428720 (+109318us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.428766 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.428856 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.150747 (+721891us) raft_consensus.cc:1685] finished
0709 13:07:10.150778 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.150985 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1770,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":105267,"threads_started":1,"wal-append.queue_time_us":156920}
I20260709 13:07:10.145625 15646 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.163108 18040 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:10.180537 18041 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:10.194572 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 83460.8us
I20260709 13:07:10.195531 17783 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:10.196270 17725 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:10.196790 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:10.199479 17851 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.201601 17924 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.202654 17849 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8.
I20260709 13:07:10.203029 17994 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:10.210914 18058 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:10.212131 17778 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:10.220340 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.221169 17857 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.637s	user 0.016s	sys 0.008s
W20260709 13:07:10.222810 17840 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.001s
W20260709 13:07:10.263242 15580 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.001s
W20260709 13:07:10.225080 17920 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.019s
I20260709 13:07:10.234202 16275 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
W20260709 13:07:10.249056 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51456us
I20260709 13:07:10.283861 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:10.259311 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 71410.6us
W20260709 13:07:10.259127 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 76944.9us
I20260709 13:07:10.264082 15580 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:10.180878 15474 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 4 to 6, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), now has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:10.287499 15650 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.784s	user 0.015s	sys 0.006s
I20260709 13:07:10.288683 15650 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:10.235387 17924 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:10.241906 17783 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.308072 17851 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:10.178673 17915 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:10.318938 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 226290us
I20260709 13:07:10.320497 15474 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 2 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.186453 18042 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:07:10.327946 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:10.317786 17849 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.339517 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:10.344779 15580 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.347906 17724 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.348650 17724 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.349607 17836 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:07:10.310680 17994 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:10.351883 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.343704 17783 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.352700 17994 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:10.352905 15576 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:10.353333 17994 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.355680 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:10.355613 17729 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:10.356737 17729 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:10.357303 16236 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.940s (SENT)
I20260709 13:07:10.357450 17892 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:10.338685 17976 consensus_meta.cc:287] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.797s	user 0.014s	sys 0.000s
I20260709 13:07:10.357805 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:10.327729 17840 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:07:10.325312 17857 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:10.353783 17994 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.357859 17892 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.351801 17724 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:10.403990 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:10.404685 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47450.3us
I20260709 13:07:10.367044 17872 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.357903 18042 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:10.379108 15474 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 1 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.335769 17963 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:10.418063 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:10.447896 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:10.449242 15575 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:07:10.361986 17725 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:07:10.427577 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.456619 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.428818 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 60577.1us
I20260709 13:07:10.409690 17892 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.409497 17729 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.477249 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:10.503906 17983 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:10.331933 17924 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.417613 17872 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:10.409624 17849 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:10.381865 17976 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:10.423807 18041 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.562112 17976 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:10.562404 18041 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.564007 17976 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.564673 17976 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:10.565097 18041 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:10.566416 15725 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.567348 17729 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.576547 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:10.577329 15572 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.579133 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:10.532657 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 175377us
W20260709 13:07:10.533530 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 468912us
I20260709 13:07:10.423955 18042 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:10.537420 18054 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.621s	user 0.000s	sys 0.005s
I20260709 13:07:10.539079 17872 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.546335 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:10.554987 17783 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:10.558887 17849 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.527266 17983 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:10.609563 15580 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:10.579993 15576 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:10.631918 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:10.638747 15580 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.641113 15580 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:10.468094 17836 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:07:10.642412 15646 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:10.633046 15574 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:10.663307 15576 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:10.616328 15571 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:10.648766 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.030s
W20260709 13:07:10.648461 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.021s	sys 0.040s
W20260709 13:07:10.667677 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.021s	sys 0.040s
W20260709 13:07:10.666731 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.003s	sys 0.030s
W20260709 13:07:10.668910 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 635868us
W20260709 13:07:10.648648 17806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.022s
I20260709 13:07:10.616613 17778 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.672876 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:10.666718 18027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.017s	sys 0.084s
I20260709 13:07:10.590955 17729 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.665815 17924 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.565846 17976 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:10.692296 17806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.011s	sys 0.022s
W20260709 13:07:10.726709 18027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.017s	sys 0.085s
I20260709 13:07:10.760859 17985 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:10.762197 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 216003us
W20260709 13:07:10.763715 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 115616us
I20260709 13:07:10.674845 17778 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.674299 17872 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.631335 17983 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.757910 17698 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.778957 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1671) took 1260 ms. Trace:
W20260709 13:07:10.790524 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 3.328s (SENT)
I20260709 13:07:10.812093 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:10.768465 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 928301us
I20260709 13:07:10.809628 15720 rpcz_store.cc:276] 0709 13:07:09.522168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.522351 (+   183us) service_pool.cc:224] Handling call
0709 13:07:09.522970 (+   619us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.523432 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.523459 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.524082 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.723900 (+199818us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:10.047847 (+323947us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.338671 (+290824us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:10.358443 (+ 19772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.358997 (+   554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.778625 (+419628us) raft_consensus.cc:1685] finished
0709 13:07:10.778733 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.778877 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7734,"prepare.queue_time_us":310157,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":8518,"raft.queue_time_us":517015,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":293,"spinlock_wait_cycles":43901184,"thread_start_us":761931,"threads_started":3,"wal-append.queue_time_us":382169}
I20260709 13:07:10.791303 16272 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:10.771971 17778 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:10.773841 17848 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.184s	user 0.011s	sys 0.011s
I20260709 13:07:10.791033 17851 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:10.818284 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 687) took 1269 ms. Trace:
I20260709 13:07:10.818678 16272 rpcz_store.cc:276] 0709 13:07:09.549351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.550348 (+   997us) service_pool.cc:224] Handling call
0709 13:07:09.550657 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.817400 (+1266743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.817973 (+   573us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400770e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:10.818200 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2852635392}
I20260709 13:07:10.787469 17924 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:10.819983 15572 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:10.820202 16276 raft_consensus.cc:2410] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:10.761654 17806 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:10.792147 18060 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:07:10.832607 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 201768us
I20260709 13:07:10.771688 17958 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.779738 18075 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.815419 18041 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.766371 17915 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:10.767863 17985 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:10.832363 17861 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.331s	user 0.019s	sys 0.001s
W20260709 13:07:10.837352 16278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.025s	sys 0.094s
I20260709 13:07:10.844549 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:10.791808 17857 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:07:10.791942 17982 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:10.861799 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:10.862848 18070 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:10.863235 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:10.863484 18070 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:10.864655 18070 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.866796 17985 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.867938 17985 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.856015 17967 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.870405 17967 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.779331 18071 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:07:10.856492 17806 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.800899 17892 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.786448 18042 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.877240 17892 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:10.877797 18042 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.844906 18075 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.880290 18075 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:10.880882 18075 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.881230 18075 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:10.858436 17729 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:10.861282 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1550) took 3693 ms. Trace:
I20260709 13:07:10.882541 15573 rpcz_store.cc:276] 0709 13:07:07.168062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.527156 (+2359094us) service_pool.cc:224] Handling call
0709 13:07:09.527576 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.528012 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.528046 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.574175 (+ 46129us) log.cc:844] Serialized 26 byte log entry
0709 13:07:09.885793 (+311618us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:09.885832 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.885895 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.861071 (+975176us) raft_consensus.cc:1685] finished
0709 13:07:10.861092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.861206 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":11464,"thread_start_us":290431,"threads_started":1,"wal-append.queue_time_us":883374}
W20260709 13:07:10.854516 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64037.5us
W20260709 13:07:10.885283 16236 leader_election.cc:336] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 3.434s (SENT)
I20260709 13:07:10.885758 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:10.844503 17958 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:10.890930 17958 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.892295 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:10.892908 15652 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:10.854672 16278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.025s	sys 0.095s
I20260709 13:07:10.842221 17994 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:10.866312 18078 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.865724 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:10.900177 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 490686us
W20260709 13:07:10.894949 17991 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.325s	user 0.014s	sys 0.002s
I20260709 13:07:10.910194 15650 pending_rounds.cc:85] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 5
I20260709 13:07:10.910562 15650 pending_rounds.cc:107] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:10.910816 15650 raft_consensus.cc:2889] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:10.896598 17427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.017s
I20260709 13:07:10.919507 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:10.923357 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 92359.9us
I20260709 13:07:10.925256 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:10.918609 17427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.017s
W20260709 13:07:10.949142 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.012s
W20260709 13:07:10.949632 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.007s	sys 0.012s
I20260709 13:07:10.953378 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:10.964078 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:10.966183 15651 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:10.968286 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.969075 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.970680 17848 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:10.971362 17848 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.974619 15653 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:10.974813 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:10.975929 15654 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:10.986294 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.987352 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.953183 17872 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.917735 17991 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.966850 17892 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.962674 17994 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:07:11.012240 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 146625us
I20260709 13:07:11.009814 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:11.013432 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 77533.2us
W20260709 13:07:10.966692 16273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.014s
I20260709 13:07:10.990299 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:11.016963 18073 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.017699 18072 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.014904 17892 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:10.909042 18075 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:10.991675 17427 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.976790 18078 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:11.025569 15578 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.990486 17848 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:10.974822 17778 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:11.038760 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 695) took 1351 ms. Trace:
W20260709 13:07:11.020293 16273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.010s	sys 0.014s
I20260709 13:07:11.039214 16276 rpcz_store.cc:276] 0709 13:07:09.675907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.676162 (+   255us) service_pool.cc:224] Handling call
0709 13:07:11.020000 (+1343838us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540073ebd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:11.026769 (+  6769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608034048}
I20260709 13:07:11.050087 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1678) took 1214 ms. Trace:
I20260709 13:07:11.050737 17892 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.037497 18078 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.050673 15723 rpcz_store.cc:276] 0709 13:07:09.705353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.776574 (+ 71221us) service_pool.cc:224] Handling call
0709 13:07:09.790856 (+ 14282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.791172 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:10.145919 (+354747us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.919185 (+773266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.919255 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:10.919320 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.919406 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.919561 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20116,"prepare.queue_time_us":400133,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":323098,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":69502208,"thread_start_us":956324,"threads_started":3,"wal-append.queue_time_us":602111}
W20260709 13:07:11.053027 18080 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:11.039471 18027 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:11.055590 18027 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:11.057080 18068 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.275s	user 0.001s	sys 0.005s
I20260709 13:07:11.056728 18027 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.058512 18090 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.058743 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1572) took 1664 ms. Trace:
I20260709 13:07:11.059262 18090 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.059176 15577 rpcz_store.cc:276] 0709 13:07:09.394612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.814010 (+419398us) service_pool.cc:224] Handling call
0709 13:07:09.840003 (+ 25993us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.925562 (+ 85559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.925592 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.933571 (+  7979us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.265503 (+331932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:10.733508 (+468005us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.733770 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.733892 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.899976 (+166084us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4800080058. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:11.055561 (+155585us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800358d80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928f42a6 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db
0709 13:07:11.056547 (+   986us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:11.058525 (+  1978us) raft_consensus.cc:1685] finished
0709 13:07:11.058544 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.058677 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18379,"prepare.queue_time_us":722999,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2419,"raft.queue_time_us":124976,"raft.run_cpu_time_us":3382,"raft.run_wall_time_us":97828,"spinlock_wait_cycles":96554752,"thread_start_us":746755,"threads_started":2,"wal-append.queue_time_us":717741}
I20260709 13:07:11.011319 17872 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.070809 15692 leader_election.cc:400] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4.
I20260709 13:07:11.103320 17698 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:11.104382 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 134100us
I20260709 13:07:11.105963 17583 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:11.109604 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.017s
W20260709 13:07:11.109984 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.003s	sys 0.017s
I20260709 13:07:11.037894 17994 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:11.114704 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.115880 15544 connection.cc:256] RPC call timeout handler was delayed by -1.1008685409999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:07:11.116964 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:11.103438 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:11.070456 18075 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.121035 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:11.121788 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.122181 15724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.013s
W20260709 13:07:11.125058 15724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.011s	sys 0.013s
I20260709 13:07:11.125888 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1679) took 1391 ms. Trace:
I20260709 13:07:11.067444 17991 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.069725 17778 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.107510 18090 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.110627 17848 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:11.131932 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:11.133343 15655 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
W20260709 13:07:11.133731 16236 leader_election.cc:336] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 3.003s (SENT)
I20260709 13:07:11.134269 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:11.109483 18078 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.042629 17427 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:11.131125 17920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.023s
W20260709 13:07:11.153211 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 572916us
I20260709 13:07:11.129391 15724 rpcz_store.cc:276] 0709 13:07:09.734275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.796634 (+ 62359us) service_pool.cc:224] Handling call
0709 13:07:09.797095 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.797383 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:09.952627 (+155244us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.125453 (+1172826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.125545 (+    92us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:11.125600 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.125676 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.125817 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":357191,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":517828,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":1237373,"threads_started":3,"wal-append.queue_time_us":738492}
W20260709 13:07:11.152545 17920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.012s	sys 0.023s
W20260709 13:07:11.156347 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 113481us
W20260709 13:07:11.161645 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.140664 18072 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.188407 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1559) took 2847 ms. Trace:
W20260709 13:07:11.190081 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58628.3us
I20260709 13:07:11.194409 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:11.145025 17892 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:11.193384 15578 rpcz_store.cc:276] 0709 13:07:08.341161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.698365 (+1357204us) service_pool.cc:224] Handling call
0709 13:07:09.794091 (+ 95726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.027803 (+1233712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.159336 (+131533us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540026c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:11.188325 (+ 28989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2831627648}
W20260709 13:07:11.162601 17962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.027s
W20260709 13:07:11.218758 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 61129.7us
I20260709 13:07:11.189059 17778 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.140389 17848 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.188016 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:11.225037 18079 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.350s	user 0.001s	sys 0.004s
I20260709 13:07:11.225536 17967 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.226117 17698 raft_consensus.cc:2764] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:11.226120 17994 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.188164 18078 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.227600 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:11.218672 17962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.028s
I20260709 13:07:11.236267 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 701) took 1203 ms. Trace:
I20260709 13:07:11.225711 15652 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:11.246783 16278 rpcz_store.cc:276] 0709 13:07:10.033217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.044431 (+ 11214us) service_pool.cc:224] Handling call
0709 13:07:10.193068 (+148637us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:10.193311 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.257878 (+ 64567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.257921 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.262978 (+  5057us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.898645 (+635667us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:10.898703 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.898790 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.235952 (+337162us) raft_consensus.cc:1685] finished
0709 13:07:11.235971 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.236201 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41449,"raft.queue_time_us":65111,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":26173,"spinlock_wait_cycles":5533184,"thread_start_us":587737,"threads_started":1,"wal-append.queue_time_us":847923}
I20260709 13:07:11.248044 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:11.254966 18077 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.475s	user 0.000s	sys 0.008s
I20260709 13:07:11.255947 18091 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:11.257375 18071 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.257849 18071 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:11.259014 18071 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.260823 17778 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:11.256335 15653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1574) took 5479 ms (client timeout 1991 ms). Trace:
W20260709 13:07:11.264403 15653 rpcz_store.cc:269] 0709 13:07:05.776927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.777066 (+   139us) service_pool.cc:224] Handling call
0709 13:07:11.256049 (+5478983us) spinlock_profiling.cc:243] Waited 4.25 s on lock 0x7b5400155c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:11.256223 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9768797056}
W20260709 13:07:11.266796 18074 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.480s	user 0.007s	sys 0.003s
I20260709 13:07:11.267390 17427 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.268126 18067 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:07:11.272933 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.274500 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 52711.9us
I20260709 13:07:11.275547 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:11.275765 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:11.277150 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:11.278214 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 423) took 2365 ms. Trace:
I20260709 13:07:11.240983 18092 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:11.247480 18073 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:11.290185 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.028s
W20260709 13:07:11.293262 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.013s	sys 0.028s
W20260709 13:07:11.293576 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 572514us
I20260709 13:07:11.278673 15579 rpcz_store.cc:276] 0709 13:07:08.912880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.786313 (+873433us) service_pool.cc:224] Handling call
0709 13:07:09.863381 (+ 77068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.906925 (+ 43544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.906954 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:09.944804 (+ 37850us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.384088 (+439284us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:10.384138 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.387865 (+  3727us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.266096 (+878231us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:11.277813 (+ 11717us) raft_consensus.cc:1685] finished
0709 13:07:11.277842 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.278146 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12775,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":26747,"spinlock_wait_cycles":55209728,"thread_start_us":338966,"threads_started":1,"wal-append.queue_time_us":794837}
I20260709 13:07:11.294997 18083 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.296016 17872 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:11.296777 17872 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:11.298358 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 70862us
I20260709 13:07:11.299299 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:11.301636 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.072s
W20260709 13:07:11.301981 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.072s
W20260709 13:07:11.302281 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 512990us
I20260709 13:07:11.251124 18087 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:11.307022 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:11.288491 17427 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.287618 17892 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:11.331815 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 133329us
I20260709 13:07:11.331099 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:11.283833 18078 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.339531 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:11.345081 15579 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:11.334789 15571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.041s
W20260709 13:07:11.315290 16271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.019s	sys 0.024s
I20260709 13:07:11.354519 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:11.315482 17698 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.330683 17427 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:11.356693 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 49746us
I20260709 13:07:11.355458 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:11.310731 17729 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:11.339067 17962 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.359208 16271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.019s	sys 0.027s
I20260709 13:07:11.373260 17698 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:11.375301 15572 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:11.375767 17848 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.358755 18089 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.377202 18089 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.378414 17778 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:11.358911 15571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.025s	sys 0.041s
I20260709 13:07:11.338932 18083 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:11.292789 18092 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.362267 18073 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.361832 17427 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.339923 17967 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:11.405998 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 702) took 1355 ms. Trace:
I20260709 13:07:11.406436 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:11.406916 17915 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.407251 15721 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:11.407425 17915 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.409700 17915 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.409826 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:11.413704 15727 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.410483 17698 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.388185 17962 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.406515 16271 rpcz_store.cc:276] 0709 13:07:10.050778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.053923 (+  3145us) service_pool.cc:224] Handling call
0709 13:07:10.168536 (+114613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:10.226091 (+ 57555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.226140 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:10.226885 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:07:10.763425 (+536540us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:11.373863 (+610438us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.405573 (+ 31710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.405683 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.405758 (+    75us) raft_consensus.cc:1685] finished
0709 13:07:11.405770 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.405930 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57166,"raft.queue_time_us":43670,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":14820,"thread_start_us":1020423,"threads_started":2,"wal-append.queue_time_us":770601}
I20260709 13:07:11.416298 17962 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.417757 15692 leader_election.cc:400] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:11.418161 15692 leader_election.cc:403] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:11.418669 15727 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.419610 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:11.420928 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:11.384930 17806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.023s	sys 0.019s
W20260709 13:07:11.431532 15649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.017s	sys 0.027s
W20260709 13:07:11.431955 15649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.017s	sys 0.027s
W20260709 13:07:11.428391 17976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.018s
I20260709 13:07:11.362428 17991 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:07:11.450968 15653 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:07:11.406352 17967 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:11.458742 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 436) took 1048 ms. Trace:
I20260709 13:07:11.447310 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:11.428759 17806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.023s	sys 0.019s
W20260709 13:07:11.502390 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 131331us
I20260709 13:07:11.334771 18087 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:11.452373 17983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.022s
W20260709 13:07:11.451908 17976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.008s	sys 0.018s
W20260709 13:07:11.503141 15544 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.618s (SENT)
I20260709 13:07:11.427847 18090 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
W20260709 13:07:11.526763 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 79550.6us
I20260709 13:07:11.505863 17729 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:11.531522 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:11.475416 17967 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:11.553383 15574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.023s	sys 0.014s
W20260709 13:07:11.553745 15574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.023s	sys 0.014s
W20260709 13:07:11.531507 17983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.008s	sys 0.022s
I20260709 13:07:11.530267 17962 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:11.558017 15650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.013s	sys 0.035s
W20260709 13:07:11.565652 15650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.013s	sys 0.035s
W20260709 13:07:11.566213 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.570766 15646 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:11.562366 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:11.549469 18083 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:11.573328 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.551980 17729 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:11.605546 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 153890us
I20260709 13:07:11.561964 17962 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:11.692909 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84806.7us
I20260709 13:07:11.692948 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1579) took 1203 ms. Trace:
W20260709 13:07:11.609347 17958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.011s	sys 0.032s
W20260709 13:07:11.643687 15693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.016s
I20260709 13:07:11.551285 17920 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:07:11.699311 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 140737us
W20260709 13:07:11.752767 15693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.010s	sys 0.017s
W20260709 13:07:11.755544 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 624607us
W20260709 13:07:11.760812 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 541419us
W20260709 13:07:11.720134 18075 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.591s	user 0.016s	sys 0.000s
I20260709 13:07:11.657655 17983 raft_consensus.cc:2764] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:11.692533 18083 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:11.621129 17976 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:11.621433 17968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.017s	sys 0.006s
I20260709 13:07:11.694083 17991 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.765780 15544 leader_election.cc:336] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.774s (SENT)
I20260709 13:07:11.713095 17962 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.756599 18072 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.694905 18078 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.788568 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1582) took 1202 ms. Trace:
I20260709 13:07:11.804140 18072 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.804065 15571 rpcz_store.cc:276] 0709 13:07:10.581058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.761005 (+179947us) service_pool.cc:224] Handling call
0709 13:07:10.778399 (+ 17394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.778810 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.778842 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.780100 (+  1258us) log.cc:844] Serialized 564 byte log entry
0709 13:07:11.402589 (+622489us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:11.411516 (+  8927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.411615 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.783586 (+371971us) raft_consensus.cc:1685] finished
0709 13:07:11.783609 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.783806 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":603931,"threads_started":1,"wal-append.queue_time_us":974602}
I20260709 13:07:11.807502 15726 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:11.773350 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:11.778579 18108 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:07:11.475957 15575 rpcz_store.cc:276] 0709 13:07:10.410813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.492576 (+ 81763us) service_pool.cc:224] Handling call
0709 13:07:10.532492 (+ 39916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.536947 (+  4455us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:10.905707 (+368760us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.458357 (+552650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.458416 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:11.458465 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.458535 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.458673 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490467,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":19269,"thread_start_us":853609,"threads_started":2}
I20260709 13:07:11.782169 17967 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.760514 18093 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.698972 17849 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:07:11.784135 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 450) took 1171 ms. Trace:
I20260709 13:07:11.608248 17982 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:07:11.789300 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:11.789497 16236 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.608s (SENT)
W20260709 13:07:11.754876 17958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.012s	sys 0.033s
I20260709 13:07:11.776113 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:11.811533 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.812578 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.020s	sys 0.014s
W20260709 13:07:11.828557 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.020s	sys 0.014s
W20260709 13:07:11.796718 17968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.018s	sys 0.012s
W20260709 13:07:11.806770 18097 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:07:11.785054 17976 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.818687 15649 rpcz_store.cc:276] 0709 13:07:10.612285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.612431 (+   146us) service_pool.cc:224] Handling call
0709 13:07:10.629664 (+ 17233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.709549 (+ 79885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.709580 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.833397 (+123817us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.432330 (+598933us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:11.432370 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.432449 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.783951 (+351502us) raft_consensus.cc:1685] finished
0709 13:07:11.783974 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.784083 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7871,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":36544,"thread_start_us":598467,"threads_started":1,"wal-append.queue_time_us":945765}
I20260709 13:07:11.829838 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:11.814728 18075 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:11.806668 18072 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.806567 18089 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:11.788414 18070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.016s	sys 0.037s
I20260709 13:07:11.806121 18100 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:11.816967 18087 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:11.821529 18073 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:11.843075 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 422239us
I20260709 13:07:11.806977 18083 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.815683 17991 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:11.837200 18092 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.838459 17976 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.842159 17836 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:11.842900 18070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.017s	sys 0.038s
I20260709 13:07:11.840626 18067 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:11.865948 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 89953.5us
I20260709 13:07:11.867178 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:11.871527 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 175798us
I20260709 13:07:11.844074 17983 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.821599 18093 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.855695 17958 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:11.880301 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:11.837695 17729 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:11.895082 18106 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:11.894884 18073 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:11.878746 18089 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:11.898330 18089 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.899360 17991 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.899879 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:11.900287 18089 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.901099 17849 raft_consensus.cc:2764] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:11.903122 17849 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:11.905527 17849 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.847795 18075 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.868700 17836 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:11.876657 17983 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:11.918578 17994 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.938733 17983 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:11.940158 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.920069 18110 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:07:11.706234 15580 rpcz_store.cc:276] 0709 13:07:10.489387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.670178 (+180791us) service_pool.cc:224] Handling call
0709 13:07:10.729165 (+ 58987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.729421 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:11.194240 (+464819us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.692582 (+498342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:11.692634 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:11.692679 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.692742 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.692870 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2000,"prepare.queue_time_us":338289,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":72167,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4571,"thread_start_us":878231,"threads_started":2}
W20260709 13:07:11.923132 18109 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:07:11.947680 17983 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.950224 17983 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.951551 17967 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.953127 17962 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:11.955091 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:11.955744 17962 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.955879 15726 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.958288 15722 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.911235 17958 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.919399 18089 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.927423 18083 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.929440 18093 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:11.930320 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63275.8us
W20260709 13:07:11.931517 18114 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:07:11.932296 18116 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:11.935397 18075 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:11.944700 17836 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.968367 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:11.934010 18071 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:11.925622 17427 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.004s
W20260709 13:07:11.975306 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.006716 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.006736 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:11.994838 17991 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.020987 17991 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:12.021659 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:12.022835 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 233374us
I20260709 13:07:12.023168 17991 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:11.997175 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.025837 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.026474 16274 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:11.911788 17849 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:11.997625 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:11.999531 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.000627 15649 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:12.041002 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:12.046306 18123 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.046555 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 49042.9us
I20260709 13:07:12.047425 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:12.046927 18123 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:11.997004 17962 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:12.068877 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.069545 15651 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:12.052914 18093 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.070516 18093 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.071185 17994 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.072268 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:12.050264 18133 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.057107 18122 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:12.057636 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.058305 18075 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:12.057181 18083 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:07:12.061443 18119 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
W20260709 13:07:12.062862 18126 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:07:12.069796 15726 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:12.074946 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:12.030933 17427 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:12.081151 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 208817us
I20260709 13:07:12.046684 17849 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.074997 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:12.073151 17872 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:12.076550 16269 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.105696 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:12.109130 15575 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:12.082677 18075 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.133728 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.135712 15577 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:07:12.137630 15728 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.031s	sys 0.045s
W20260709 13:07:12.138252 15728 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.031s	sys 0.045s
I20260709 13:07:12.138866 15721 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:12.140027 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:12.083041 18078 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.142263 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.142861 15651 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:12.144223 15572 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:12.085139 18041 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:12.110932 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:12.111229 17994 raft_consensus.cc:2764] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:12.151474 15649 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:12.151554 15544 leader_election.cc:336] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.045s (SENT)
I20260709 13:07:12.157749 15543 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:12.175264 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.176884 15544 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:12.087626 17976 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.149274 18075 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.081393 18122 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.150442 18089 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:12.152359 17991 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.195371 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.202194 15729 raft_consensus.cc:2376] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5. Re-sending same reply.
I20260709 13:07:12.170732 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 700) took 2181 ms. Trace:
I20260709 13:07:12.195551 18105 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.181380 18141 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:12.189220 17962 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:12.205633 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 305797us
I20260709 13:07:12.237294 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.234079 17872 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:12.243166 17427 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:12.243707 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 86060.8us
I20260709 13:07:12.249392 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:12.250937 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.203094 18138 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.252396 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 103897us
I20260709 13:07:12.188226 15571 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:12.203589 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.259701 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.285470 15723 raft_consensus.cc:2368] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4.
I20260709 13:07:12.215567 18141 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.309371 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.310159 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:07:12.323983 15544 leader_election.cc:336] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.062s (SENT)
W20260709 13:07:12.294390 18129 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:07:12.204047 18089 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.321065 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.286052 18067 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:12.333809 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:12.340265 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.340596 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.340898 15729 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.341279 15723 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:12.299338 18027 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:12.260128 17962 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.302443 17976 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:12.355764 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.310791 18141 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:12.333413 17958 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.296536 18138 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:12.401536 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 117240us
W20260709 13:07:12.463129 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.366569 18149 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.458984 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64383.4us
W20260709 13:07:12.470345 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.468920 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:12.467448 18143 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:12.476306 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1692) took 1063 ms. Trace:
I20260709 13:07:12.476745 15721 rpcz_store.cc:276] 0709 13:07:11.412656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.412800 (+   144us) service_pool.cc:224] Handling call
0709 13:07:11.413199 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.143362 (+730163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.476050 (+332688us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54001a4fd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:12.476247 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668379392}
I20260709 13:07:12.478304 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.480422 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.394815 18124 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.481132 15723 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.481439 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 157498us
I20260709 13:07:12.481323 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.496951 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:12.510442 15544 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.155s (SENT)
I20260709 13:07:12.511082 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:12.512643 15727 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:12.513942 15651 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:12.514490 15651 pending_rounds.cc:85] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:07:12.514761 15651 pending_rounds.cc:107] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:12.515029 15651 raft_consensus.cc:2889] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.339371 17872 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.363667 18027 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:12.507227 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 233313us
I20260709 13:07:12.555577 17962 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:12.555979 18122 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:12.556300 18139 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:07:12.557953 18144 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:07:12.559047 18134 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:07:12.559840 18167 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:12.562067 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1687) took 1167 ms. Trace:
I20260709 13:07:12.562544 15720 rpcz_store.cc:276] 0709 13:07:11.394583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.394738 (+   155us) service_pool.cc:224] Handling call
0709 13:07:11.498852 (+104114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.527482 (+ 28630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.527526 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.548803 (+ 21277us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.076435 (+527632us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.076492 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.076585 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.561805 (+485220us) raft_consensus.cc:1685] finished
0709 13:07:12.561827 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.561982 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15502,"raft.queue_time_us":101828,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":44298,"thread_start_us":499546,"threads_started":1,"wal-append.queue_time_us":636545}
I20260709 13:07:12.568126 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.570320 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.570508 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:07:12.570991 15720 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:12.571658 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.574258 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.574980 15727 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:12.512183 17991 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:12.585598 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.586889 15720 raft_consensus.cc:2410] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:12.543419 18164 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:12.596181 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.595762 17991 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.206190 16273 rpcz_store.cc:276] 0709 13:07:09.985108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.995032 (+  9924us) service_pool.cc:224] Handling call
0709 13:07:10.069883 (+ 74851us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:10.225581 (+155698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.225622 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:10.226617 (+   995us) log.cc:844] Serialized 78 byte log entry
0709 13:07:11.094643 (+868026us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:11.737258 (+642615us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.802295 (+ 65037us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.078051 (+275756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.083474 (+  5423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.096725 (+ 13251us) raft_consensus.cc:1685] finished
0709 13:07:12.142058 (+ 45333us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.166155 (+ 24097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":936,"prepare.queue_time_us":1350444,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4458,"raft.queue_time_us":178122,"raft.run_cpu_time_us":3459,"raft.run_wall_time_us":12904,"spinlock_wait_cycles":23685888,"thread_start_us":1560340,"threads_started":3,"wal-append.queue_time_us":1083824}
I20260709 13:07:12.598640 18157 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:12.606264 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.616466 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.609943 15728 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:12.613328 16269 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:12.485770 18149 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.572696 18167 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.629696 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.633054 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.634485 15720 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:12.645582 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.646319 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.573556 17958 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:12.652205 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.652696 16278 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:12.661154 18093 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:12.661638 17991 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:12.665210 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:12.666163 18138 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:12.666893 18089 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:12.667030 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.651578 17982 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.667374 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1695) took 1251 ms. Trace:
I20260709 13:07:12.667918 17982 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:12.669044 17958 consensus_queue.cc:1243] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:12.667872 15725 rpcz_store.cc:276] 0709 13:07:11.415462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.421375 (+  5913us) service_pool.cc:224] Handling call
0709 13:07:11.421772 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.990532 (+568760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.993366 (+  2834us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.078563 (+ 85197us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.331937 (+253374us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.358229 (+ 26292us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.358485 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.358570 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.599318 (+240748us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800346360. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:12.667060 (+ 67742us) raft_consensus.cc:1685] finished
0709 13:07:12.667172 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.667299 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27126,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":150849,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":23452,"spinlock_wait_cycles":10097024,"thread_start_us":656575,"threads_started":2,"wal-append.queue_time_us":444733}
I20260709 13:07:12.670271 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:12.673808 16273 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.674434 16273 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:12.630789 18157 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.678558 16273 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.680079 18157 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.680298 16273 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.682370 18149 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:12.683605 18027 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.614975 18164 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.633455 18167 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:12.685935 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.696574 15729 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:12.676949 18075 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.647673 17698 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:12.698483 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 199679us
W20260709 13:07:12.707113 15544 leader_election.cc:336] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.318s (SENT)
I20260709 13:07:12.707657 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:12.700189 17982 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.712126 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1704) took 1269 ms. Trace:
I20260709 13:07:12.711170 18105 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.714936 15727 rpcz_store.cc:276] 0709 13:07:11.439160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.701251 (+1262091us) service_pool.cc:224] Handling call
0709 13:07:12.708174 (+  6923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.708383 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.708410 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.708461 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.708494 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.708550 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.708658 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797440}
I20260709 13:07:12.723335 18164 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.734548 15723 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:12.707795 18167 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.736828 15721 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:12.753439 15544 connection.cc:256] RPC call timeout handler was delayed by -1.2472858410000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32730000000000004s for a response
I20260709 13:07:12.768213 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.770141 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.772004 15650 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.778415 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:12.805743 18071 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.002s
I20260709 13:07:12.805989 15652 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:12.806207 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.806975 15648 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:12.807513 15652 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:12.809319 18177 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.809928 18177 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.812340 18177 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:12.813112 16273 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:12.814657 18135 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:12.776449 17982 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.819275 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.813768 18141 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.824292 16276 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:12.825201 18167 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.830426 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1581) took 2314 ms. Trace:
I20260709 13:07:12.833119 15574 rpcz_store.cc:276] 0709 13:07:10.527495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.681361 (+153866us) service_pool.cc:224] Handling call
0709 13:07:10.758500 (+ 77139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.061435 (+302935us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4800080058. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:11.574488 (+513053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.574541 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.671821 (+ 97280us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.074393 (+402572us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:12.074459 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.076721 (+  2262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.815950 (+739229us) raft_consensus.cc:1685] finished
0709 13:07:12.815977 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.830347 (+ 14370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15157,"raft.queue_time_us":70071,"raft.run_cpu_time_us":2599,"raft.run_wall_time_us":220804,"spinlock_wait_cycles":3206016,"thread_start_us":1054294,"threads_started":2,"wal-append.queue_time_us":839864}
W20260709 13:07:12.829958 18099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.016s	sys 0.015s
I20260709 13:07:12.833905 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:12.841414 18172 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.842020 18172 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.842463 18172 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.845947 18180 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:12.847600 18162 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.848344 18162 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:12.849790 17729 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:12.851540 18162 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:12.852875 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.854671 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:12.857594 18171 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.135s	user 0.004s	sys 0.000s
I20260709 13:07:12.863039 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1698) took 1446 ms. Trace:
I20260709 13:07:12.863531 15722 rpcz_store.cc:276] 0709 13:07:11.416468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.418525 (+  2057us) service_pool.cc:224] Handling call
0709 13:07:11.418863 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.958876 (+540013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.862789 (+903913us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003bf6d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:12.862976 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063589760}
W20260709 13:07:12.840022 18099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.016s	sys 0.016s
I20260709 13:07:12.835553 18145 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.829332 17982 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:12.871806 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:12.836270 18075 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:12.875208 15722 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:12.873339 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.877471 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.880020 15722 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:12.876458 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1707) took 1326 ms. Trace:
I20260709 13:07:12.874888 18162 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:12.865247 18141 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:12.910307 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.889336 18174 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:07:12.911806 18167 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:12.875697 18145 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:12.907950 18162 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:12.925436 17982 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.927424 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1700) took 1510 ms. Trace:
I20260709 13:07:12.928001 15728 rpcz_store.cc:276] 0709 13:07:11.417063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.634571 (+1217508us) service_pool.cc:224] Handling call
0709 13:07:12.635063 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.635488 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.635517 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.636122 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.776765 (+140643us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:12.776827 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.776938 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.927160 (+150222us) raft_consensus.cc:1685] finished
0709 13:07:12.927186 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.927351 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":140193,"threads_started":1,"wal-append.queue_time_us":234121}
I20260709 13:07:12.930698 16272 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.930800 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1709) took 1233 ms. Trace:
I20260709 13:07:12.934368 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:12.931799 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1702) took 1514 ms. Trace:
I20260709 13:07:12.931308 15728 rpcz_store.cc:276] 0709 13:07:11.697175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.929756 (+1232581us) service_pool.cc:224] Handling call
0709 13:07:12.930186 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.930407 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.930445 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.930500 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.930543 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.930610 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.930735 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.944346 16270 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:12.946516 16270 pending_rounds.cc:85] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 5
I20260709 13:07:12.946789 16270 pending_rounds.cc:107] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:12.948472 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2145) took 1027 ms. Trace:
W20260709 13:07:12.948900 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.949604 15728 rpcz_store.cc:276] 0709 13:07:11.920737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.942433 (+1021696us) service_pool.cc:224] Handling call
0709 13:07:12.944789 (+  2356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.948053 (+  3264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.948092 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.948146 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.948205 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.948276 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.948400 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.948966 16270 raft_consensus.cc:2889] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.942335 15725 rpcz_store.cc:276] 0709 13:07:11.417641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.690083 (+1272442us) service_pool.cc:224] Handling call
0709 13:07:12.713970 (+ 23887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.716009 (+  2039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.716052 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.716688 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.871369 (+154681us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.876004 (+  4635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.882190 (+  6186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.931588 (+ 49398us) raft_consensus.cc:1685] finished
0709 13:07:12.931614 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.931742 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1467,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":123220,"threads_started":1,"wal-append.queue_time_us":168638}
I20260709 13:07:12.951673 18145 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.952741 15725 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.953912 15725 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.953730 18162 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:12.881313 15729 rpcz_store.cc:276] 0709 13:07:11.550078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.709217 (+1159139us) service_pool.cc:224] Handling call
0709 13:07:12.738608 (+ 29391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.738899 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:12.739302 (+   403us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.875775 (+136473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.875826 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.875893 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.875964 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.876085 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25215,"prepare.queue_time_us":1235,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":86,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3236,"thread_start_us":136011,"threads_started":1}
I20260709 13:07:12.969429 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:12.970683 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1599) took 1005 ms. Trace:
I20260709 13:07:12.971134 15646 rpcz_store.cc:276] 0709 13:07:11.965118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.966368 (+  1250us) service_pool.cc:224] Handling call
0709 13:07:12.969266 (+1002898us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:12.970610 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4718336}
I20260709 13:07:12.960969 18078 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:12.981150 18078 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.973207 17848 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:07:12.984153 18123 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:12.984534 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1708) took 1427 ms. Trace:
I20260709 13:07:12.995074 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2136) took 1232 ms. Trace:
I20260709 13:07:12.995702 15721 rpcz_store.cc:276] 0709 13:07:11.762946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.480083 (+717137us) service_pool.cc:224] Handling call
0709 13:07:12.994754 (+514671us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400002154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:12.994984 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549393280}
I20260709 13:07:12.984910 15727 rpcz_store.cc:276] 0709 13:07:11.557298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.718778 (+1161480us) service_pool.cc:224] Handling call
0709 13:07:12.719218 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.719662 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.719700 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.720279 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.845302 (+125023us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.845345 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.845431 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.984320 (+138889us) raft_consensus.cc:1685] finished
0709 13:07:12.984342 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.984474 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1411,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":124602,"threads_started":1,"wal-append.queue_time_us":215311}
I20260709 13:07:13.018424 15721 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:13.018843 15721 pending_rounds.cc:85] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
I20260709 13:07:13.019071 15721 pending_rounds.cc:107] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:13.019311 15721 raft_consensus.cc:2889] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:13.019413 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:13.005442 17967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.013s
I20260709 13:07:13.004771 18075 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:13.038232 17967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.014s
I20260709 13:07:13.051350 18071 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.057843 18071 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.060083 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2144) took 1166 ms. Trace:
I20260709 13:07:13.060225 18071 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:13.060528 15726 rpcz_store.cc:276] 0709 13:07:11.894101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.939608 (+1045507us) service_pool.cc:224] Handling call
0709 13:07:12.947667 (+  8059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.949883 (+  2216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.949925 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.962640 (+ 12715us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.043110 (+ 80470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.043177 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.043296 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.059867 (+ 16571us) raft_consensus.cc:1685] finished
0709 13:07:13.059887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.060023 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":655,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":55335,"threads_started":1,"wal-append.queue_time_us":83435}
W20260709 13:07:13.067488 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.071501 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.060875 18071 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.076532 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 707) took 1020 ms. Trace:
W20260709 13:07:13.077464 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.079308 18071 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.077899 16277 rpcz_store.cc:276] 0709 13:07:12.056323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.056456 (+   133us) service_pool.cc:224] Handling call
0709 13:07:13.074872 (+1018416us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:13.075077 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.076038 (+   961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.076084 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.076146 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:13.076206 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.076291 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.076448 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37409664}
I20260709 13:07:13.081709 18071 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:13.060962 18172 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.055197 18075 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.092319 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2135) took 1449 ms. Trace:
I20260709 13:07:13.092931 15723 rpcz_store.cc:276] 0709 13:07:11.643086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.735800 (+1092714us) service_pool.cc:224] Handling call
0709 13:07:12.736200 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.773403 (+ 37203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:12.878795 (+105392us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.091606 (+212811us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.091852 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.091916 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.091984 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.092072 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.092245 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14728,"prepare.queue_time_us":32890,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":33,"raft.queue_time_us":48609,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2589,"thread_start_us":201062,"threads_started":3,"wal-append.queue_time_us":161935}
I20260709 13:07:13.094132 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.094475 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.095592 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1602) took 1127 ms. Trace:
I20260709 13:07:13.096055 15655 rpcz_store.cc:276] 0709 13:07:11.968006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.991192 (+ 23186us) service_pool.cc:224] Handling call
0709 13:07:13.094299 (+1103107us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:13.095490 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3691392}
I20260709 13:07:13.088371 16271 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:13.070358 18078 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.098157 18172 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:13.110383 18104 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.125104 15655 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:13.115770 18104 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:13.131192 18104 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.131744 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.132246 18104 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.136315 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.139551 15655 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:13.150892 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.152052 15655 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:13.153671 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.154860 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.154963 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.155588 18075 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:13.156250 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.166993 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 930) took 1118 ms. Trace:
W20260709 13:07:13.160256 18193 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:07:13.167551 16274 rpcz_store.cc:276] 0709 13:07:12.048628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.053043 (+  4415us) service_pool.cc:224] Handling call
0709 13:07:13.166241 (+1113198us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:13.166429 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.166604 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.166631 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.166679 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.166722 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.166789 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.166918 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18144128}
I20260709 13:07:13.165253 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:13.188288 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.188082 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:13.189047 15652 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.190246 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1712) took 1120 ms. Trace:
I20260709 13:07:13.193326 18078 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:13.193477 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.195338 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1703) took 1777 ms. Trace:
I20260709 13:07:13.195727 15724 rpcz_store.cc:276] 0709 13:07:11.417906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.689570 (+1271664us) service_pool.cc:224] Handling call
0709 13:07:12.702759 (+ 13189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.710408 (+  7649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.710462 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.741360 (+ 30898us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.864913 (+123553us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:12.864955 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.865038 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.159706 (+294668us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:13.195085 (+ 35379us) raft_consensus.cc:1685] finished
0709 13:07:13.195103 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.195284 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3521,"spinlock_wait_cycles":21775744,"thread_start_us":86144,"threads_started":1,"wal-append.queue_time_us":140156}
I20260709 13:07:13.196694 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:13.197286 15648 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.197219 18123 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.190730 15728 rpcz_store.cc:276] 0709 13:07:12.069436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.969840 (+900404us) service_pool.cc:224] Handling call
0709 13:07:12.979946 (+ 10106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.989433 (+  9487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.989481 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.051586 (+ 62105us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.151282 (+ 99696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.151320 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.151384 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.189980 (+ 38596us) raft_consensus.cc:1685] finished
0709 13:07:13.190003 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.190180 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42340,"raft.queue_time_us":8909,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":21043,"thread_start_us":88885,"threads_started":1,"wal-append.queue_time_us":94072}
I20260709 13:07:13.201707 18124 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.201920 18067 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.197353 17729 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:13.202317 18124 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.202458 18067 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:13.203195 17698 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.203802 17698 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.204486 18124 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:13.205292 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.206904 16235 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:13.207939 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92121.9us
W20260709 13:07:13.236419 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.234959 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.248741 15574 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:13.225832 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:13.227413 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:13.153228 17976 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:07:13.204509 18067 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:13.224057 18123 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.205724 17698 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:13.224895 18122 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:07:13.282838 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.285422 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58096.2us
I20260709 13:07:13.244622 17729 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:13.303742 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.285508 18188 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:13.285555 18123 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.320626 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.322795 15729 raft_consensus.cc:2410] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:13.317317 15648 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:13.328128 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:13.329296 15727 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:13.324417 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.225625 16235 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:13.334275 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 108725us
I20260709 13:07:13.303455 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.326347 18123 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.332801 18122 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.337044 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:13.344210 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.347720 15726 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:13.314626 15652 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:13.353835 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.353102 18122 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:13.358932 18122 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.332944 18162 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:13.365005 18201 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.365473 18201 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:13.325940 17962 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:13.366243 18201 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.367244 18201 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.368171 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:13.369459 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.370492 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.370919 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.382423 15649 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:13.369993 15727 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:13.336829 17872 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:13.373728 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:13.379165 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.308s (SENT) [suppressed 27 similar messages]
W20260709 13:07:13.390615 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.392254 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:13.393095 18184 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.467s	user 0.000s	sys 0.002s
W20260709 13:07:13.394695 18185 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.468s	user 0.003s	sys 0.000s
I20260709 13:07:13.383924 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:13.375084 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.398125 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:13.370959 17849 raft_consensus.cc:1064] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:07:13.495661 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:13.434098 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.421698 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.477061 16274 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:07:13.521894 15692 connection.cc:256] RPC call timeout handler was delayed by -3.2160150669999439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:07:13.539814 15692 connection.cc:256] RPC call timeout handler was delayed by -3.0081150669999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:07:13.541045 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.475334 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 706) took 1420 ms. Trace:
W20260709 13:07:13.541349 15692 connection.cc:256] RPC call timeout handler was delayed by -2.9550150669998629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:07:13.406010 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.542819 16278 rpcz_store.cc:276] 0709 13:07:12.055904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.056019 (+   115us) service_pool.cc:224] Handling call
0709 13:07:12.481180 (+425161us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:13.475094 (+993914us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:13.475257 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416026880}
I20260709 13:07:13.420014 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:13.539244 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 155397us
W20260709 13:07:13.504104 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.541093 15726 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:13.540851 15572 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:13.405660 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:13.544037 15692 connection.cc:256] RPC call timeout handler was delayed by -1.4934150669998871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3457s for a response
I20260709 13:07:13.540169 15729 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:13.545718 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.536754 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 138723us
I20260709 13:07:13.493817 17698 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.560424 17698 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.561754 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.563158 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:13.517972 18131 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.564136 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.566658 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.564427 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.400454 17872 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.527737 18078 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.568914 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.570528 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.571455 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:13.564991 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 145104us
I20260709 13:07:13.544544 18127 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.545521 17976 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.585186 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.544291 18041 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:13.476723 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 934) took 1364 ms (client timeout 1599 ms). Trace:
I20260709 13:07:13.586246 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.589378 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.594059 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.597414 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.569084 17729 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.607183 15572 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:13.574391 17872 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.572679 18131 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.612443 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1701) took 2195 ms. Trace:
I20260709 13:07:13.612759 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:13.591112 18127 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.626214 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.626977 15729 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:13.602835 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.612882 15720 rpcz_store.cc:276] 0709 13:07:11.417356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.635234 (+1217878us) service_pool.cc:224] Handling call
0709 13:07:12.635543 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.636464 (+   921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.636495 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.637059 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.834754 (+197695us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:12.834806 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.834883 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.392528 (+557645us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:13.607429 (+214901us) raft_consensus.cc:1685] finished
0709 13:07:13.607449 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.612364 (+  4915us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":667,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":15469312,"thread_start_us":197232,"threads_started":1,"wal-append.queue_time_us":287952}
I20260709 13:07:13.629941 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.631290 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.632128 15720 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:13.614719 18123 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.615602 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.635471 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.616595 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:13.591014 16271 rpcz_store.cc:269] 0709 13:07:12.112468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.192717 (+ 80249us) service_pool.cc:224] Handling call
0709 13:07:13.476518 (+1283801us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400697654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:13.476666 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846721792}
I20260709 13:07:13.619413 18071 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:13.588838 18041 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.619954 17698 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:13.622078 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 713) took 1049 ms. Trace:
I20260709 13:07:13.622728 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.610136 17976 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:13.624341 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.639091 16275 rpcz_store.cc:276] 0709 13:07:12.572218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.671152 (+ 98934us) service_pool.cc:224] Handling call
0709 13:07:12.671494 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:12.671834 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.671861 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:12.672444 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.875734 (+203290us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:12.875775 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.875842 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.394149 (+518307us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:13.621723 (+227574us) raft_consensus.cc:1685] finished
0709 13:07:13.621753 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.621995 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1263,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":15544704,"thread_start_us":202906,"threads_started":1,"wal-append.queue_time_us":253973}
I20260709 13:07:13.645556 15572 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.642737 18123 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:13.640057 16277 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:13.642314 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.584551 18078 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.604058 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:13.663892 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.665271 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.666366 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.657738 18175 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:13.670765 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.670603 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.638736 18041 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.638540 18071 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.658066 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.674815 16277 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:13.745164 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.756006 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.753120 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.720005 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.780534 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:13.675758 15727 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:07:13.772231 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.727975 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.752703 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:13.710094 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 710) took 1141 ms. Trace:
I20260709 13:07:13.698395 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.855029 16276 rpcz_store.cc:276] 0709 13:07:12.568334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.571398 (+  3064us) service_pool.cc:224] Handling call
0709 13:07:13.709894 (+1138496us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400090454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:13.710021 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578885504}
I20260709 13:07:13.855862 16275 raft_consensus.cc:2410] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:13.754650 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:13.769982 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.856735 15725 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:13.676129 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.728719 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.748775 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.858820 15576 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
W20260709 13:07:13.749562 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.703227 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.757087 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:13.863268 15648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.010s
I20260709 13:07:13.863855 15579 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.689517 16269 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:13.864917 15648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.010s
I20260709 13:07:13.849392 15720 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:13.704835 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:13.875571 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.876343 15573 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.681468 15572 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:13.879531 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.884523 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:13.737216 18192 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.810s	user 0.005s	sys 0.000s
W20260709 13:07:13.888470 15619 connection.cc:256] RPC call timeout handler was delayed by -1.0253761410000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:07:13.891434 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.893163 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.752967 18067 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.756242 18186 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:13.896286 15578 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:13.894133 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:13.873389 18122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.001s	sys 0.018s
I20260709 13:07:13.682753 17836 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.903522 18221 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:13.904175 18188 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.904623 18228 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:13.904713 18188 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.676312 18071 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.907333 18188 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:13.691018 17849 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:13.903543 18122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.001s	sys 0.018s
I20260709 13:07:13.844831 18174 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:13.871498 18104 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.899304 15723 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:13.744303 18131 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:13.695258 18078 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:13.678244 18127 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:13.699082 17698 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.915809 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.916504 15574 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:13.917503 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:13.918217 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 299323us
I20260709 13:07:13.825732 17968 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:13.901865 17962 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:13.902326 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.902093 18186 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.903076 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.925977 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.859627 17729 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:13.919037 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.901327 15572 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:13.923535 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.902752 18067 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.927234 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:13.760316 18041 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.674440 18175 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.931885 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:13.927858 15578 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:13.955220 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.934144 15574 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:13.937048 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.956900 15576 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.944036 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:13.939473 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:13.955963 15578 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:13.958300 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:13.958726 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.959414 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.959733 15578 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:07:13.941912 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:13.960314 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.959961 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:13.921736 18131 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.676965 17976 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.963874 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.971505 15575 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 2.
I20260709 13:07:13.972865 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.973667 15575 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:13.965698 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.966895 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.968080 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:13.928648 18127 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:13.921062 18078 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.974831 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:13.975255 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.980808 15574 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.981446 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.982242 15572 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
W20260709 13:07:13.983611 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.984438 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:13.976605 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 360092us
I20260709 13:07:13.979169 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:13.980320 16278 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:13.979848 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 347440us
I20260709 13:07:13.955410 18233 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:13.960906 18124 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.964602 18165 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:13.921581 17698 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:13.988379 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:14.001821 15575 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:14.003227 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 430297us
I20260709 13:07:13.967119 18201 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.011210 15575 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:13.981341 17920 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.976305 17967 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:13.976831 18127 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:13.928941 17968 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:13.982990 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 714) took 1410 ms. Trace:
I20260709 13:07:14.011297 18201 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.017954 18165 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:14.023061 18188 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.040931 18188 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:14.041447 18188 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.041316 18165 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.031895 16273 rpcz_store.cc:276] 0709 13:07:12.572495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.816412 (+243917us) service_pool.cc:224] Handling call
0709 13:07:12.836144 (+ 19732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.844976 (+  8832us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:12.884646 (+ 39670us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.198225 (+313579us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b180039e0e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:07:13.927987 (+729762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.933983 (+  5996us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:13.956931 (+ 22948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.966446 (+  9515us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.980115 (+ 13669us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14893,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":72692,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"spinlock_wait_cycles":4739456,"thread_start_us":688938,"threads_started":2,"wal-append.queue_time_us":888541}
I20260709 13:07:14.044304 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:14.044610 18248 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:14.045145 18248 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.049482 18188 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.051473 18188 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.053704 18067 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.054461 18067 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:14.055559 18186 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.034674 18201 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.059738 17968 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.062281 18071 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.066090 15726 raft_consensus.cc:2393] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:13.987970 18078 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.068737 18078 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:14.069415 18078 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:14.015136 17920 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:14.070488 17920 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.013332 17872 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.074847 17698 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:14.041899 15605 heartbeater.cc:646] Failed to heartbeat to 127.14.34.190:46799 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.34.190:46799 timed out after 15.000s (SENT)
I20260709 13:07:13.983697 18131 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.013949 15571 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:14.023775 18127 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:14.079016 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 326379us
I20260709 13:07:14.076938 15578 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:07:14.088671 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:14.081883 15573 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:14.035524 18175 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.018626 18233 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.036665 17729 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.104523 15576 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:14.090236 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:14.257082 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 168489us
I20260709 13:07:14.260689 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:14.114585 15577 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.260875 15578 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:14.268544 15573 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.268803 15574 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
W20260709 13:07:14.271615 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.273080 15647 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:14.133800 15579 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:14.056613 18186 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:14.222901 18230 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 13:07:14.303714 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:14.090425 17698 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:14.314996 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 323789us
I20260709 13:07:14.314308 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 459) took 1052 ms. Trace:
I20260709 13:07:14.274240 18169 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.213320 18071 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.348546 15579 rpcz_store.cc:276] 0709 13:07:13.246736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.246867 (+   131us) service_pool.cc:224] Handling call
0709 13:07:13.756921 (+510054us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:14.299094 (+542173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37515136}
W20260709 13:07:14.355405 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 401827us
W20260709 13:07:14.381271 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 413211us
I20260709 13:07:14.076658 18078 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:14.362547 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.365393 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61785us
I20260709 13:07:14.384186 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:14.382723 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:14.305001 18186 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:14.387415 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:14.396142 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 454) took 1189 ms. Trace:
I20260709 13:07:14.400596 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:14.403179 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:14.394927 15577 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:14.384642 18041 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:14.387559 18241 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:14.388165 18169 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:14.431468 15647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 458) took 2382 ms (client timeout 1977 ms). Trace:
I20260709 13:07:14.432542 18186 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:14.441082 15647 rpcz_store.cc:269] 0709 13:07:12.048852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.049982 (+  1130us) service_pool.cc:224] Handling call
0709 13:07:14.428813 (+2378831us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b540035d254. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:14.431367 (+  2554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5036642560}
I20260709 13:07:14.441499 18186 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.419647 18249 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.420228 17982 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:14.402549 18180 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.397661 18071 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.397755 17968 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.440528 18078 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.420379 17872 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.400171 18188 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:14.440605 18248 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.447909 17982 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:14.448407 18131 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.446936 18241 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.466321 18180 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:14.504894 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1603) took 1108 ms. Trace:
I20260709 13:07:14.505546 15574 rpcz_store.cc:276] 0709 13:07:13.396942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.269806 (+872864us) service_pool.cc:224] Handling call
0709 13:07:14.270211 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.270463 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:14.273128 (+  2665us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.504535 (+231407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.504589 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:14.504631 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.504697 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.504836 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13487,"prepare.queue_time_us":3042,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":148352,"thread_start_us":217414,"threads_started":1}
I20260709 13:07:14.466127 18078 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.478404 17982 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:14.512617 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 126707us
I20260709 13:07:14.455305 18071 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.490211 17698 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:14.529980 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 125668us
W20260709 13:07:14.535929 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 151857us
W20260709 13:07:14.538412 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 122233us
I20260709 13:07:14.544667 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:14.584759 18174 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:14.585350 18174 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:14.515317 17968 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:14.530874 18180 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:14.523111 18078 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:14.552510 18257 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.617131 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:14.621008 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:14.621073 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:14.624537 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 78936.6us
I20260709 13:07:14.608924 17698 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.608767 18131 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:14.680927 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:14.693780 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.696779 18267 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:14.697209 18255 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:07:14.699370 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:14.639343 17920 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.001s
W20260709 13:07:14.701464 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.619458 18248 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:07:14.716724 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:14.717406 15722 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:14.717835 15722 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:14.722698 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 104803us
I20260709 13:07:14.703958 17849 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.721731 15722 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.618136 18174 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.683284 17698 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.633615 18257 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.703274 18131 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:07:14.813634 15722 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.799345 15725 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:07:14.804250 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.717540 18165 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:14.727094 18266 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:14.819257 18260 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:07:14.734555 18250 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.731721 17849 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.842152 18131 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.843297 18269 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:14.878235 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:14.878365 18269 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.846151 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:14.880470 18269 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.880612 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:14.881328 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:14.881713 18104 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:14.846400 18071 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:14.882143 15653 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:14.846964 18264 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:07:14.877756 17982 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.846899 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 462) took 1448 ms. Trace:
I20260709 13:07:14.885412 15649 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:14.398283 15580 rpcz_store.cc:276] 0709 13:07:13.206719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.206827 (+   108us) service_pool.cc:224] Handling call
0709 13:07:13.225855 (+ 19028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.226344 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:13.440234 (+213890us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.086160 (+645926us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.090110 (+  3950us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.090271 (+   161us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:14.090556 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.261494 (+170938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.261597 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.395854 (+134257us) raft_consensus.cc:1685] finished
0709 13:07:14.395884 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.396062 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425,"prepare.queue_time_us":41193,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":1593,"raft.queue_time_us":462781,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":48891,"thread_start_us":777653,"threads_started":3,"wal-append.queue_time_us":615037}
I20260709 13:07:14.848927 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 461) took 1451 ms. Trace:
I20260709 13:07:14.887401 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:14.888084 15580 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.887207 17982 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:14.800318 18270 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:14.890527 18270 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:14.891427 18270 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.892870 18270 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:14.872366 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:14.887320 17836 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.886961 15576 rpcz_store.cc:276] 0709 13:07:13.397888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.269826 (+871938us) service_pool.cc:224] Handling call
0709 13:07:14.270747 (+   921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.270982 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.271017 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.303118 (+ 32101us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.514524 (+211406us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:14.514583 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.514663 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.848708 (+334045us) raft_consensus.cc:1685] finished
0709 13:07:14.848729 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.848871 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":119020,"threads_started":1,"wal-append.queue_time_us":418661}
I20260709 13:07:14.890080 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 455) took 1680 ms. Trace:
I20260709 13:07:14.849291 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 463) took 1449 ms. Trace:
I20260709 13:07:14.915408 15574 rpcz_store.cc:276] 0709 13:07:13.399817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.508747 (+1108930us) service_pool.cc:224] Handling call
0709 13:07:14.509093 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.509458 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.509492 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.516086 (+  6594us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.700580 (+184494us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:14.700659 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.700780 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.849103 (+148323us) raft_consensus.cc:1685] finished
0709 13:07:14.849121 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.849238 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11711,"raft.queue_time_us":5200,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":15556,"thread_start_us":149484,"threads_started":1,"wal-append.queue_time_us":198402}
I20260709 13:07:14.917160 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:14.891935 18233 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.892930 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1601) took 1512 ms. Trace:
I20260709 13:07:14.929556 15573 rpcz_store.cc:276] 0709 13:07:13.380367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.162545 (+782178us) service_pool.cc:224] Handling call
0709 13:07:14.268340 (+105795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.269140 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.892747 (+623607us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54001351d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:14.892873 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123813120}
I20260709 13:07:14.893723 15578 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:14.872764 15650 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:14.868325 15648 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:14.849783 18262 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:07:14.884224 15579 rpcz_store.cc:276] 0709 13:07:13.398192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.387937 (+989745us) service_pool.cc:224] Handling call
0709 13:07:14.411472 (+ 23535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.418638 (+  7166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.418684 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.430340 (+ 11656us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.522821 (+ 92481us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:14.534872 (+ 12051us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.690730 (+155858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.690834 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.846669 (+155835us) raft_consensus.cc:1685] finished
0709 13:07:14.846698 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.846841 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17598,"prepare.queue_time_us":12872,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":109990,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"thread_start_us":207945,"threads_started":2,"wal-append.queue_time_us":368637}
I20260709 13:07:14.773941 18241 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:14.718297 17920 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.898108 15725 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:14.938760 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 215253us
I20260709 13:07:14.906435 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:14.939673 15576 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:14.781473 18278 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:14.880635 18201 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.000s
I20260709 13:07:14.948091 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:14.951314 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 732) took 1079 ms. Trace:
I20260709 13:07:14.959687 16275 rpcz_store.cc:276] 0709 13:07:13.872071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.881231 (+  9160us) service_pool.cc:224] Handling call
0709 13:07:13.900590 (+ 19359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.900794 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:13.929595 (+ 28801us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.962949 (+ 33354us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.776249 (+813300us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180037dbc0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:14.950845 (+174596us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180037dbc0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:07:14.951002 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.951047 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.951089 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.951152 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.951258 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24262,"prepare.queue_time_us":85038,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":991550,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":210,"spinlock_wait_cycles":31153792}
I20260709 13:07:14.897257 17849 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.953248 15727 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:07:14.954501 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.01261e+06us
I20260709 13:07:14.962863 16235 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:14.882179 18104 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.965699 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 941) took 1491 ms. Trace:
I20260709 13:07:14.969547 16270 rpcz_store.cc:276] 0709 13:07:13.474146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.713067 (+238921us) service_pool.cc:224] Handling call
0709 13:07:13.713383 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.713578 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:13.714885 (+  1307us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.961506 (+1246621us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.961567 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.961639 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.965489 (+  3850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.965628 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":965784,"prepare.queue_time_us":848,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":77274880,"thread_start_us":262425,"threads_started":1,"wal-append.queue_time_us":555717}
I20260709 13:07:14.971531 18122 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.963647 18201 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.725033 18180 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:14.974375 18201 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:14.974515 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 728) took 1191 ms. Trace:
I20260709 13:07:14.974870 16274 rpcz_store.cc:276] 0709 13:07:13.783405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.783524 (+   119us) service_pool.cc:224] Handling call
0709 13:07:13.841134 (+ 57610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.841426 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:13.841794 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.919572 (+ 77778us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18003e4d00. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:07:14.974184 (+1054612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.974243 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.974287 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.974351 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.974463 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845759,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":11904,"spinlock_wait_cycles":36385536,"thread_start_us":208558,"threads_started":1,"wal-append.queue_time_us":562240}
I20260709 13:07:14.978331 17848 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:14.978894 17848 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:14.979830 17848 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:14.956867 15580 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:14.905665 17836 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:14.992445 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:14.994585 18104 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:14.962824 18127 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.000s
W20260709 13:07:15.065843 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 444860us
I20260709 13:07:15.080114 15650 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:15.037695 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45367.4us
I20260709 13:07:15.086987 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.002379 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.087378 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:15.036782 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:14.977870 18242 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.663s	user 0.004s	sys 0.000s
I20260709 13:07:15.065061 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:15.093227 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 56589.2us
I20260709 13:07:15.089167 15573 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.097731 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:14.968276 18282 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:15.107741 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:14.967814 18278 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:15.112329 18278 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:15.114588 18280 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.115142 18280 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:15.115607 18280 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.044502 18201 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:07:14.915176 15571 rpcz_store.cc:276] 0709 13:07:13.209221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.225449 (+ 16228us) service_pool.cc:224] Handling call
0709 13:07:13.757915 (+532466us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eeeee 0000000000375939 00007f2d9a9621e0 00007f2d9aa2b0c4 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:13.758126 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.086711 (+328585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.889813 (+803102us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400292a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:14.890003 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535242880}
I20260709 13:07:15.107277 18256 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.122110 18071 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:15.123294 18071 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.123723 18071 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:15.124001 18104 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.124833 18071 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:15.065740 18165 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:15.109594 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.125499 17920 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.135519 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:15.138201 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 146502us
I20260709 13:07:15.062819 18168 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.141000 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:15.100881 18122 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:15.153865 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 44417.9us
I20260709 13:07:15.101614 18266 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.968719 18241 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
I20260709 13:07:15.065603 18249 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:07:15.157817 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:15.113824 18169 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.161320 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:15.103271 17976 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.157437 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.089053 18127 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:15.088967 18259 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:07:15.176463 15573 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:15.177469 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:15.179280 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:15.183589 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.142797 18233 raft_consensus.cc:2764] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:15.088179 18276 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:07:15.196447 15580 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:15.197731 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.162616 18122 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:15.199426 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:15.200143 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.168202 18071 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.200871 16274 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:15.163849 18075 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.219309 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:15.217048 15573 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:15.174726 18289 raft_consensus.cc:2764] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:15.233661 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.166428 18248 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:15.241971 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.245339 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.246230 15580 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.241140 15723 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:15.248824 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.241452 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:15.251485 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:15.254138 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:15.254927 16276 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:15.223667 18122 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.137014 18282 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:15.262145 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:15.262728 16274 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.240713 18266 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.279234 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:15.282238 15729 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.259164 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:15.222283 18169 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.223451 18131 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.191579 18168 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:15.261039 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.299932 15723 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:15.259696 17982 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.275990 17778 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.250175 18201 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:15.305976 15722 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:07:15.328888 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1585) took 1995 ms. Trace:
I20260709 13:07:15.293756 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:15.292449 18302 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:15.330060 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.379256 15729 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:15.373100 15580 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:15.421093 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.309481 15722 pending_rounds.cc:85] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
W20260709 13:07:15.339910 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63185.8us
I20260709 13:07:15.422537 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.424162 15723 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:15.400964 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.350984 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.425190 15722 pending_rounds.cc:107] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:07:15.425896 15722 raft_consensus.cc:2889] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:15.354555 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.427373 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.307477 17849 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:15.425222 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.421095 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.421576 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:15.503151 15729 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:15.503322 15580 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:15.335397 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 736) took 1404 ms. Trace:
I20260709 13:07:15.329361 15572 rpcz_store.cc:276] 0709 13:07:13.333700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.010621 (+676921us) service_pool.cc:224] Handling call
0709 13:07:14.010984 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.403009 (+392025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.403039 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.403605 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:07:14.572829 (+169224us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:14.718520 (+145691us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.731685 (+ 13165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.731778 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.328654 (+596876us) raft_consensus.cc:1685] finished
0709 13:07:15.328675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.328826 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12143,"prepare.queue_time_us":34058,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":119548,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":197,"thread_start_us":616082,"threads_started":3,"wal-append.queue_time_us":635156}
I20260709 13:07:15.504666 15580 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:15.425267 15724 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:15.489224 16274 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 3.
I20260709 13:07:15.489566 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.505297 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1545) took 2036 ms. Trace:
I20260709 13:07:15.492573 17848 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:15.362639 17778 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:15.493674 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71233.8us
I20260709 13:07:15.505669 15580 rpcz_store.cc:276] 0709 13:07:13.468753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.504131 (+2035378us) service_pool.cc:224] Handling call
0709 13:07:15.504498 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.505064 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.505248 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.494145 18291 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:15.496996 15723 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:15.502233 18127 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.306293 17982 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:15.504151 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.522197 15729 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:15.279156 18298 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.505733 15728 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:15.519505 15572 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.406431 17698 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.340255 18174 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 13:07:15.520255 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:15.520907 17848 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:15.506817 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:15.550586 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 43846.9us
I20260709 13:07:15.533631 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1554) took 1994 ms. Trace:
I20260709 13:07:15.556243 15572 rpcz_store.cc:276] 0709 13:07:13.538895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.504940 (+1966045us) service_pool.cc:224] Handling call
0709 13:07:15.519279 (+ 14339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.533011 (+ 13732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.533541 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.548543 15580 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.504640 16272 rpcz_store.cc:276] 0709 13:07:13.931345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.984301 (+ 52956us) service_pool.cc:224] Handling call
0709 13:07:14.006421 (+ 22120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.963985 (+957564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.964015 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.964504 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.257214 (+292710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:15.257259 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.257316 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.335099 (+ 77783us) raft_consensus.cc:1685] finished
0709 13:07:15.335129 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.335317 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":952898,"raft.queue_time_us":964259,"raft.run_cpu_time_us":41,"raft.run_wall_time_us":45,"thread_start_us":192993,"threads_started":1,"wal-append.queue_time_us":348431}
I20260709 13:07:15.549198 18282 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.534338 17982 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.538816 18257 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:15.677532 17848 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:15.483932 18302 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:15.572247 18300 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:07:15.570369 18104 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.710569 18122 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:15.711839 17849 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:15.715327 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1604) took 2005 ms. Trace:
I20260709 13:07:15.858522 15580 rpcz_store.cc:276] 0709 13:07:13.710075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.518449 (+1808374us) service_pool.cc:224] Handling call
0709 13:07:15.548366 (+ 29917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.561821 (+ 13455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.715256 (+153435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:15.801918 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 601807us
I20260709 13:07:15.860550 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:15.811178 15573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.015s
W20260709 13:07:15.829701 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.861959 15573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.016s
I20260709 13:07:15.904181 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 464) took 2504 ms. Trace:
I20260709 13:07:15.798319 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:15.904716 15573 rpcz_store.cc:276] 0709 13:07:13.400144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.249843 (+1849699us) service_pool.cc:224] Handling call
0709 13:07:15.250154 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.250340 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:15.256267 (+  5927us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.903812 (+647545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.903871 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:15.903916 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.903986 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.904115 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41042,"prepare.queue_time_us":8885,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":606101,"threads_started":1}
I20260709 13:07:15.906282 16272 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:15.886348 18168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.011s	sys 0.003s
I20260709 13:07:15.928498 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:15.929226 16269 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.929522 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:16.040925 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 111460us
I20260709 13:07:16.041951 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:15.930125 18127 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.031991 17848 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:15.930691 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:15.931010 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:15.770308 18104 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.916110 18280 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.000s
I20260709 13:07:15.985498 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1587) took 2626 ms. Trace:
I20260709 13:07:15.986457 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1602) took 2599 ms. Trace:
W20260709 13:07:16.011920 18274 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.943s	user 0.014s	sys 0.017s
I20260709 13:07:15.858667 17778 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:16.013288 18075 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.001s
I20260709 13:07:16.014362 18302 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:15.985940 18320 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:07:16.033794 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.007s	sys 0.020s
W20260709 13:07:16.035233 16276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.010s	sys 0.011s
I20260709 13:07:16.099105 18319 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:15.930321 18122 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:16.099862 18247 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:16.100596 18247 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:16.035295 18314 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.102371 18314 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.105149 18314 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:16.070341 18123 raft_consensus.cc:670] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } [suppressed 2 similar messages]
I20260709 13:07:16.044726 18127 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.088352 15578 rpcz_store.cc:276] 0709 13:07:13.386765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.265409 (+878644us) service_pool.cc:224] Handling call
0709 13:07:14.893420 (+628011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.930781 (+ 37361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.970632 (+1039851us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400292a50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:15.986376 (+ 15744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443291392}
I20260709 13:07:16.087525 15575 rpcz_store.cc:276] 0709 13:07:13.358958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.018378 (+659420us) service_pool.cc:224] Handling call
0709 13:07:14.018682 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.310769 (+292087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.310818 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.310875 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.310925 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.972481 (+1661556us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400293454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:15.985232 (+ 12751us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.985431 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671134080}
I20260709 13:07:16.114470 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1613) took 1171 ms. Trace:
I20260709 13:07:16.114925 15575 rpcz_store.cc:276] 0709 13:07:14.942578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.113478 (+1170900us) service_pool.cc:224] Handling call
0709 13:07:16.113842 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.114074 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.114110 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.114163 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:16.114212 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.114277 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.114405 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:16.089882 16275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.017s
W20260709 13:07:16.116921 16275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.007s	sys 0.017s
I20260709 13:07:16.086591 18104 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.094628 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:16.098126 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.008s	sys 0.020s
I20260709 13:07:16.124332 15575 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:07:16.099392 16276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.010s	sys 0.011s
I20260709 13:07:16.125231 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1614) took 1182 ms. Trace:
W20260709 13:07:16.088145 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 46337.8us
I20260709 13:07:16.125676 15575 rpcz_store.cc:276] 0709 13:07:14.942895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.116023 (+1173128us) service_pool.cc:224] Handling call
0709 13:07:16.116335 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.124912 (+  8577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.125165 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:15.886078 18259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.010s
I20260709 13:07:16.119087 15573 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:16.127749 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1611) took 1435 ms. Trace:
I20260709 13:07:16.082473 16271 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:16.128283 15573 rpcz_store.cc:276] 0709 13:07:14.692501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.095051 (+1402550us) service_pool.cc:224] Handling call
0709 13:07:16.118688 (+ 23637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.127386 (+  8698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.127659 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.130977 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:16.133268 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.134116 15580 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:16.136664 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1615) took 1193 ms. Trace:
I20260709 13:07:16.110332 18075 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.092475 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:16.127142 18259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.007s	sys 0.010s
I20260709 13:07:16.122393 18127 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.137216 15575 rpcz_store.cc:276] 0709 13:07:14.943183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.135636 (+1192453us) service_pool.cc:224] Handling call
0709 13:07:16.136039 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.136258 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.136293 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.136350 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:16.136397 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.136466 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.136597 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.146054 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1616) took 1202 ms. Trace:
I20260709 13:07:16.156728 15573 rpcz_store.cc:276] 0709 13:07:14.943631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.132021 (+1188390us) service_pool.cc:224] Handling call
0709 13:07:16.145319 (+ 13298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.145582 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.145620 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.145679 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:16.145734 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.145809 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.145957 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.085753 17848 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.095834 18280 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.161816 15729 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.150403 15580 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:16.163229 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1618) took 1218 ms. Trace:
I20260709 13:07:16.163661 15580 rpcz_store.cc:276] 0709 13:07:14.944346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.134902 (+1190556us) service_pool.cc:224] Handling call
0709 13:07:16.148097 (+ 13195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.162931 (+ 14834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.163166 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.158226 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.139917 18233 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:16.159888 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 469) took 1068 ms. Trace:
I20260709 13:07:16.099917 18319 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.172273 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 466) took 1186 ms. Trace:
I20260709 13:07:16.172827 15573 rpcz_store.cc:276] 0709 13:07:14.985791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.158569 (+1172778us) service_pool.cc:224] Handling call
0709 13:07:16.171581 (+ 13012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.171816 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.171853 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.171908 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.172004 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.172073 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.172200 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.101723 18247 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.168330 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.142848 18316 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.169191 15575 rpcz_store.cc:276] 0709 13:07:15.091079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.158872 (+1067793us) service_pool.cc:224] Handling call
0709 13:07:16.159244 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.159463 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.159499 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.159557 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.159604 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.159674 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.159821 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.180109 15580 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:16.180902 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 470) took 1089 ms. Trace:
I20260709 13:07:16.181291 15580 rpcz_store.cc:276] 0709 13:07:15.093343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.164589 (+1071246us) service_pool.cc:224] Handling call
0709 13:07:16.179684 (+ 15095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.180602 (+   918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.180835 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:16.159597 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 343748us
I20260709 13:07:16.185313 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.189108 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.194209 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.197227 15580 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:16.212668 15580 pending_rounds.cc:85] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 5
I20260709 13:07:16.212973 15580 pending_rounds.cc:107] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:16.182928 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.214509 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.215102 16271 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:16.217214 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 744) took 1015 ms. Trace:
I20260709 13:07:16.213191 15580 raft_consensus.cc:2889] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:16.217309 18296 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.217613 16275 rpcz_store.cc:276] 0709 13:07:15.201709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.227963 (+ 26254us) service_pool.cc:224] Handling call
0709 13:07:15.257465 (+ 29502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:15.285228 (+ 27763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.285270 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:15.359054 (+ 73784us) log.cc:844] Serialized 590 byte log entry
0709 13:07:16.117369 (+758315us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.117423 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.117509 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.217020 (+ 99511us) raft_consensus.cc:1685] finished
0709 13:07:16.217039 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.217162 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20300,"raft.queue_time_us":643082,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":15368,"thread_start_us":616449,"threads_started":1,"wal-append.queue_time_us":821151}
I20260709 13:07:16.218907 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.221347 16275 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.192472 18071 consensus_meta.cc:287] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.001s
I20260709 13:07:16.222569 17848 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:16.222723 15580 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:16.175841 18233 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.227046 18233 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.230762 16272 raft_consensus.cc:2376] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3. Re-sending same reply.
W20260709 13:07:16.231263 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.236078 15577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1595) took 2875 ms (client timeout 2221 ms). Trace:
W20260709 13:07:16.236712 15577 rpcz_store.cc:269] 0709 13:07:13.361092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.928426 (+567334us) service_pool.cc:224] Handling call
0709 13:07:16.235822 (+2307396us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000d52d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:16.235979 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355454208}
I20260709 13:07:16.210335 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:16.238103 18071 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.241016 15722 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:16.241987 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2178) took 1025 ms. Trace:
I20260709 13:07:16.267002 15722 rpcz_store.cc:276] 0709 13:07:15.216079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.555616 (+339537us) service_pool.cc:224] Handling call
0709 13:07:16.240487 (+684871us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:16.240753 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.241661 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.241912 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31930624}
I20260709 13:07:16.248494 15720 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.257297 16235 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:16.247825 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 505) took 2878 ms (client timeout 2481 ms). Trace:
W20260709 13:07:16.273125 15726 rpcz_store.cc:269] 0709 13:07:13.369198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.634749 (+265551us) service_pool.cc:224] Handling call
0709 13:07:16.247572 (+2612823us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540011bcd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:16.247722 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919432064}
W20260709 13:07:16.277037 15692 connection.cc:256] RPC call timeout handler was delayed by -1.485134558000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:07:16.277558 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3681345580000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:07:16.277899 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3582345580000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:07:16.278899 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1458345580000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 13:07:16.203078 18318 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.200994 17982 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:16.293504 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.042s	sys 0.091s
W20260709 13:07:16.295032 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.042s	sys 0.091s
I20260709 13:07:16.279028 17848 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.202600 18317 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.301362 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 751) took 1030 ms. Trace:
I20260709 13:07:16.286896 18075 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.318430 15579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.019s	sys 0.062s
I20260709 13:07:16.266083 18296 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:16.283951 15692 connection.cc:256] RPC call timeout handler was delayed by -1.009034558000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:07:16.296981 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 1.20832e+06us
I20260709 13:07:16.278672 18316 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:16.282234 18280 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:16.283699 18314 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:16.297894 17848 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.255648 17836 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.324434 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.286700 18325 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:07:16.320292 15579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.020s	sys 0.062s
I20260709 13:07:16.346374 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 472) took 1067 ms. Trace:
I20260709 13:07:16.289593 18318 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.354828 15575 rpcz_store.cc:276] 0709 13:07:15.278677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.176906 (+898229us) service_pool.cc:224] Handling call
0709 13:07:16.177300 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.177557 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:16.195376 (+ 17819us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.345578 (+150202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.345663 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.345780 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.345955 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.346269 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19518,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":142,"thread_start_us":149636,"threads_started":1}
W20260709 13:07:16.352226 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 727) took 2564 ms (client timeout 1586 ms). Trace:
W20260709 13:07:16.358263 16278 rpcz_store.cc:269] 0709 13:07:13.779860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.780183 (+   323us) service_pool.cc:224] Handling call
0709 13:07:16.343839 (+2563656us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:16.344040 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297630080}
I20260709 13:07:16.358284 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.283635 16275 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:16.345041 17848 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:16.353833 18321 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:07:16.322772 18075 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.373802 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.381264 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:16.368410 15728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.003s	sys 0.014s
W20260709 13:07:16.384955 15728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.003s	sys 0.014s
I20260709 13:07:16.386106 15577 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.391965 18280 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.392824 18280 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.393162 18127 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.396126 18280 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.397877 15575 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:16.402149 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2181) took 1146 ms. Trace:
I20260709 13:07:16.403193 15722 rpcz_store.cc:276] 0709 13:07:15.260055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.268697 (+1008642us) service_pool.cc:224] Handling call
0709 13:07:16.269166 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.269489 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:16.292591 (+ 23102us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.401212 (+108621us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.401275 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:16.401336 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.401889 (+   553us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.402074 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22915,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"thread_start_us":108226,"threads_started":1}
I20260709 13:07:16.363339 17836 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.362118 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.366217 18282 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.407145 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.369491 18328 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.403050 18319 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:16.401204 18122 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.425413 16277 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:16.419852 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.343799 18316 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.428653 18316 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.428928 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:16.430115 16275 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:16.430075 18336 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.430735 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.430794 18336 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:16.432328 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.432379 18336 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.411584 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.401495 18071 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:16.434253 17849 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.434459 18071 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.435256 17849 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.436259 18319 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.437816 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.438843 18319 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:16.440557 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.441229 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.441578 18319 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:16.442350 15650 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:16.396128 18127 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:16.452277 15650 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.415184 18302 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.462903 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.364085 15726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48742
I20260709 13:07:16.468926 15726 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:16.433867 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:16.469321 15726 raft_consensus.cc:614] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.418713 18282 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.473702 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.473412 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.477499 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.479496 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2179) took 1263 ms. Trace:
I20260709 13:07:16.480183 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:16.459450 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68152.9us
I20260709 13:07:16.498703 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.469763 18122 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.503028 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.503888 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.480154 15724 rpcz_store.cc:276] 0709 13:07:15.216345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.643109 (+426764us) service_pool.cc:224] Handling call
0709 13:07:15.748212 (+105103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.748521 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:15.907160 (+158639us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.478311 (+571151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.478361 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.478404 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.478472 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.479440 (+   968us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165636,"prepare.run_cpu_time_us":188,"prepare.run_wall_time_us":16056,"raft.queue_time_us":26227,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12683,"thread_start_us":554321,"threads_started":2,"wal-append.queue_time_us":418385}
I20260709 13:07:16.477430 18328 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:16.509167 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.479221 17778 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.512487 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.513346 15653 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:16.513650 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.514266 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.514937 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.411240 18296 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.511664 18302 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.510833 18319 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.554350 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.558265 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.501658 17849 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:16.507891 18325 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.562068 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.509469 17982 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.564097 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.546917 17729 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.566336 15649 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:16.513221 18328 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.564738 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.512729 18123 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:16.557940 18296 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.507869 18122 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.559806 18314 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.575090 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.578950 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1612) took 1637 ms. Trace:
I20260709 13:07:16.565225 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.548786 18323 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.583449 15578 rpcz_store.cc:276] 0709 13:07:14.942017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.111700 (+1169683us) service_pool.cc:224] Handling call
0709 13:07:16.112122 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.112515 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.112554 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.113094 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.373008 (+259914us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:16.373048 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.373118 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.578741 (+205623us) raft_consensus.cc:1685] finished
0709 13:07:16.578763 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.578895 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9435,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1980,"thread_start_us":222726,"threads_started":1,"wal-append.queue_time_us":336601}
I20260709 13:07:16.574625 18328 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:16.585556 18337 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:07:16.585836 18338 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:07:16.586344 18329 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:07:16.589257 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2175) took 1374 ms. Trace:
W20260709 13:07:16.572348 18180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.595s	user 0.030s	sys 0.075s
I20260709 13:07:16.605908 15721 rpcz_store.cc:276] 0709 13:07:15.215270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.549315 (+334045us) service_pool.cc:224] Handling call
0709 13:07:16.247821 (+698506us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:16.248022 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.276529 (+ 28507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.276562 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.277086 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.368262 (+ 91176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:16.368304 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.368379 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.588920 (+220541us) raft_consensus.cc:1685] finished
0709 13:07:16.588947 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.589192 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35329,"raft.queue_time_us":28451,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":15002,"spinlock_wait_cycles":10514176,"thread_start_us":87109,"threads_started":1,"wal-append.queue_time_us":180743}
W20260709 13:07:16.617244 18180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.030s	sys 0.076s
I20260709 13:07:16.601442 15652 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:16.618947 18122 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:16.598949 18318 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.580088 18075 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:16.590147 18330 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:07:16.581866 18314 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:16.625365 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.636744 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1747) took 1467 ms. Trace:
I20260709 13:07:16.637214 15728 rpcz_store.cc:276] 0709 13:07:15.169540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.547646 (+378106us) service_pool.cc:224] Handling call
0709 13:07:15.561785 (+ 14139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.562237 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.562267 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.641079 (+ 78812us) log.cc:844] Serialized 564 byte log entry
0709 13:07:16.385463 (+744384us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:16.385521 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.385619 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:16.636523 (+250904us) raft_consensus.cc:1685] finished
0709 13:07:16.636543 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.636682 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":743938,"threads_started":1,"wal-append.queue_time_us":714713}
I20260709 13:07:16.625306 18314 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.628408 17778 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:16.646318 15526 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0afe96ac1d4a48728e3ac0814d8867b1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:16.652645 15526 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:16.647450 17848 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.651881 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 743) took 1459 ms. Trace:
I20260709 13:07:16.671530 16269 rpcz_store.cc:276] 0709 13:07:15.192069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.198413 (+  6344us) service_pool.cc:224] Handling call
0709 13:07:15.198673 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.040319 (+841646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.651611 (+611292us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54005424d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:16.651817 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679655040}
W20260709 13:07:16.678376 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 120691us
I20260709 13:07:16.680433 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.682273 17778 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:16.683085 18328 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.686501 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:16.652967 15526 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:07:16.681313 18239 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.686s	user 0.010s	sys 0.032s
I20260709 13:07:16.690099 17848 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:16.687844 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 177226us
I20260709 13:07:16.689971 15578 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:16.686168 18282 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:16.690662 18239 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.695s	user 0.010s	sys 0.033s
I20260709 13:07:16.699239 18341 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.700915 18078 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:16.701327 18319 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.704682 15650 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:16.708537 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 155300us
I20260709 13:07:16.696434 18356 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.710104 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:16.711558 18122 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.712604 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.713188 16278 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:16.714713 18104 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.006s
I20260709 13:07:16.715207 18104 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.717269 18104 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.714617 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.694736 18276 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 13:07:16.710657 18352 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:16.698670 18354 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:16.704308 18180 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:16.721167 16278 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:16.727182 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:16.741166 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.765008 17962 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.765407 18078 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:16.765615 17962 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.765995 18078 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.767151 18175 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.767537 18175 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:16.767889 18175 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.768257 18078 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:16.708736 17836 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:07:16.771148 18328 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:16.765072 16269 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 4. Ops: []
I20260709 13:07:16.721555 18356 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.770913 18341 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:16.779843 16269 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.766088 17962 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.798399 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.799340 16269 raft_consensus.cc:2410] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:16.776374 17967 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:16.790757 18075 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:07:16.802331 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1723) took 2092 ms. Trace:
I20260709 13:07:16.802937 15720 rpcz_store.cc:276] 0709 13:07:14.709701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.710227 (+   526us) service_pool.cc:224] Handling call
0709 13:07:16.248313 (+1538086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.274602 (+ 26289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.802055 (+527453us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540011bcd0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:16.802250 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536461184}
I20260709 13:07:16.791194 18078 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:07:16.813473 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.817799 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.818434 16278 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.820921 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:16.802907 18075 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:16.826627 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.832047 15576 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:16.832188 15578 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:16.830391 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.830626 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:16.834205 15580 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:16.827078 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.844370 16273 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:16.845348 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.846271 16273 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:16.846470 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:16.846992 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.847481 18356 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:16.848980 15652 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:16.837620 18075 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:16.835008 16235 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:16.839815 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.852533 16275 raft_consensus.cc:2410] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:16.840101 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.840775 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.853570 16274 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:16.841012 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.854830 16271 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:16.855839 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.856704 16271 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:16.842435 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.857851 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.836946 18041 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:16.860877 15649 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:16.862656 16277 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:16.869832 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:16.879849 16278 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:16.882320 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.882457 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:16.891834 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.898623 18277 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.899257 18277 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:16.899875 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.900098 18277 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.901425 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.902055 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.902493 16271 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:16.903198 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.903589 17976 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.903671 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.904029 17976 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:16.904651 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.905684 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.906456 16275 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:16.868336 18356 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:16.903983 16273 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:16.909405 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2180) took 1692 ms. Trace:
I20260709 13:07:16.909673 16278 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.887943 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.904800 16271 raft_consensus.cc:2410] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:16.911732 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.888520 18276 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.914081 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.914956 16275 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:16.917732 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:16.917804 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.918573 16271 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:16.920071 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.872252 18078 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:07:16.871657 18041 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.915823 15725 rpcz_store.cc:276] 0709 13:07:15.217467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.815306 (+597839us) service_pool.cc:224] Handling call
0709 13:07:15.924234 (+108928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.924507 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:15.968389 (+ 43882us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.799536 (+831147us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b180026a8e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:07:16.908908 (+109372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.908978 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:16.909036 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.909121 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.909347 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43789,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":454,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":85371264,"thread_start_us":109042,"threads_started":1}
I20260709 13:07:16.910106 18259 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.882172 18263 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:16.909559 15571 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:16.915789 18122 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.915405 18356 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:16.930269 18357 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:07:16.884459 18075 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:16.933300 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.935112 16278 raft_consensus.cc:2410] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:16.927898 18078 consensus_queue.cc:1243] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:16.933560 18263 consensus_queue.cc:1243] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:16.981314 18365 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:16.982137 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.002846 16278 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 1.
I20260709 13:07:16.982306 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:16.982939 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:17.004238 16275 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:17.014861 15720 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:07:17.015435 15720 pending_rounds.cc:85] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 5
I20260709 13:07:17.015709 15720 pending_rounds.cc:107] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:07:17.016005 15720 raft_consensus.cc:2889] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.021545 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.022491 15654 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:17.025048 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.029240 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.031308 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:16.976701 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.045630 15651 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:17.008162 18319 raft_consensus.cc:2764] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:16.993260 18356 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.059268 18263 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.047616 18314 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.103207 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.104091 15728 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:17.108841 16274 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:17.109906 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.097337 18263 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:17.104350 16273 raft_consensus.cc:2368] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:17.107748 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.135311 18078 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:17.146373 18367 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:17.146961 15652 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:17.146848 18078 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.149181 18078 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.149538 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.151497 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.152340 15652 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:17.152449 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:17.152786 18364 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:07:17.153769 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.154973 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.155632 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.155900 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.156590 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.157122 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.157704 15726 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.149652 18078 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.157564 15728 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:17.158419 18078 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
W20260709 13:07:17.160652 18350 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.575s	user 0.003s	sys 0.007s
I20260709 13:07:17.160808 18078 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:17.161438 18078 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:17.161989 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.162207 18041 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:17.163750 18314 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:17.164520 15726 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:17.165570 18263 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:17.166131 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.140661 18175 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.166662 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.167982 18175 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.165174 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:17.166524 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.157451 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1739) took 2119 ms. Trace:
I20260709 13:07:17.171957 15729 rpcz_store.cc:276] 0709 13:07:15.038302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.522814 (+484512us) service_pool.cc:224] Handling call
0709 13:07:15.523090 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.162310 (+639220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.157229 (+994919us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54000e5954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:17.157395 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468537088}
I20260709 13:07:17.176887 15648 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.177068 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.168938 18324 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.183377 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.185148 15648 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.186694 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.182992 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.181465 18314 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.190584 18314 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.191257 17962 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.192689 18314 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:17.193791 17962 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.193929 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.194599 15651 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:17.196048 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.197324 18078 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.181758 18263 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.199019 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.199960 18263 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.200938 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.201939 18263 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.202373 18263 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.202809 18263 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.202508 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.204581 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.205165 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.205350 16275 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:17.205227 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.208024 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.209087 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.185250 18324 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:17.210295 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.206877 18078 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.206966 18356 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:07:17.210367 18041 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.209620 18314 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.215801 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.216904 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.211231 18122 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.218281 15574 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:07:17.230755 15574 pending_rounds.cc:85] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 3
I20260709 13:07:17.231138 15574 pending_rounds.cc:107] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:07:17.231439 15574 raft_consensus.cc:2889] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.219352 18071 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.213719 18319 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:17.223223 15725 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:17.225204 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.225906 15729 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.226621 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.225260 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.227257 15721 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:17.268626 15727 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:17.229703 17962 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.241168 18122 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.299263 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.303174 15725 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.301430 17836 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.316659 17836 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.319375 17836 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.228289 18314 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.320047 18314 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:17.320072 16270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 739) took 2165 ms (client timeout 2136 ms). Trace:
W20260709 13:07:17.322642 16270 rpcz_store.cc:269] 0709 13:07:15.154994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.156862 (+  1868us) service_pool.cc:224] Handling call
0709 13:07:17.225041 (+2068179us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:17.319964 (+ 94923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39853952}
I20260709 13:07:17.326923 18122 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.263201 18078 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.330936 18314 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.332793 18071 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.302663 17962 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.287984 18324 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.337507 16277 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:17.334435 18263 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.302915 18319 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:17.349740 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 132871us
I20260709 13:07:17.350529 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.351969 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.352607 16275 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.343811 17836 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.384358 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.391609 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.392248 16271 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEARNER]: Advancing to term 6
I20260709 13:07:17.400127 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.406042 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.407495 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.408888 16275 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:17.410398 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.385552 18197 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:17.403206 18071 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.414201 18298 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:17.478690 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54813us
I20260709 13:07:17.480469 15650 raft_consensus.cc:1217] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Deduplicated request from leader. Original: 4.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:07:17.481166 15650 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:17.392377 17836 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.456960 18374 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.491014 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.478318 18369 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:17.473389 18371 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:17.507751 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 152652us
I20260709 13:07:17.493135 18372 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.489990 18291 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:17.531427 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1741) took 2468 ms. Trace:
I20260709 13:07:17.531860 15723 rpcz_store.cc:276] 0709 13:07:15.063172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.540001 (+476829us) service_pool.cc:224] Handling call
0709 13:07:17.142178 (+1602177us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:17.142392 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.210923 (+ 68531us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:17.210952 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.211428 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.410967 (+199539us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.411010 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.411084 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.531084 (+120000us) raft_consensus.cc:1685] finished
0709 13:07:17.531108 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.531360 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5474,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":31011584,"thread_start_us":216391,"threads_started":2,"wal-append.queue_time_us":278381}
I20260709 13:07:17.514925 17962 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.512425 18341 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:07:17.505016 18283 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.489662 18071 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.537029 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.537303 15651 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:17.498296 18369 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.538342 18369 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.531860 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.543284 18071 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.523326 17836 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.527441 18197 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.537603 15723 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.497072 18319 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.524539 18263 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.555011 15725 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:17.556473 15723 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:17.491958 18359 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:07:17.505622 18373 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:17.562629 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 155213us
I20260709 13:07:17.568687 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.570673 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.571456 15723 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:17.513302 18372 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.586655 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.588783 16275 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:17.589002 16277 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:17.595446 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.622901 15651 raft_consensus.cc:1217] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Deduplicated request from leader. Original: 1.3->[2.4-2.4]   Dedup: 2.4->[]
W20260709 13:07:17.635866 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.635962 15651 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:07:17.597510 18371 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.637631 18371 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.622097 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:16.302101 16276 rpcz_store.cc:276] 0709 13:07:15.270894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.328892 (+ 57998us) service_pool.cc:224] Handling call
0709 13:07:15.331674 (+  2782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.331932 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:16.125763 (+793831us) log.cc:844] Serialized 14 byte log entry
0709 13:07:16.299482 (+173719us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.299567 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:16.299630 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.301063 (+  1433us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.301276 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85131,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":468,"thread_start_us":896752,"threads_started":2}
I20260709 13:07:17.615986 18383 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.641059 15693 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.642169 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.642434 18383 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:17.643029 18259 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.643326 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.643924 18278 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.644739 18278 consensus_queue.cc:1243] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:17.587524 18373 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:17.646399 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.612172 16271 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:17.643878 16276 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.645215 18278 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 2.4, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:07:17.649994 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.600875 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.648259 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.682655 15650 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:17.685491 15693 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:17.686699 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 85906.8us
I20260709 13:07:17.640604 18371 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.597234 18379 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.588562 18314 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:17.676447 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.585947 18372 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.644670 18383 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:17.689237 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.702466 18379 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:17.703856 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.704692 15726 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.705837 18239 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.706183 18360 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.676577 18328 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.605070 18122 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.692571 18356 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.631884 18369 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.695928 16272 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:17.696172 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.698589 16278 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.603869 18277 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Committing config change with OpId 6.7: config changed from index 5 to 7, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:17.709170 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:17.720932 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.710101 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.688946 18278 consensus_queue.cc:1243] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:17.678166 18373 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:17.691326 17836 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.718089 15726 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:17.713847 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.707098 18239 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:17.730484 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:17.731043 16269 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.718755 18379 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:17.707590 18263 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.732223 18263 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.732610 18263 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.733273 18259 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.725033 18314 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:07:17.734274 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.734859 18360 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.735198 18360 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:17.735972 18360 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.737103 18360 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:17.738931 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.713410 18328 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.740342 18328 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.741034 16269 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:17.742833 18373 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.743955 18075 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.745481 15726 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:17.722959 18356 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:17.727322 17836 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:17.728416 18122 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:17.738814 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.727322 18378 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:07:17.748893 16270 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.721698 15723 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:17.751820 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.752987 16269 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:17.754159 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.754765 16272 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:17.755707 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:17.756063 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:17.757454 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.758631 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:17.759703 16276 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:17.762236 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:17.764561 16276 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.761317 18253 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:07:17.754977 18356 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.753381 18257 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.760934 18319 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.760321 18354 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.774607 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.771584 16276 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:17.766637 18104 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:17.789849 18104 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:17.768306 16273 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:17.791800 18379 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.792446 18379 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:17.778980 18353 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.794512 18353 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.794936 18353 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.795387 15727 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:17.776794 18354 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.774461 17836 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.771255 18356 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.776969 18257 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:17.783838 15723 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:17.776710 18197 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:17.775810 18319 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:17.785025 16277 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:17.818840 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 93917.9us
I20260709 13:07:17.827373 18263 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.777650 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:17.839059 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61524.1us
I20260709 13:07:17.837293 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.841419 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.842684 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.844223 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.848886 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.816824 18354 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.850762 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:17.854135 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.856166 15723 pending_rounds.cc:85] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
I20260709 13:07:17.830237 18356 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.858317 18373 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:07:17.858716 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:17.860747 15723 pending_rounds.cc:107] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:17.864920 18363 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:17.866751 15723 raft_consensus.cc:2889] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.866371 15726 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:17.859598 15722 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:17.868587 15722 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:17.861790 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.869027 18071 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:17.869288 15729 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.869645 18071 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:17.869428 15722 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:17.870384 15722 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.870618 18071 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.859329 18371 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:07:17.871115 16275 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:17.872990 15692 leader_election.cc:400] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:17.873334 15692 leader_election.cc:403] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:17.878319 15729 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:17.852593 18302 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.852821 18253 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.851173 18360 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:17.852276 18122 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.873983 18374 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
W20260709 13:07:17.890736 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 1.52131e+06us
I20260709 13:07:17.891045 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1607) took 4124 ms. Trace:
I20260709 13:07:17.855302 18278 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.900754 15722 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:17.903196 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1606) took 4183 ms. Trace:
W20260709 13:07:17.903383 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.861459 17872 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.926699 15651 raft_consensus.cc:1217] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Deduplicated request from leader. Original: 4.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:07:17.921627 15572 rpcz_store.cc:276] 0709 13:07:13.766592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.557297 (+1790705us) service_pool.cc:224] Handling call
0709 13:07:15.637418 (+ 80121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.637603 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:15.877664 (+240061us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.890674 (+2013010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.890729 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:17.890780 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.890867 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.890989 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1521360,"prepare.queue_time_us":239868,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1522060,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":491215,"threads_started":1,"wal-append.queue_time_us":542504,"wal-append.run_cpu_time_us":2145,"wal-append.run_wall_time_us":1197305}
I20260709 13:07:17.861358 18385 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:17.942379 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 46050us
I20260709 13:07:17.936638 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:17.855130 18175 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:17.944162 15654 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:17.902554 18302 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:17.948313 18302 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.924593 18278 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:17.949445 18278 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:17.942487 18238 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:17.942682 18360 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:17.951104 18263 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:17.951686 18360 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.935408 17872 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:17.954928 17872 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.956056 17872 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.956453 18302 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.944805 18257 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.958515 18278 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.935591 15651 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:17.925190 15579 rpcz_store.cc:276] 0709 13:07:13.719339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.519917 (+1800578us) service_pool.cc:224] Handling call
0709 13:07:15.520273 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:15.520695 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.520722 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:15.521476 (+   754us) log.cc:844] Serialized 52 byte log entry
0709 13:07:16.354361 (+832885us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:16.364349 (+  9988us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.883011 (+1518662us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180043f960. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:07:17.883187 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.883266 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.883306 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:17.902862 (+ 19556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.903115 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3126,"prepare.queue_time_us":11654,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1527410,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":19894,"spinlock_wait_cycles":3010304,"thread_start_us":832448,"threads_started":1,"wal-append.queue_time_us":891831,"wal-append.run_cpu_time_us":3867,"wal-append.run_wall_time_us":1197431}
I20260709 13:07:17.947607 18385 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:17.963104 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.963254 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:17.892481 18372 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.973016 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1633) took 1155 ms. Trace:
I20260709 13:07:17.982661 18104 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:17.983700 18104 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.986984 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 471) took 2718 ms. Trace:
I20260709 13:07:17.987591 15573 rpcz_store.cc:276] 0709 13:07:15.268826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.174006 (+905180us) service_pool.cc:224] Handling call
0709 13:07:16.187712 (+ 13706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.225789 (+ 38077us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:16.453632 (+227843us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.893112 (+1439480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.893166 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.893208 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.986631 (+ 93423us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5400109854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:17.986697 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.986903 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1335781,"prepare.queue_time_us":46515,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2672,"raft.queue_time_us":1367489,"spinlock_wait_cycles":89529088,"thread_start_us":330655,"threads_started":2,"wal-append.queue_time_us":128415,"wal-append.run_cpu_time_us":2340,"wal-append.run_wall_time_us":1144639}
W20260709 13:07:17.992738 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71114.5us
I20260709 13:07:17.994612 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:17.996805 18124 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.858211 18388 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:07:17.997318 18124 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.009650 15720 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:17.959769 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:17.959045 18302 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.042716 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54000
I20260709 13:07:18.043396 15573 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:18.043737 15573 raft_consensus.cc:614] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.044373 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:18.047827 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.049244 15721 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:18.050495 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:18.053011 15721 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:17.922356 18319 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.054327 15654 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:18.085547 15651 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:18.093192 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1636) took 1269 ms. Trace:
I20260709 13:07:18.096312 15574 rpcz_store.cc:276] 0709 13:07:16.823820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.264517 (+440697us) service_pool.cc:224] Handling call
0709 13:07:17.264890 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.265145 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:17.303226 (+ 38081us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.092786 (+789560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.092855 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.092929 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.093004 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.093122 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702151,"prepare.queue_time_us":38104,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":693057,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6143,"thread_start_us":118970,"threads_started":1}
W20260709 13:07:18.104065 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.107940 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 113418us
I20260709 13:07:18.115696 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:18.118664 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.120049 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:18.120621 15574 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.052055 18258 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.124212 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.128223 15573 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:18.093760 18250 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:18.102314 18169 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.134769 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.097440 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:18.127641 18319 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.135620 15573 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:18.161363 15652 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:18.162482 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:18.163205 16272 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:18.165056 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.172142 15573 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:18.136247 18259 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.175827 15543 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:18.176074 15574 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:18.179803 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:18.181293 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.182094 15574 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:18.183209 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.184357 15574 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:18.158778 18373 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.185366 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.131392 18258 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.187242 18259 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.193277 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.205814 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.205858 15573 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:18.210150 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.174962 18124 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.125430 18385 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.219867 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.219939 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:18.220966 15573 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.221024 15574 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:18.222430 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.223908 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.189193 18383 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.162774 18169 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.210727 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:18.257243 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:18.228053 18394 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:07:18.175348 18353 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.220042 18278 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.194846 18373 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:18.334314 18410 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:07:18.334852 18391 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:07:18.270124 18405 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:18.367486 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.409548 15692 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 2.089s (SENT) [suppressed 25 similar messages]
I20260709 13:07:18.207922 18333 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:07:18.218784 18257 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:18.207988 18296 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.219986 18408 raft_consensus.cc:2764] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:07:18.406680 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.002s	sys 0.004s
W20260709 13:07:18.575646 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.003s	sys 0.004s
I20260709 13:07:18.550197 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:18.559106 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 149585us
W20260709 13:07:18.481191 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.479948 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.577417 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.561693 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.433166 15573 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:18.410239 18372 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:18.563464 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.020s
I20260709 13:07:18.579550 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:18.583688 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.004s	sys 0.020s
W20260709 13:07:18.562819 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 387066us
W20260709 13:07:18.580374 15653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1628) took 1720 ms (client timeout 2065 ms). Trace:
I20260709 13:07:18.581908 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:18.584343 15653 rpcz_store.cc:269] 0709 13:07:16.859668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.866593 (+  6925us) service_pool.cc:224] Handling call
0709 13:07:18.549946 (+1683353us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:18.580314 (+ 30368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10513280}
W20260709 13:07:18.510386 18400 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.352s	user 0.000s	sys 0.005s
W20260709 13:07:18.546531 18412 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:07:18.529625 18398 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.405s	user 0.006s	sys 0.000s
W20260709 13:07:18.585824 15544 connection.cc:256] RPC call timeout handler was delayed by -1.366305331000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:07:18.595602 15544 connection.cc:256] RPC call timeout handler was delayed by -1.366305331000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:07:18.596086 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0756053310000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 13:07:18.596506 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0450053309999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 13:07:18.596869 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0414053310000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:07:18.597237 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0414053310000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:07:18.597761 15544 connection.cc:256] RPC call timeout handler was delayed by -1.035105331000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260709 13:07:18.486229 18104 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.600690 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1639) took 1776 ms. Trace:
I20260709 13:07:18.582231 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:18.560173 17872 consensus_meta.cc:287] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.604s	user 0.015s	sys 0.001s
I20260709 13:07:18.601274 15579 rpcz_store.cc:276] 0709 13:07:16.824676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.962495 (+1137819us) service_pool.cc:224] Handling call
0709 13:07:18.000579 (+ 38084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.001016 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.001056 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.012299 (+ 11243us) log.cc:844] Serialized 564 byte log entry
0709 13:07:18.121361 (+109062us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:18.121408 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.121473 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.600404 (+478931us) raft_consensus.cc:1685] finished
0709 13:07:18.600432 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.600610 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":108691,"threads_started":1,"wal-append.queue_time_us":162531}
I20260709 13:07:18.550783 18169 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:18.453312 18328 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.712s	user 0.014s	sys 0.001s
I20260709 13:07:18.590171 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:18.516853 18288 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:18.491879 18302 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:18.592381 18124 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.598197 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0270053310000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:07:18.615103 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0270053310000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:07:18.615562 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0144053310000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:07:18.616354 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:18.545075 18397 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.364s	user 0.004s	sys 0.006s
I20260709 13:07:18.587327 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.584595 18296 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.585378 18318 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.634675 18318 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.636698 18318 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.638769 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 540) took 1001 ms. Trace:
W20260709 13:07:18.604421 16275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.003s	sys 0.032s
W20260709 13:07:18.589020 18354 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.002s
W20260709 13:07:18.640610 16275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.003s	sys 0.032s
I20260709 13:07:18.639282 15723 rpcz_store.cc:276] 0709 13:07:17.637228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.830250 (+193022us) service_pool.cc:224] Handling call
0709 13:07:17.855909 (+ 25659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.867240 (+ 11331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.867263 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.867579 (+   316us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.980166 (+112587us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.990580 (+ 10414us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.990797 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.990870 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.638483 (+647613us) raft_consensus.cc:1685] finished
0709 13:07:18.638518 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.638692 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":453,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":103,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":112214,"threads_started":1,"wal-append.queue_time_us":214215}
I20260709 13:07:18.640797 18354 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.642900 18354 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.643218 18407 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.643723 18407 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.611320 18328 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.646690 18328 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:18.597962 18278 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.612358 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.647987 18278 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:18.648416 18278 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:18.649008 18356 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.000s
I20260709 13:07:18.649430 18356 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.617022 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:18.585134 18257 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.617384 15574 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:18.614741 18075 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.630595 18417 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:18.616436 18302 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.820251 18341 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:18.820791 18341 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:18.820736 18417 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.822153 18302 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.564713 18405 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.631048 18124 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.822204 18341 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.823737 18341 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.825053 18124 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.632557 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1632) took 1815 ms. Trace:
I20260709 13:07:18.825686 15578 rpcz_store.cc:276] 0709 13:07:16.817244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.860954 (+ 43710us) service_pool.cc:224] Handling call
0709 13:07:16.861335 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.973427 (+1112092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.973458 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.992342 (+ 18884us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.227562 (+235220us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.584228 (+356666us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.587116 (+  2888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.587183 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.632268 (+ 45085us) raft_consensus.cc:1685] finished
0709 13:07:18.632288 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.632468 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1077811,"prepare.queue_time_us":174720,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1118138,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":20096,"spinlock_wait_cycles":1226496,"thread_start_us":343153,"threads_started":2,"wal-append.queue_time_us":381155}
I20260709 13:07:18.828020 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.829329 15578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:18.829514 18318 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.829898 15578 raft_consensus.cc:606] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:18.830363 15578 raft_consensus.cc:614] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.611140 18288 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.650086 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:18.604803 18104 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:18.545346 18409 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.185s	user 0.002s	sys 0.004s
I20260709 13:07:18.650951 18353 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:18.660846 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44574.7us
I20260709 13:07:18.844525 18104 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.766350 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:18.778991 16273 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:18.790318 18408 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.794881 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:18.650799 18372 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.833496 18318 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.851316 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:18.854102 18405 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.856348 18296 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.853817 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:18.857743 18417 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.857918 18296 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.859630 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:18.863219 18296 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.863678 18356 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:18.874617 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:18.875844 18417 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.876355 18417 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.876806 18417 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.835386 18288 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.882663 16271 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:18.884176 15649 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.835853 18373 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:18.836099 18124 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.837368 18407 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:18.837749 15578 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.886782 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:18.892838 15578 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:18.894423 15578 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.838212 18075 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:18.850682 18372 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:18.834055 15573 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:18.896991 15578 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:18.849690 18257 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.906210 18408 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.907480 18278 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.909363 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1755) took 1686 ms. Trace:
I20260709 13:07:18.910466 18296 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.910692 18202 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.911288 18202 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:18.911484 18278 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:18.911391 18417 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.912498 18202 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.913636 18202 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.914681 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 776) took 1412 ms. Trace:
I20260709 13:07:18.914667 18417 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.916185 18283 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:18.917212 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 537) took 1332 ms. Trace:
I20260709 13:07:18.901325 18372 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.918921 15579 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:18.909765 15722 rpcz_store.cc:276] 0709 13:07:17.223376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.223565 (+   189us) service_pool.cc:224] Handling call
0709 13:07:17.223807 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.924830 (+701023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.909041 (+984211us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54003bf6d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:18.909284 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461921024}
I20260709 13:07:18.921345 16270 rpcz_store.cc:276] 0709 13:07:17.502409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.513648 (+ 11239us) service_pool.cc:224] Handling call
0709 13:07:17.513895 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.749289 (+235394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.914378 (+1165089us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400541854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:18.914607 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540080000}
I20260709 13:07:18.899479 18373 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.925022 15726 rpcz_store.cc:276] 0709 13:07:17.585066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.752792 (+167726us) service_pool.cc:224] Handling call
0709 13:07:17.753071 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.868476 (+115405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.916957 (+1048481us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001900d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:18.917147 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260035456}
I20260709 13:07:18.917500 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 788) took 1048 ms. Trace:
W20260709 13:07:18.926986 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.927945 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.904080 18407 raft_consensus.cc:2764] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:18.935140 16275 rpcz_store.cc:276] 0709 13:07:17.868954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.870182 (+  1228us) service_pool.cc:224] Handling call
0709 13:07:17.870558 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.870998 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:17.895621 (+ 24623us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.641061 (+745440us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.641687 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.641849 (+   162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:18.641893 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.641980 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.917207 (+275227us) raft_consensus.cc:1685] finished
0709 13:07:18.917235 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.917426 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3689,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"thread_start_us":667025,"threads_started":1,"wal-append.queue_time_us":990940}
I20260709 13:07:18.936327 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:18.937531 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.947402 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.955490 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.960342 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.961980 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:18.905632 18405 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:18.924842 18283 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:18.901208 18075 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.896886 18124 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:18.970140 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.934376 18296 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:18.946853 18408 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.953006 18422 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.973351 15574 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:18.974473 18124 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:18.949854 18356 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.952219 18373 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:18.975644 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1638) took 2151 ms. Trace:
I20260709 13:07:18.976439 18373 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:18.975699 18356 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:18.978624 17968 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:18.976222 15572 rpcz_store.cc:276] 0709 13:07:16.824394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.943823 (+1119429us) service_pool.cc:224] Handling call
0709 13:07:17.954266 (+ 10443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:18.020985 (+ 66719us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:18.040815 (+ 19830us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.078075 (+ 37260us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.595189 (+517114us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:18.595244 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.595333 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.975277 (+379944us) raft_consensus.cc:1685] finished
0709 13:07:18.975308 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.975507 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43875,"raft.queue_time_us":101314,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5045,"thread_start_us":475696,"threads_started":1,"wal-append.queue_time_us":855481}
I20260709 13:07:18.966255 18419 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.982152 15572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:18.983413 18356 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:18.985416 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1634) took 2162 ms. Trace:
I20260709 13:07:18.986088 15571 rpcz_store.cc:276] 0709 13:07:16.823168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.154040 (+330872us) service_pool.cc:224] Handling call
0709 13:07:17.154595 (+   555us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:18.116018 (+961423us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:18.232932 (+116914us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.599410 (+366478us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.604064 (+  4654us) log.cc:844] Serialized 590 byte log entry
0709 13:07:18.604289 (+   225us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.604348 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.606458 (+  2110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.985087 (+378629us) raft_consensus.cc:1685] finished
0709 13:07:18.985116 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.985340 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":854309,"prepare.queue_time_us":406338,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1339,"raft.queue_time_us":884812,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14725,"thread_start_us":419451,"threads_started":3,"wal-append.queue_time_us":512961}
I20260709 13:07:18.999557 15571 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.967767 18318 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:19.001976 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 351993us
I20260709 13:07:19.005770 18385 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.001410 18356 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.006399 18385 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.006547 18356 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.008803 18356 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.008958 18385 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.011982 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.012192 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 779) took 1258 ms. Trace:
I20260709 13:07:19.012758 15725 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:19.014376 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.012615 16271 rpcz_store.cc:276] 0709 13:07:17.754150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.755779 (+  1629us) service_pool.cc:224] Handling call
0709 13:07:19.011984 (+1256205us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400692654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:19.012134 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589138304}
I20260709 13:07:19.015051 15725 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:19.016741 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1637) took 2192 ms. Trace:
I20260709 13:07:19.017239 15576 rpcz_store.cc:276] 0709 13:07:16.824102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.639295 (+815193us) service_pool.cc:224] Handling call
0709 13:07:17.639645 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:18.430240 (+790595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.430299 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:18.563714 (+133415us) log.cc:844] Serialized 52 byte log entry
0709 13:07:18.989454 (+425740us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:07:18.989503 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.989613 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.016472 (+ 26859us) raft_consensus.cc:1685] finished
0709 13:07:19.016498 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.016672 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":371499,"raft.queue_time_us":356669,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10502,"thread_start_us":674422,"threads_started":2,"wal-append.queue_time_us":421193}
I20260709 13:07:18.989913 18417 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:18.991791 18408 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.001489 18422 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.031605 15572 raft_consensus.cc:606] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.032315 15572 raft_consensus.cc:614] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:19.032428 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 70558.2us
I20260709 13:07:19.034516 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.022501 15571 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.038810 15571 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:07:19.003065 18075 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.024998 18174 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:19.028447 15694 connection.cc:256] RPC call timeout handler was delayed by -1.023146698000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:07:19.030587 15576 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:19.016045 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.019299 18356 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.045965 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.046541 15576 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:19.031172 18278 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.049585 15725 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.055867 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:19.054489 15576 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.058270 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.055820 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 481) took 2602 ms. Trace:
I20260709 13:07:19.061820 18419 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.062357 18432 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.063541 18432 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:19.063927 18432 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:19.064878 18432 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.061012 15577 rpcz_store.cc:276] 0709 13:07:16.453876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.454132 (+   256us) service_pool.cc:224] Handling call
0709 13:07:16.454571 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.906273 (+1451702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.906316 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.921351 (+ 15035us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.025769 (+1104418us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800358a80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:07:19.039980 (+ 14211us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.040031 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.040119 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.044992 (+  4873us) raft_consensus.cc:1685] finished
0709 13:07:19.045010 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.055751 (+ 10741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1487250,"raft.queue_time_us":1469475,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7472,"spinlock_wait_cycles":2538368,"thread_start_us":14011,"threads_started":1,"wal-append.queue_time_us":1094894}
I20260709 13:07:19.058892 18437 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.040901 18333 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:19.028952 18408 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.031374 18422 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.051481 15722 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:19.056875 18318 raft_consensus.cc:2764] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:19.080272 15725 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.083608 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.085331 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.086480 15725 raft_consensus.cc:2410] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:19.080775 18405 consensus_queue.cc:1243] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:19.071856 18296 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.082355 15721 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:19.069092 18431 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:19.072314 18071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.010s	sys 0.028s
I20260709 13:07:19.090396 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.088917 15727 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:19.093837 15577 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.094121 15725 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:19.094697 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.094995 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.076988 18408 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.072372 18437 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:19.093231 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.095949 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.102902 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:19.077620 18422 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.080618 18432 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.060009 18356 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.068612 18278 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.103751 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:19.105767 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51542.7us
I20260709 13:07:19.116894 15727 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:19.106943 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.103780 15725 raft_consensus.cc:2410] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:19.103530 18071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.010s	sys 0.028s
I20260709 13:07:19.121675 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:19.122393 18431 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.122555 15721 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:19.122908 18431 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.123291 18431 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.081934 18434 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:19.130903 18434 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:19.131310 18434 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:19.132207 18434 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.133574 18434 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.135555 18356 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.137967 18278 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.138574 18278 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.139652 18369 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.143922 15721 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.145040 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:19.105520 18437 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.106149 18341 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:19.152632 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:19.154974 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:19.155668 16270 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.156463 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:19.161147 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:19.157231 16272 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
W20260709 13:07:19.166692 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84771us
I20260709 13:07:19.096046 18430 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:07:19.160638 18356 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.161643 18288 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:19.189270 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.181041 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 479) took 2169 ms. Trace:
I20260709 13:07:19.203482 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 772) took 1810 ms. Trace:
W20260709 13:07:19.215715 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.198298 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:19.216440 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48676.7us
I20260709 13:07:19.216331 16278 rpcz_store.cc:276] 0709 13:07:17.392804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.393045 (+   241us) service_pool.cc:224] Handling call
0709 13:07:17.698413 (+305368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.719978 (+ 21565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.203176 (+1483198us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54004efcd0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:19.203402 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701435776}
I20260709 13:07:19.217581 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.217607 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.207415 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.218927 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.220077 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.220698 15577 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:19.221480 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.214092 15649 rpcz_store.cc:276] 0709 13:07:17.011924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.012096 (+   172us) service_pool.cc:224] Handling call
0709 13:07:17.045379 (+ 33283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.884769 (+1839390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.180806 (+296037us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:19.180979 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4228327168}
I20260709 13:07:17.979866 15580 rpcz_store.cc:276] 0709 13:07:16.817497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.872516 (+ 55019us) service_pool.cc:224] Handling call
0709 13:07:16.872814 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.873008 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:16.873230 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.972665 (+1099435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.972717 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.972777 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.972844 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.972958 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1057526,"prepare.queue_time_us":8658,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1063841,"thread_start_us":40912,"threads_started":1,"wal-append.queue_time_us":104673}
I20260709 13:07:19.210137 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 531) took 2055 ms. Trace:
I20260709 13:07:19.223556 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.223434 15720 rpcz_store.cc:276] 0709 13:07:17.155014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.155888 (+   874us) service_pool.cc:224] Handling call
0709 13:07:17.156129 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.011012 (+854883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.209868 (+1198856us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:19.210072 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961843072}
I20260709 13:07:19.224288 15580 raft_consensus.cc:2376] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5. Re-sending same reply.
I20260709 13:07:19.224963 15720 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.225183 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.195657 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.232832 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.236092 15580 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:19.231923 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:19.237831 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.237928 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.237069 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.169662 18071 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.141973 18372 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.244573 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.246907 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.248471 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.249559 15580 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:19.171799 18388 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.251024 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:19.262348 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.264098 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.266425 15578 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:19.189155 18411 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.690s	user 0.018s	sys 0.022s
I20260709 13:07:19.267468 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.269914 15580 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:19.206796 18078 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.210775 18356 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:19.178570 18437 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.177322 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 959) took 1019 ms. Trace:
I20260709 13:07:19.283973 15577 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:19.236518 18430 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.237516 18333 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.251840 18369 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.296896 15726 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:19.299443 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 144503us
I20260709 13:07:19.261670 18278 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.240492 18071 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.252524 18425 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.241897 17968 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:19.252250 18180 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:19.286813 18440 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.316684 15728 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:19.312182 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 94667.8us
I20260709 13:07:19.321367 18447 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.325394 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:19.328431 15728 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.302985 18369 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.333068 18448 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:19.334070 18071 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:19.310904 18278 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:19.335695 18325 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:19.341289 18296 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.275485 18388 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.334188 18356 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.364691 18379 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:19.319958 18041 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.287333 18078 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.372349 18078 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.375213 18437 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:19.305513 18333 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.297186 16273 rpcz_store.cc:276] 0709 13:07:18.158343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.158978 (+   635us) service_pool.cc:224] Handling call
0709 13:07:19.177134 (+1018156us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b54002d50d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:19.177254 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211487488}
I20260709 13:07:19.351509 18369 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.392066 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.393450 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.399788 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.394603 16270 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:19.397205 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:19.401678 15722 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.400511 15654 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:19.407560 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.408591 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:19.409994 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.413400 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.405561 15728 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:19.417692 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.329674 18447 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.418918 15649 raft_consensus.cc:2410] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:19.417937 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.311956 18425 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.345732 18431 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.347630 18408 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.419723 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.441267 18078 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.495337 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:19.495023 18078 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.496070 15651 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:19.497165 15651 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:19.497336 18078 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:19.499192 18449 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:19.503974 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.505717 18372 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:19.505954 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.506384 18372 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.507409 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:19.509518 18405 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.510063 18333 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.510339 18405 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.510851 18405 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.511152 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.511286 18405 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:19.512154 18444 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:19.512081 18388 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.512821 18388 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:19.513234 18388 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:19.515866 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.519480 18422 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.525534 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:19.493795 18450 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:07:19.531488 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.477618 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:19.419997 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:19.535779 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 231643us
I20260709 13:07:19.538117 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:19.471745 15572 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:07:19.498070 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 253564us
I20260709 13:07:19.517584 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.540278 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:19.438685 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:19.602429 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 62250.5us
I20260709 13:07:19.428491 15722 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:19.600593 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.604235 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.605013 15728 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:19.552536 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.611312 15579 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.417757 18288 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.619115 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.613135 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:19.613394 15576 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.390266 18075 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.622679 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.624178 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.618060 15651 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:19.480373 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 158523us
I20260709 13:07:19.607626 15728 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.633291 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:19.402997 18442 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.493475 17976 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.641721 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.643888 18440 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.643088 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:19.633571 18075 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.480720 18278 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:19.606467 17968 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:19.620527 18437 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:19.634934 18430 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.634667 18071 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.606398 18333 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:19.655551 15728 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:19.632223 18288 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.641731 18078 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.668037 18453 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.668774 18453 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:19.661058 18437 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.669358 18453 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:19.669596 18402 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.688s	user 0.011s	sys 0.004s
I20260709 13:07:19.671465 18437 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.674319 18461 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.674839 18461 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.675233 18461 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.676203 18258 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.677136 18457 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.678084 18457 consensus_queue.cc:1243] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:19.679534 18457 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.680282 18408 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.680215 18457 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.668231 18447 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.657970 17968 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.609385 18388 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.646216 18442 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.671466 18431 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.690172 18442 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.679550 18425 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.684546 18325 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.694921 18388 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.698912 18457 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.698562 18405 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.704480 18461 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.706207 18461 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.734340 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 480) took 3306 ms. Trace:
I20260709 13:07:19.643514 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:19.744350 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100807us
I20260709 13:07:19.746860 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:19.735553 15575 rpcz_store.cc:276] 0709 13:07:16.427725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.427919 (+   194us) service_pool.cc:224] Handling call
0709 13:07:16.428503 (+   584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.892059 (+1463556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.892099 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.892577 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.972651 (+ 80074us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.972693 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.972764 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.669035 (+1696271us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:19.733029 (+ 63994us) raft_consensus.cc:1685] finished
0709 13:07:19.733113 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.733859 (+   746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1535094,"raft.queue_time_us":1472879,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":6743,"spinlock_wait_cycles":27117312,"thread_start_us":79740,"threads_started":1,"wal-append.queue_time_us":88153}
I20260709 13:07:19.759446 15728 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.761637 15647 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:19.764609 15647 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:19.765322 15647 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:19.768471 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 137315us
I20260709 13:07:19.782485 15647 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.785633 18078 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:19.785811 16277 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.786921 18296 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.792023 18379 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:19.783998 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.798750 18447 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.800541 18457 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.800068 18325 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.798771 18460 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:07:19.802855 18405 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.803841 18425 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.800135 18403 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.814s	user 0.009s	sys 0.010s
W20260709 13:07:19.810506 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.811266 18369 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.815505 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1649) took 1222 ms. Trace:
I20260709 13:07:19.818234 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1650) took 1225 ms. Trace:
I20260709 13:07:19.818323 18437 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:19.820987 17968 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.865363 15574 rpcz_store.cc:276] 0709 13:07:18.592853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.794517 (+201664us) service_pool.cc:224] Handling call
0709 13:07:19.814948 (+1020431us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000c62d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:19.815202 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282576128}
I20260709 13:07:19.865846 15579 rpcz_store.cc:276] 0709 13:07:18.593051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.267766 (+674715us) service_pool.cc:224] Handling call
0709 13:07:19.268039 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.611839 (+343800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.817634 (+205795us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54003f9dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:19.818001 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789009664}
I20260709 13:07:19.856442 18078 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.870014 18379 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:19.880506 15722 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.883195 15647 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.883389 18425 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.885092 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 501) took 1972 ms. Trace:
W20260709 13:07:19.890936 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 107420us
I20260709 13:07:19.894867 18463 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.900703 16270 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:19.902565 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 301856us
I20260709 13:07:19.903056 16278 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:19.905229 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.905743 16272 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:19.906718 18325 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:19.907123 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:19.909616 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 499) took 2068 ms. Trace:
I20260709 13:07:19.910166 16271 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:19.909695 18369 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:19.910133 15650 rpcz_store.cc:276] 0709 13:07:17.840922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.841063 (+   141us) service_pool.cc:224] Handling call
0709 13:07:17.841370 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.848575 (+  7205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.848608 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.858004 (+  9396us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.986126 (+128122us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.986172 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.986250 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.005675 (+1019425us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b48000ce358. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:19.798533 (+792858us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:19.909228 (+110695us) raft_consensus.cc:1685] finished
0709 13:07:19.909249 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.909454 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6767,"raft.queue_time_us":17523,"raft.run_cpu_time_us":2107,"raft.run_wall_time_us":1144721,"spinlock_wait_cycles":71165568,"thread_start_us":64445,"threads_started":1,"wal-append.queue_time_us":92271}
I20260709 13:07:19.912442 18405 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.915418 15725 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.914927 18453 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.915735 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.916565 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.917609 15575 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:19.874975 18078 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.917771 18453 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.920909 18379 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.878923 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1566) took 1792 ms. Trace:
I20260709 13:07:19.919359 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:19.888907 15648 rpcz_store.cc:276] 0709 13:07:17.898493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.898618 (+   125us) service_pool.cc:224] Handling call
0709 13:07:17.898865 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.935374 (+ 36509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.935403 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.935444 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.935479 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.865013 (+1929534us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5400156654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:19.866383 (+  1370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.870790 (+  4407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83445120}
I20260709 13:07:19.879649 18457 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.933861 15579 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:19.925091 15573 rpcz_store.cc:276] 0709 13:07:18.042525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.580060 (+537535us) service_pool.cc:224] Handling call
0709 13:07:19.813850 (+1233790us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54003f98d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:19.834604 (+ 20754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533407616}
I20260709 13:07:19.936296 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:19.937121 16271 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.937665 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.941088 18447 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.946820 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:19.948127 16275 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:19.949290 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44377.5us
I20260709 13:07:19.942203 18460 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:19.967935 16277 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:19.971750 18453 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.972618 18453 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.974469 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:19.974828 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:19.976331 18460 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.977336 18457 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.979056 18460 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.941792 18447 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:19.981285 18447 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.978962 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.985666 18124 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.986002 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.986464 18124 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:19.986907 18405 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.987542 18405 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.990219 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:19.989969 18431 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:19.991508 18464 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.991953 18464 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:19.992138 18425 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:19.992385 18464 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.988219 18124 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:20.011102 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 118690us
I20260709 13:07:20.015838 18124 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.019920 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.020092 18356 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.020763 18356 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:20.017351 18283 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.027740 18283 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.035574 18078 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.043254 15648 raft_consensus.cc:1217] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Deduplicated request from leader. Original: 1.3->[2.4-2.4]   Dedup: 2.4->[]
I20260709 13:07:20.043834 15648 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:07:20.044155 18453 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.045040 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.053797 16271 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:20.058537 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.060433 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.061997 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.067409 18464 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:20.074544 18404 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.880s	user 0.019s	sys 0.021s
I20260709 13:07:20.075335 18464 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.024413 18356 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.076478 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 498) took 2235 ms. Trace:
I20260709 13:07:20.078765 18356 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.078465 15646 rpcz_store.cc:276] 0709 13:07:17.840605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.840756 (+   151us) service_pool.cc:224] Handling call
0709 13:07:17.859107 (+ 18351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.904950 (+ 45843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.904978 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.923840 (+ 18862us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.081402 (+157562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.081442 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.081511 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.073989 (+1992478us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b2400176108. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d927ac9c4 00007f2d927aaacb 00007f2d92965dc9 00007f2d92965a55 00007f2d9296509d 00007f2d9559710e 00007f2d955ae88c 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221
0709 13:07:20.075929 (+  1940us) raft_consensus.cc:1685] finished
0709 13:07:20.075955 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.076261 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16120,"raft.queue_time_us":45664,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":22495,"spinlock_wait_cycles":34775424,"thread_start_us":134782,"threads_started":1,"wal-append.queue_time_us":213623}
W20260709 13:07:20.080729 18471 consensus_queue.cc:1175] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "680390d3f0884c91bf1f22ba914b438a" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:20.077595 18071 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.067849 18078 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.082434 18341 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.085489 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1644) took 1494 ms. Trace:
I20260709 13:07:20.089452 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:20.090765 15727 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.086580 15576 rpcz_store.cc:276] 0709 13:07:18.587799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.058595 (+470796us) service_pool.cc:224] Handling call
0709 13:07:19.059072 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.621136 (+562064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.082213 (+461077us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400293e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:20.082509 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274423680}
I20260709 13:07:20.089437 18341 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.099375 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.092221 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.130827 15650 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
W20260709 13:07:20.134697 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 45375.4us
I20260709 13:07:20.136248 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.143308 18075 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:20.144896 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.148157 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44607.1us
I20260709 13:07:20.160576 18453 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.165647 18378 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.162933 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:20.616115 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.231146 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.332911 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.189881 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.320555 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 784) took 2478 ms. Trace:
I20260709 13:07:20.622725 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:20.353544 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.210973 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:20.641477 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.644203 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.170756 15648 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.253546 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:20.645519 15648 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:20.648618 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.260353 18104 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:07:20.366173 18461 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.004s
W20260709 13:07:20.254973 18360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.034s	user 0.031s	sys 0.050s
I20260709 13:07:20.163223 18407 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:20.641870 18356 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.004s
W20260709 13:07:20.256773 18474 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:07:20.342792 18390 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 2.346s	user 0.005s	sys 0.014s
I20260709 13:07:20.342639 18425 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.660079 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:20.656031 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:20.656446 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:20.263726 18453 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:20.260444 18341 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.353511 18259 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:20.670692 15579 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:20.669533 15576 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:20.264065 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:20.658264 18461 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.018s	sys 0.008s
W20260709 13:07:20.662752 18360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.450s	user 0.039s	sys 0.067s
I20260709 13:07:20.677513 15579 pending_rounds.cc:85] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 7
I20260709 13:07:20.686110 18356 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:20.686414 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:20.686797 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:20.690299 15573 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.696130 15576 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:20.698184 18296 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.699283 18296 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.691924 15579 pending_rounds.cc:107] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:20.703183 15579 raft_consensus.cc:2889] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.661495 18407 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:20.638806 16276 rpcz_store.cc:276] 0709 13:07:17.763808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.768619 (+  4811us) service_pool.cc:224] Handling call
0709 13:07:17.771110 (+  2491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.771433 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:17.822213 (+ 50780us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.939541 (+2117328us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b18002fef00. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:07:20.055377 (+115836us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.158691 (+103314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.160269 (+  1578us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.165195 (+  4926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.165942 (+   747us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.242293 (+ 76351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1201,"prepare.queue_time_us":1298655,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":107,"raft.queue_time_us":24300,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4614,"spinlock_wait_cycles":16181632,"thread_start_us":886113,"threads_started":3,"wal-append.queue_time_us":1050193,"wal-append.run_cpu_time_us":946,"wal-append.run_wall_time_us":1005795}
I20260709 13:07:20.366196 15472 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:20.746738 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 596513us
W20260709 13:07:20.727367 15618 connection.cc:256] RPC call timeout handler was delayed by -1.0699944300000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:07:20.749728 15648 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.745342 18296 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.756305 18422 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.752907 18124 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:20.757788 15618 connection.cc:256] RPC call timeout handler was delayed by -1.0258944299999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:07:20.686874 18425 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.746536 18471 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:20.753432 15574 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:20.759593 18259 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:20.760660 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 782) took 3000 ms. Trace:
I20260709 13:07:20.767421 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2186) took 1678 ms. Trace:
I20260709 13:07:20.768787 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:20.764771 18259 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.767856 15721 rpcz_store.cc:276] 0709 13:07:19.082718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.123343 (+ 40625us) service_pool.cc:224] Handling call
0709 13:07:19.123681 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.144311 (+ 20630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.692842 (+1548531us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b540012e654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:20.761232 (+ 68390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46116608}
I20260709 13:07:20.765465 18296 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.772969 15648 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.765442 18283 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.763700 16269 rpcz_store.cc:276] 0709 13:07:17.759723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.761305 (+  1582us) service_pool.cc:224] Handling call
0709 13:07:17.761694 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.761963 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.761981 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.762518 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.884496 (+121978us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:17.884523 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.884570 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.333363 (+2448793us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:20.760020 (+426657us) raft_consensus.cc:1685] finished
0709 13:07:20.760050 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.760417 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2344,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2733,"spinlock_wait_cycles":12922112,"thread_start_us":121684,"threads_started":1,"wal-append.queue_time_us":234131}
I20260709 13:07:20.754276 18356 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.764195 18341 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.767614 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2166) took 1372 ms. Trace:
I20260709 13:07:20.766853 18422 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.763799 18453 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.774281 18259 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.775344 18378 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.777514 18283 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.772837 18124 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.773893 18471 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.779268 15652 rpcz_store.cc:276] 0709 13:07:19.390818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.412633 (+ 21815us) service_pool.cc:224] Handling call
0709 13:07:20.263719 (+851086us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:20.761184 (+497465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9076480}
I20260709 13:07:20.799860 18425 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.785847 18296 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.806870 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:20.815958 18453 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.804905 18283 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.816615 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 505) took 1369 ms. Trace:
I20260709 13:07:20.816924 18324 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:20.786857 18422 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.817103 15655 rpcz_store.cc:276] 0709 13:07:19.446818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.739982 (+293164us) service_pool.cc:224] Handling call
0709 13:07:20.803572 (+1063590us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:20.803762 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.816098 (+ 12336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.816133 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.816188 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:20.816222 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.816292 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.816428 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4962048}
I20260709 13:07:20.792647 18341 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:20.826426 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 658762us
I20260709 13:07:20.826462 18486 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.828449 18356 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.828619 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1754) took 3605 ms. Trace:
W20260709 13:07:20.829363 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.817551 18124 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.835803 15573 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:20.845167 18486 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.845450 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:20.847262 18124 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:20.849521 18124 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.851830 18124 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.853876 15579 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:20.792804 18407 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.833091 15724 rpcz_store.cc:276] 0709 13:07:17.223083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.223195 (+   112us) service_pool.cc:224] Handling call
0709 13:07:17.223469 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.230149 (+  6680us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:17.470485 (+240336us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.179398 (+1708913us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800447760. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:19.359757 (+180359us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800447760. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287
0709 13:07:19.385136 (+ 25379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.385214 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.385291 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.828044 (+1442753us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b54003bf1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:20.828129 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.828372 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":277155,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":18412,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":32967,"spinlock_wait_cycles":33480576,"thread_start_us":234771,"threads_started":3,"wal-append.queue_time_us":45757,"wal-append.run_cpu_time_us":1643,"wal-append.run_wall_time_us":1004581}
I20260709 13:07:20.852783 18453 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:20.867540 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 60802.7us
I20260709 13:07:20.869928 15576 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:20.871865 18124 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.872336 16276 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.872583 18124 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:20.875934 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.879289 16275 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.879981 18296 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.880542 18296 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.881276 18296 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.874009 18471 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.882004 18341 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.882205 18356 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:20.884111 16269 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:20.886651 16276 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.887403 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:20.892817 15543 connection.cc:256] RPC call timeout handler was delayed by -1.3009774719999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:07:20.893507 15648 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:20.894125 18422 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.895849 18486 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.895424 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:20.897436 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:20.880586 18124 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.898808 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.939174 16275 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:07:20.899711 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.900041 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.901051 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:20.901865 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.902370 18433 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:20.886761 18481 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:07:20.903232 15646 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:20.903144 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:20.903855 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.947373 15650 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:20.904304 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.904757 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1576) took 2790 ms. Trace:
I20260709 13:07:20.904824 18385 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.905428 16272 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.905557 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:20.951404 15474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 364) took 21899 ms (client timeout 15000 ms). Trace:
I20260709 13:07:20.952008 16273 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:20.952510 15576 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.953007 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:20.953696 16273 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.955245 15472 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 4, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 4 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.956831 18385 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.958122 15729 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.960907 18385 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.906401 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1652) took 2312 ms. Trace:
I20260709 13:07:20.948004 15578 rpcz_store.cc:276] 0709 13:07:18.114563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.900362 (+785799us) service_pool.cc:224] Handling call
0709 13:07:18.900704 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.274782 (+374078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.904253 (+1629471us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400292554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:20.904557 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840676608}
I20260709 13:07:20.962173 15580 rpcz_store.cc:276] 0709 13:07:18.593494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.271287 (+677793us) service_pool.cc:224] Handling call
0709 13:07:19.823065 (+551778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.824142 (+  1077us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:19.824660 (+   518us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.867888 (+ 43228us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.879676 (+ 11788us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.879781 (+   105us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:19.879805 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.889902 (+ 10097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.975965 (+ 86063us) raft_consensus.cc:1685] finished
0709 13:07:19.975983 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.906140 (+930157us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54003f98d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:20.906255 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":254,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2434,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":1316,"spinlock_wait_cycles":1267657984,"thread_start_us":42605,"threads_started":1,"wal-append.queue_time_us":123761}
W20260709 13:07:20.964237 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 89384.5us
I20260709 13:07:20.910229 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.910974 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.966066 17968 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:20.967337 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.967689 18104 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:20.914624 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:20.911821 18296 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:20.915988 15721 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:20.969079 15720 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.916982 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:20.970378 15724 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.957078 15472 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:20.920663 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.974861 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:20.975173 18486 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.975752 18486 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.976438 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:20.977131 15721 raft_consensus.cc:2393] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:20.921813 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:20.977855 18486 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.978328 15727 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.978430 18486 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.979146 18486 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.981225 15649 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:20.981696 18486 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.982298 18486 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.982887 18486 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.983772 15724 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:20.922216 18233 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.923741 15726 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.924728 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:20.985852 18233 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:20.986299 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:20.986923 18233 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.987630 15728 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:20.988027 18233 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.925017 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:20.925868 18341 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:20.989688 15726 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.913106 18407 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.990191 18341 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:20.985347 18486 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.992357 18341 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:20.926370 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:20.926887 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:20.993409 15722 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.926559 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.929813 16269 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:20.930681 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:20.994932 16274 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.928324 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.934074 16277 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEARNER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:20.931591 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:20.933266 18283 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.942665 18356 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.943567 18442 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.998776 18442 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.001046 18442 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.001626 18442 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.905431 18324 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:20.944308 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:20.945307 18483 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.945720 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:20.949851 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:20.950464 15655 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.951874 18433 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.968756 16272 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.919327 18372 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.985395 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:20.990058 15725 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:20.993450 16278 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.927129 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:20.997529 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 66094.5us
W20260709 13:07:20.942875 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47563.9us
I20260709 13:07:20.985864 16273 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:07:21.002892 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58895.4us
I20260709 13:07:21.004335 16271 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:21.002810 15472 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 2 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:21.014943 15727 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:21.040704 15720 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:21.044870 15726 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.047917 15729 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:07:21.048144 15725 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.049026 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:21.048113 16274 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:21.049695 15472 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 6, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
W20260709 13:07:21.050890 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 123846us
I20260709 13:07:21.051474 18372 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.048386 15729 pending_rounds.cc:85] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
I20260709 13:07:21.085640 15729 pending_rounds.cc:107] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:21.085955 15729 raft_consensus.cc:2889] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.997619 18283 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:20.998502 18296 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.001992 18442 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:21.079105 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.107681 16277 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:21.002393 18324 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.110705 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.111126 18433 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.111371 15724 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:21.112317 18324 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.016487 18259 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.112804 18442 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.090883 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.003183 18483 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.094846 15472 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:21.096027 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.120198 15725 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:21.096580 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.097743 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.098218 18487 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:21.098558 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.099423 15721 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.123682 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:21.100616 18372 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.102370 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.103216 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.090883 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.103374 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.104543 18233 consensus_queue.cc:1059] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:21.107609 15722 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:21.109333 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 542) took 3261 ms. Trace:
I20260709 13:07:21.140197 15726 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:21.109896 15720 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:21.112250 18433 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.140430 15729 rpcz_store.cc:276] 0709 13:07:17.848307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.899534 (+ 51227us) service_pool.cc:224] Handling call
0709 13:07:17.899872 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.090469 (+3190597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.109037 (+ 18568us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b54001fca54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:21.109271 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7032704896}
I20260709 13:07:21.114565 15648 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:21.084637 18434 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:07:21.114825 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.087281 16278 raft_consensus.cc:2410] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:20.951859 15474 rpcz_store.cc:269] 0709 13:06:59.052185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.052535 (+   350us) service_pool.cc:224] Handling call
0709 13:07:00.010812 (+958277us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:20.951138 (+20940326us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:11.552738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:11.780264 (+227526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:11.780315 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:07:11.780356 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:11.781335 (+   979us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:11.781409 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:11.781437 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:11.816594 (+ 35157us) tablet.cc:701] Row locks acquired
0709 13:07:11.832317 (+ 15723us) write_op.cc:260] PREPARE: finished
0709 13:07:11.856830 (+ 24513us) write_op.cc:270] Start()
0709 13:07:11.877148 (+ 20318us) write_op.cc:276] Timestamp: P: 1783602431845168 usec, L: 0
0709 13:07:11.878057 (+   909us) op_driver.cc:348] REPLICATION: starting
0709 13:07:11.937758 (+ 59701us) log.cc:844] Serialized 2834 byte log entry
0709 13:07:12.682879 (+745121us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d929090ac 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b
0709 13:07:13.754392 (+1071513us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800341020. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:13.754791 (+   399us) op_driver.cc:464] REPLICATION: finished
0709 13:07:14.253268 (+498477us) write_op.cc:301] APPLY: starting
0709 13:07:14.290681 (+ 37413us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:14.388017 (+ 97336us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:14.404806 (+ 16789us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:14.542166 (+137360us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:14.697689 (+155523us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:14.708136 (+ 10447us) write_op.cc:312] APPLY: finished
0709 13:07:14.829653 (+121517us) log.cc:844] Serialized 53 byte log entry
0709 13:07:15.166633 (+336980us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:15.180704 (+ 14071us) write_op.cc:454] Released schema lock
0709 13:07:15.199500 (+ 18796us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:15.267515 (+ 68015us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:15.277215 (+  9700us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":227831,"reported_tablets":20,"spinlock_wait_cycles":150175616,"child_traces":[["op",{"apply.queue_time_us":339652,"apply.run_cpu_time_us":33409,"apply.run_wall_time_us":1037045,"num_ops":6,"prepare.queue_time_us":898889,"prepare.run_cpu_time_us":38770,"prepare.run_wall_time_us":1361284,"raft.queue_time_us":64236,"raft.run_cpu_time_us":21752,"raft.run_wall_time_us":199376,"replication_time_us":1876552,"spinlock_wait_cycles":93604992,"thread_start_us":1939163,"threads_started":5,"wal-append.queue_time_us":1357154,"wal-append.run_cpu_time_us":11584,"wal-append.run_wall_time_us":2760136}]]}
I20260709 13:07:21.123648 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.100239 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:21.137566 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48138us
I20260709 13:07:21.113873 18296 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:21.147737 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.143821 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:21.088521 18124 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:21.153729 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:21.158838 15472 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.160899 16271 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:21.161237 15576 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:21.164168 15571 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:21.176461 16273 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.177759 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.167196 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.167726 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:21.183017 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.166359 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.184041 15655 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:21.155268 18296 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.158463 18259 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.187681 16278 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
I20260709 13:07:21.161842 18453 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.172719 18283 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.187182 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:21.186501 18477 raft_consensus.cc:2764] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:07:21.214269 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.194362 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 228723us
I20260709 13:07:21.161243 18471 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:07:21.233865 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 129239us
I20260709 13:07:21.189064 18487 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.187599 18488 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.195849 18453 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.221050 15472 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 3, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:21.250231 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.250325 18488 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.254261 18488 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.250347 18487 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.255666 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.258044 18487 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:21.268488 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 111821us
W20260709 13:07:21.274391 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91378.1us
I20260709 13:07:21.275334 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.276474 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.276569 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.278343 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:21.278971 17976 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.279139 15646 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:21.281155 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 59565.3us
I20260709 13:07:21.294548 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.295611 15649 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:21.297379 18494 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.300064 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.301350 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.240618 18283 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.302565 18491 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.302663 15653 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:21.303872 18442 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.303967 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.306053 15646 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:21.283908 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.310735 16270 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:21.308646 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.313311 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.313921 15646 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:21.314301 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.196995 18324 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:21.259732 18453 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.323424 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.322876 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:21.329645 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58468.8us
I20260709 13:07:21.341813 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.224560 18451 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:07:21.336719 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:21.343482 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:21.347355 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:21.354159 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 118600us
I20260709 13:07:21.333069 18356 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.317677 18233 consensus_queue.cc:1243] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:21.312791 18422 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:21.340668 18494 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.362062 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:21.366619 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.345598 18283 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.370522 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:21.373006 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.376091 15721 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:21.377367 15655 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:21.359180 18372 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.381170 15571 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.382258 18506 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.382660 15578 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.380553 15576 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:21.385731 15720 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:07:21.387965 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:21.388893 15573 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.383078 15578 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.367892 18433 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.345806 18104 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:07:21.395865 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 158648us
I20260709 13:07:21.394981 15577 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:21.399869 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:21.400120 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.411727 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:21.368201 18356 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:21.417578 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 95175.5us
I20260709 13:07:21.421136 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.415935 18433 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.429183 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.430040 15721 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:21.405539 18422 consensus_queue.cc:1243] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:21.399644 18124 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.399821 18233 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.438110 15720 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
W20260709 13:07:21.439414 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 103908us
I20260709 13:07:21.416230 18489 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.446300 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.430730 18385 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.454723 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:21.450505 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 113881us
I20260709 13:07:21.455587 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 2.
I20260709 13:07:21.409581 18259 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:21.440760 15578 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:21.443876 18493 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:21.468281 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:21.472913 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.411476 18372 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.482479 15575 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:21.490705 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 46455.7us
I20260709 13:07:21.408517 18506 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:21.501992 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.408555 18283 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.513146 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.517335 15578 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.480739 18385 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:21.449800 18124 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:21.519414 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 79264us
W20260709 13:07:21.521133 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 417796us
I20260709 13:07:21.448892 18498 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 13:07:21.520761 15580 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:21.525520 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.456126 17968 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:21.533233 15573 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:21.537652 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45947.1us
I20260709 13:07:21.526561 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.514819 18451 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.519279 18471 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.542793 18519 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.543429 18505 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:21.515554 18516 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.552443 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:21.557797 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.480888 18489 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.483368 18499 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:07:21.537875 18492 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:07:21.559284 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:21.561043 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55499.1us
I20260709 13:07:21.562834 15580 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:21.564574 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.565685 15573 raft_consensus.cc:2410] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:21.554517 18471 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.561272 18500 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.570348 18341 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.587343 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:21.601576 15721 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.578640 18471 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.526382 18433 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:21.604650 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57888.7us
W20260709 13:07:21.606334 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54352.2us
I20260709 13:07:21.606921 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.602061 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.608024 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.558985 18451 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.562153 18519 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.519843 18494 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.613866 15579 raft_consensus.cc:2410] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:21.618328 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.619083 15726 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:21.590768 18341 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.587208 18500 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:21.583267 18521 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:21.604044 18356 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:21.637681 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 93420.4us
I20260709 13:07:21.644735 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:21.648729 18451 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.616496 18233 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:21.654439 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47343.9us
I20260709 13:07:21.568074 18516 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.651569 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:21.652295 15573 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:21.659205 15571 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:21.591857 18523 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:21.637698 18500 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.600389 18385 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.666903 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.667709 16270 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:21.650909 18425 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.670867 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.671244 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:21.671577 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.674064 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.672488 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.672114 15574 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.672530 16269 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:21.673138 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:21.673317 18526 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:21.673388 18527 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.673929 18529 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.673990 18528 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:21.674371 18511 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:07:21.673743 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.703006 16275 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:21.658123 18233 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.680615 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.683802 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.712767 15573 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:21.681089 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.685385 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:21.684317 16274 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:21.713984 16273 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:21.714238 16270 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:21.680599 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:21.666908 18513 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:07:21.714890 18523 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.711668 18233 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.715591 18515 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.659746 18521 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.716135 18483 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:21.717280 18434 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:21.717777 18434 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.717868 18512 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.718664 18507 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:21.718762 18434 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.720453 18434 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.694619 18506 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.723222 18374 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.724223 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43674.5us
I20260709 13:07:21.723959 18374 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.703785 18528 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.725484 18528 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.682909 15574 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.707080 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.690661 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:21.683961 18489 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.673758 18519 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.715370 18523 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.744024 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.716903 18521 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:21.719458 18508 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:07:21.684177 18372 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:21.695051 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:21.705628 18341 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.692875 18529 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.729285 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:21.754877 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 74399.3us
I20260709 13:07:21.755515 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:21.681399 18503 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.708266 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.690332 18527 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:21.736030 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64137.8us
I20260709 13:07:21.740742 15721 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:21.741567 15720 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.743961 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.736634 17976 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.760247 17976 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.762566 17976 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:21.763473 18519 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.744242 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.764520 15722 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:21.744935 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.765666 15726 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:21.752442 15574 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.767222 18527 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.768657 18527 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.757891 18506 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.770222 18477 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:21.746598 18501 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:21.772521 18501 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.772557 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:21.772811 18471 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.773614 18501 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.774199 18498 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:21.766419 15728 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:21.774689 18532 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:21.775306 18533 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:21.775786 18499 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.776180 18499 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.776453 18533 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:21.777122 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.723359 18516 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:21.691867 18425 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.774452 18519 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.784960 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.750654 18523 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.788087 15647 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:21.790679 15726 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:21.793079 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.794499 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.776849 18533 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.813838 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.814241 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.785074 18519 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.818625 15726 raft_consensus.cc:2393] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 2: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:21.818823 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.820511 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.827165 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:21.828830 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 162664us
I20260709 13:07:21.831166 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:21.831561 18503 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:21.832041 18503 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:21.832398 18503 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.832600 15723 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:21.833480 18502 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.384s	user 0.000s	sys 0.004s
W20260709 13:07:21.837332 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.838696 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67647.4us
I20260709 13:07:21.816380 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:21.786324 18483 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:21.843695 15543 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.837281 18434 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.823736 18519 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.851321 18407 raft_consensus.cc:3055] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:21.851603 18471 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.851781 18407 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:21.848403 18356 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.853431 18124 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:21.854117 18356 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.855738 18356 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:21.842211 18535 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:07:21.856707 18453 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.009s
I20260709 13:07:21.848778 15576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:21.857251 18453 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.843482 18442 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.857772 15576 raft_consensus.cc:606] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.866765 15576 raft_consensus.cc:614] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.867810 15543 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.849823 18283 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:21.844142 18514 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.885542 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:21.886224 18539 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:07:21.887756 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:21.888500 15579 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.874343 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:21.847640 18434 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.862114 18529 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.841207 18537 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.879576 18542 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.879657 18501 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.880054 18124 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:21.880460 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71639.4us
I20260709 13:07:21.881652 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1771) took 2829 ms. Trace:
I20260709 13:07:21.916742 15578 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:21.883391 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:21.884294 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:21.876355 17968 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:21.803853 18499 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.939687 15571 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:07:21.896008 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 49759us
I20260709 13:07:21.932672 15723 rpcz_store.cc:276] 0709 13:07:19.052004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.052243 (+   239us) service_pool.cc:224] Handling call
0709 13:07:19.079865 (+ 27622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.833083 (+2753218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.881390 (+ 48307us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b5400398354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:21.881592 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6088584320}
W20260709 13:07:21.935822 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51616.3us
I20260709 13:07:21.853454 18525 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.935859 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:21.972133 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 97874.1us
I20260709 13:07:21.972982 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:21.974151 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:21.973500 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:21.952656 18488 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:21.985118 15728 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:21.936256 18483 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.936170 18124 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:21.936549 18434 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.971457 18535 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:21.885811 18514 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.971781 18501 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:21.983791 18296 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.009s
W20260709 13:07:22.074975 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 207244us
W20260709 13:07:22.051240 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 149067us
I20260709 13:07:21.984694 18529 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.981029 18104 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.077260 15543 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:21.975617 18525 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:21.987424 17976 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.982098 18515 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:22.082891 15723 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.869721 18533 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:21.990641 18124 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.987818 18506 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.048141 18535 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.050554 18283 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.935506 18542 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.081655 18499 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.082432 18104 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.936169 18537 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.121876 15579 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:22.086439 17976 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.113678 18549 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.117314 18374 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.083730 18296 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.142612 18514 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.143796 18296 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.145514 15576 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:22.111187 18425 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.086704 18471 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:07:22.153025 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.119573 18283 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.155658 18528 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.161091 18283 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.163230 18537 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.163863 18425 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.164274 18425 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.164613 18425 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:22.166692 18544 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:22.166513 18515 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:22.168108 18522 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:07:22.169387 18283 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.170951 18528 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.171499 18283 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.174296 18525 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.175577 18525 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.176309 18434 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:21.991879 18483 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.113958 18535 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:22.156987 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 79839.6us
I20260709 13:07:22.145146 17976 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.118559 18453 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.124846 18433 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.127530 18104 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.126719 18500 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.153775 18372 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.114914 17968 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:07:22.177382 18501 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.115386 18506 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.183145 18471 consensus_queue.cc:1243] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:22.228497 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.230657 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.230785 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.231410 16274 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:22.232064 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.231431 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.233022 15571 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:22.178341 18233 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.232764 15578 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:22.235800 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.237633 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.145844 18442 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:07:22.204645 18533 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.240953 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.241046 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.242892 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:22.243620 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.248239 16273 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:22.244659 16278 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:22.245297 15573 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:22.251426 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 276043us
I20260709 13:07:22.251426 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.254441 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.255462 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.257897 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.251663 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.252449 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.260331 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:22.252923 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 278879us
W20260709 13:07:22.261333 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 119572us
I20260709 13:07:22.264490 18434 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.265143 18434 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.265697 18434 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.267370 18451 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.268066 18434 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.224809 18433 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.269374 18523 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.189224 18385 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:22.273589 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.279187 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.287971 15655 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:22.288398 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.289547 15648 raft_consensus.cc:2410] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:22.280419 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.290941 15543 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.291973 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:22.292613 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63072.2us
I20260709 13:07:22.292913 16271 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.295718 18434 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.296125 18434 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.296501 18434 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.297045 18341 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.297461 18545 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.298019 18545 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.298946 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.301537 15571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377274f9c9482a924840f15b616a13"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:22.306600 15651 raft_consensus.cc:2368] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
W20260709 13:07:22.307912 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 102816us
I20260709 13:07:22.308748 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.309405 15578 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:22.331955 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.332047 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:22.334280 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.335000 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.254045 18372 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.271737 18425 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.346979 18554 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:22.350864 18483 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.351387 18555 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.427578 18545 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.427958 18523 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.430078 18547 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.430261 18516 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.430728 18516 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:22.430697 18547 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.431016 17976 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.431802 18516 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.432823 18516 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:22.433063 18527 consensus_meta.cc:287] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.664s	user 0.004s	sys 0.003s
I20260709 13:07:22.433189 17976 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.433923 15653 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:22.435434 18233 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.436641 18506 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.433845 17976 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.433929 18556 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:22.314286 18296 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 13:07:22.450277 18541 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:07:22.415889 18453 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:22.509131 18453 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.510360 18558 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.510696 18500 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.511029 18558 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.414688 18555 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.512054 18555 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:22.510237 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 249002us
I20260709 13:07:22.513877 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.456926 16269 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:22.509678 18453 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.517227 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:22.517560 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.521919 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.522869 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:22.450374 18498 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.526147 18509 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:22.527726 18489 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.528641 18558 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.529948 18407 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.536147 15728 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:22.433095 18547 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.540690 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.541989 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.550523 15577 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:22.451161 18372 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.513648 18385 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.549064 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.554450 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.555133 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:22.559386 15576 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.561367 18515 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:22.520414 18556 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:22.541569 18519 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 13:07:22.564558 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:22.535584 18498 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:22.565356 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.557034 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:22.570990 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.537029 18509 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:22.538654 18489 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:22.636708 15722 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:22.574148 18356 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.574265 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:22.519624 17976 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.563452 18558 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.634146 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:22.656545 15728 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.624284 18519 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.579744 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:22.636484 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63010.7us
I20260709 13:07:22.637046 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.580166 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:22.547461 18483 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:22.638345 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.642621 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 331959us
I20260709 13:07:22.630765 15727 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.651854 15723 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.652293 15580 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:22.653486 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:22.624114 18503 consensus_meta.cc:287] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.791s	user 0.013s	sys 0.000s
I20260709 13:07:22.679214 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.562054 18471 consensus_queue.cc:1059] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:07:22.562590 18425 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.668673 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:22.684170 15721 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.670387 17976 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:22.671185 15720 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:22.571267 18372 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:22.565307 18500 consensus_queue.cc:1175] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:22.677062 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 130601us
I20260709 13:07:22.564073 18385 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:22.653705 18356 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.686096 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.567329 18547 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 13:07:22.688329 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 123091us
I20260709 13:07:22.649068 18542 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.691264 15726 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:22.677891 18407 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.679930 18374 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.672684 18506 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:22.709033 15576 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:22.712401 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.694928 17976 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.674719 18558 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.698575 18356 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:22.712411 18124 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:07:22.679478 18503 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:22.740955 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.741312 15721 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:22.738926 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45827.4us
I20260709 13:07:22.727072 18556 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.699052 18577 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.709357 18374 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.743604 18565 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:22.745762 18535 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.003s
I20260709 13:07:22.747988 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.712684 18442 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:22.764896 15572 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:22.690840 18489 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.755517 18543 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:22.755846 15526 auto_rebalancer.cc:893] Removing replace marker failed: Replica 8995ef9978c446769377fc0e9a0cb9c1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:22.775940 15723 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:22.756414 18434 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.749331 18124 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.802430 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:22.751331 18577 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.759454 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.727564 18567 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.229s
I20260709 13:07:22.808899 18577 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.735755 17976 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:22.810113 17976 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.810932 18124 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.813074 18434 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.814085 15573 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:22.737336 18546 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.748252 15721 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:22.814635 18546 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.815186 18546 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.766577 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:22.816402 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 49933.1us
I20260709 13:07:22.817718 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:22.819190 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:22.778738 18534 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:07:22.819676 18510 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.820600 18442 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.821043 18442 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.821391 18442 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.822304 18495 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.823768 18495 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.824156 18495 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:22.824517 18495 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.742419 18509 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.783378 18514 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:22.825857 18534 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.826248 18514 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.826346 18534 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:22.826776 18514 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.783708 18503 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:22.827365 18534 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.828951 18534 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:22.829244 18104 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:07:22.829407 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.698241 18498 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.829722 18104 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:22.830124 15654 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:22.830681 18498 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.831278 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.831877 18104 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.832522 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:22.833105 18499 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.003s
W20260709 13:07:22.832558 18527 consensus_queue.cc:1175] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8995ef9978c446769377fc0e9a0cb9c1" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:22.765353 18565 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:22.785938 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:22.836090 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50281.9us
I20260709 13:07:22.835902 18565 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.798377 18573 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:22.804337 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 85333.8us
W20260709 13:07:22.804977 15526 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:22.805058 18519 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.807125 15652 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:22.765059 18535 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.807688 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.807888 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.846365 15646 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:22.808359 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.808560 18489 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.814428 15571 raft_consensus.cc:606] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.752575 15726 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:22.751025 18558 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:22.838472 18341 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:22.840103 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84707.8us
I20260709 13:07:22.851847 15576 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:22.851995 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.852902 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.804834 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:22.854143 15649 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:22.854252 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:22.841493 15728 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:22.842840 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.854914 15723 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:22.844472 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:22.802553 18533 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
W20260709 13:07:22.843422 15526 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:22.849432 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.856495 15577 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:22.847568 15571 raft_consensus.cc:614] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:22.857084 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 144779us
I20260709 13:07:22.858084 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.826262 18509 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.862386 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.859683 15578 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:22.861289 16270 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:22.858084 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:22.865338 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.844209 18547 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.869863 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.801259 18543 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:22.890344 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.894928 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.891167 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.764597 18385 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.901750 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:22.904214 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.905288 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:22.908380 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:22.878841 18558 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.881904 18570 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.909121 16273 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:22.909911 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:22.915606 16276 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.910327 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:22.911978 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.888969 18434 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.913300 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.906098 18533 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.919206 16277 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:22.919240 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.891898 18564 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:22.901700 18529 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.003s
I20260709 13:07:22.928309 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.928402 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:22.929208 16272 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:22.928361 15647 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:22.851305 18577 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.931613 16271 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:22.932411 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:22.932610 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.919667 18471 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.919163 18483 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.931814 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.901180 18547 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:22.941370 15576 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:22.920521 18385 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.914726 18570 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.922307 18573 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.976197 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:22.977277 16273 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:07:22.984958 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 52409us
I20260709 13:07:22.985857 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:22.984032 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.985839 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.946309 18516 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:22.979408 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 60254.3us
I20260709 13:07:22.957134 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:22.994297 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:22.996243 15723 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:22.978279 16277 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:22.946375 18503 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.951980 18537 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.951738 18564 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:23.000851 18477 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:22.986764 18570 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.021652 15654 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:23.004272 18586 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.005082 18553 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:23.026640 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.009076 18582 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.978451 17968 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:23.001852 18483 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.009676 18577 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.014201 18547 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.015599 18535 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:22.928738 18533 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:22.954182 18510 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:23.020445 16276 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:23.057410 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63197.1us
I20260709 13:07:23.058928 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:23.000970 18584 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 13:07:22.992777 18525 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.004s
I20260709 13:07:23.004721 18585 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:23.022747 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.023931 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:22.991416 18501 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:22.997864 18559 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:23.020546 18453 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 13:07:22.997802 18372 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:22.988586 18587 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.001503 18471 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:23.002532 18537 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:23.019780 18477 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:22.948884 18543 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.063009 18564 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.070559 18547 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.071324 18533 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.071709 18510 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.072763 18585 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:23.073216 18569 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.074429 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:23.075385 16276 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.076248 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.075412 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:23.079635 18574 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:07:23.082176 18582 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:23.084233 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.081537 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:23.085708 18501 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:23.116353 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:23.091199 18519 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.081761 18453 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.093650 18570 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.097622 18477 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:23.083601 17968 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:23.117631 15651 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:23.091759 18535 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:23.125797 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:23.129025 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:23.115463 18533 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.141599 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:23.086376 18573 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:23.151993 15655 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:23.123342 18372 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.154799 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:23.159327 16278 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
W20260709 13:07:23.161975 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.162880 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.172313 15651 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
W20260709 13:07:23.189651 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.142894 18574 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.124167 18525 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:07:23.164064 18372 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.141713 18533 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:23.193231 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:23.199146 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 106170us
I20260709 13:07:23.124895 18519 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.195251 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.135680 18535 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.203226 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.176638 18104 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.207237 15576 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:23.134729 18442 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.196429 18574 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.136395 18537 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.175905 18471 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.127041 18585 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.352138 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:23.331451 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:23.324783 15574 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.554395 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.208662 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:23.562114 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:23.252817 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.563740 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.563918 15580 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:23.524688 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.340896 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 529) took 1115 ms. Trace:
W20260709 13:07:23.212025 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 95739.2us
I20260709 13:07:23.256142 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2188) took 1029 ms. Trace:
I20260709 13:07:23.292043 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:23.511842 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:23.473455 15573 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.529836 15575 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.255692 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.514392 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:23.339383 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 988) took 1114 ms. Trace:
W20260709 13:07:23.208091 18555 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.002s
I20260709 13:07:23.262108 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:23.259895 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:23.564124 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.565574 15653 rpcz_store.cc:276] 0709 13:07:22.226367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.229012 (+  2645us) service_pool.cc:224] Handling call
0709 13:07:23.255964 (+1026952us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540024b3d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:23.256080 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415546240}
I20260709 13:07:23.566905 15576 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:23.568250 15655 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:23.206674 18517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.006s	sys 0.025s
W20260709 13:07:23.332680 18594 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:07:23.531582 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:23.568634 15647 rpcz_store.cc:276] 0709 13:07:22.225636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.226059 (+   423us) service_pool.cc:224] Handling call
0709 13:07:23.340738 (+1114679us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54002698d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:23.340836 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546156288}
I20260709 13:07:23.566686 15577 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.570611 15654 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:23.572942 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:23.563122 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 354522us
I20260709 13:07:23.206394 18372 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.638265 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.638840 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.344437 18534 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:07:23.208930 18533 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:23.670431 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.508421 18434 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.687825 15646 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:23.264249 18499 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.333498 18598 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:07:23.340433 18489 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.322016 18546 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.001s
I20260709 13:07:23.568024 16270 rpcz_store.cc:276] 0709 13:07:22.224882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.230467 (+  5585us) service_pool.cc:224] Handling call
0709 13:07:23.339147 (+1108680us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54006392d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:23.339296 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385839872}
W20260709 13:07:23.516882 18495 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
W20260709 13:07:23.516074 18590 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.527s	user 0.001s	sys 0.000s
I20260709 13:07:23.352296 18453 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:23.338866 18601 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:07:23.473065 18104 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:23.642421 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:23.258814 18593 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:07:23.261898 18356 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.002s
I20260709 13:07:23.514178 18509 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.519711 18498 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
W20260709 13:07:23.531806 18514 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.705s	user 0.006s	sys 0.004s
I20260709 13:07:23.340219 18507 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.767647 18433 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.767452 18507 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.769490 18507 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.762130 18356 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.772552 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2231) took 1024 ms. Trace:
I20260709 13:07:23.772925 15721 rpcz_store.cc:276] 0709 13:07:22.748168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.815297 (+ 67129us) service_pool.cc:224] Handling call
0709 13:07:22.854364 (+ 39067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.858854 (+  4490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.858892 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.867796 (+  8904us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.021512 (+153716us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:23.023102 (+  1590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.023150 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.772329 (+749179us) raft_consensus.cc:1685] finished
0709 13:07:23.772350 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.772492 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12391,"raft.queue_time_us":6851,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10576,"thread_start_us":112853,"threads_started":1,"wal-append.queue_time_us":185478}
I20260709 13:07:23.774866 15648 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:23.402897 18566 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:23.335585 18425 raft_consensus.cc:3055] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:23.328395 18595 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:07:23.303577 18516 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:23.635581 18517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.006s	sys 0.025s
W20260709 13:07:23.711015 18477 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
W20260709 13:07:23.339462 18589 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:07:23.573062 18535 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:23.570694 18577 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.722326 15573 raft_consensus.cc:2410] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.291370 18584 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.400s
I20260709 13:07:23.569434 18574 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.571606 18451 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:23.340121 18510 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:23.732229 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:23.259300 17976 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.737013 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:23.739436 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:23.800379 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1813) took 1183 ms. Trace:
I20260709 13:07:23.687054 18324 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:23.252454 18582 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:23.756808 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 114497us
I20260709 13:07:23.645309 18555 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.753150 18104 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.765321 18603 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.766067 18500 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.765754 18509 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.766682 18514 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.776664 16276 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:23.799183 18577 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.782984 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 530) took 1242 ms. Trace:
I20260709 13:07:23.805809 18535 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:23.254703 18501 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.775753 18566 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:23.798455 16277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.024s	sys 0.059s
I20260709 13:07:23.747469 18495 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.800520 15580 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:23.740721 18499 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.803326 16273 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:23.800773 15572 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:23.800873 15727 rpcz_store.cc:276] 0709 13:07:22.616879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.690813 (+ 73934us) service_pool.cc:224] Handling call
0709 13:07:22.691377 (+   564us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:22.878463 (+187086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.878508 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:22.901186 (+ 22678us) log.cc:844] Serialized 590 byte log entry
0709 13:07:23.017638 (+116452us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:23.017684 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.017769 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.800155 (+782386us) raft_consensus.cc:1685] finished
0709 13:07:23.800178 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.800326 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4519,"raft.queue_time_us":36886,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5911,"thread_start_us":246787,"threads_started":2,"wal-append.queue_time_us":177170}
I20260709 13:07:23.741593 18546 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.779989 18425 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:23.809114 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:23.809975 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:23.745599 18434 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.776643 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:23.815346 15579 rpcz_store.cc:276] 0709 13:07:22.540904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.541014 (+   110us) service_pool.cc:224] Handling call
0709 13:07:22.562642 (+ 21628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.076540 (+513898us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:23.097080 (+ 20540us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.200109 (+103029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:23.200174 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.200234 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.782689 (+582455us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400293954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:23.782754 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.782917 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23109,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2044,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4494,"spinlock_wait_cycles":1181265664,"thread_start_us":102653,"threads_started":1,"wal-append.queue_time_us":429091}
I20260709 13:07:23.772024 18356 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.816612 16269 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:23.807369 18451 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:23.738678 18489 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:23.819818 16277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.024s	sys 0.059s
I20260709 13:07:23.819939 15574 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:23.836668 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1613) took 2185 ms. Trace:
I20260709 13:07:23.817239 18577 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.838979 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:23.839486 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:23.839601 16273 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:23.818676 18535 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:23.835455 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.559s (SENT) [suppressed 7 similar messages]
I20260709 13:07:23.837834 15580 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.843326 15580 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.844219 18546 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.836912 18516 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.845301 18585 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.846117 18499 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.829540 16271 raft_consensus.cc:2368] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6.
I20260709 13:07:23.817706 18531 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.838307 15574 rpcz_store.cc:276] 0709 13:07:21.651430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.657714 (+  6284us) service_pool.cc:224] Handling call
0709 13:07:21.669338 (+ 11624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.324250 (+1654912us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5800740cd0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9596f0aa 00007f2d959f1447 00007f2d95a09fe7 00007f2d95a0b7de 00007f2d95a15b49 00007f2d95a16416 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4
0709 13:07:23.836325 (+512075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.836593 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121902336}
I20260709 13:07:23.831333 18442 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:23.839123 18487 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:07:23.837484 18603 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.816044 18500 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.854120 15648 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:23.789705 18477 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.845523 18451 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.858991 18585 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:07:23.865701 15648 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:23.866276 18495 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:23.866917 17976 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.867949 18509 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:23.869234 18514 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.910802 18535 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:23.850855 18531 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:23.858937 18554 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.922585 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:23.924968 15651 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:23.938654 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:23.943845 16277 raft_consensus.cc:2410] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:23.959777 15580 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:23.931577 17976 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:23.966359 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.973268 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:23.977501 15577 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
W20260709 13:07:23.977641 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 142209us
I20260709 13:07:23.978380 15579 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:23.979496 18434 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:23.979707 18568 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.306s	user 0.003s	sys 0.000s
I20260709 13:07:23.972047 18442 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.980659 18442 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.982262 18104 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:23.982712 18442 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:23.983330 15653 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:23.983659 18489 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:23.983835 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74011.8us
I20260709 13:07:23.994359 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:23.984251 18555 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.940301 18613 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.971832 18535 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.883615 18425 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.004298 15578 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:24.006301 18613 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.007380 18104 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.008647 18613 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:23.955600 18566 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.010808 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 804) took 1096 ms. Trace:
I20260709 13:07:24.013051 16278 rpcz_store.cc:276] 0709 13:07:22.914125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.914828 (+   703us) service_pool.cc:224] Handling call
0709 13:07:22.915093 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.159962 (+244869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.010556 (+850594us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54007017d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:24.010723 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522230144}
I20260709 13:07:24.014869 18477 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.015110 16278 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.015944 18425 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.021311 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.021621 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.022876 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:23.926577 18554 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.031320 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.032207 15725 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:24.035543 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43846 (request call id 23) took 1734 ms. Trace:
I20260709 13:07:24.036068 15571 rpcz_store.cc:276] 0709 13:07:22.301266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.301395 (+   129us) service_pool.cc:224] Handling call
0709 13:07:24.035273 (+1733878us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54001c4654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0d853 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691 00007f2d93f6160c 00007f2d93f608c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.035423 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177729920}
I20260709 13:07:24.038789 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1673) took 1109 ms. Trace:
W20260709 13:07:24.039319 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.039286 15580 rpcz_store.cc:276] 0709 13:07:22.929799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.844124 (+914325us) service_pool.cc:224] Handling call
0709 13:07:23.844402 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.960307 (+115905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.038498 (+ 78191us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001c4654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:24.038718 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264829184}
I20260709 13:07:24.041162 18500 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.045639 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1670) took 1137 ms. Trace:
I20260709 13:07:24.046600 15727 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:24.046957 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:24.026819 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.048640 15722 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:24.046216 15579 rpcz_store.cc:276] 0709 13:07:22.908326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.834571 (+926245us) service_pool.cc:224] Handling call
0709 13:07:23.978220 (+143649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.978759 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.045380 (+ 66621us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000d66d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.045558 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314048768}
I20260709 13:07:24.055224 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.056299 16277 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:24.054159 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:24.064503 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 70244.4us
I20260709 13:07:24.065588 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.067965 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:24.069931 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:23.992867 18531 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.080394 18531 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.080554 18501 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.080562 17976 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:24.081705 15544 leader_election.cc:400] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:24.083621 18537 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.085342 18613 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.085872 18613 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.086975 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 818) took 1015 ms. Trace:
I20260709 13:07:24.087334 16276 rpcz_store.cc:276] 0709 13:07:23.071889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.120057 (+ 48168us) service_pool.cc:224] Handling call
0709 13:07:24.086759 (+966702us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002d50d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.086889 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487750400}
I20260709 13:07:24.088002 18613 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.088385 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.089802 16276 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.073230 18489 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:24.070986 18506 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.029999 18451 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.076387 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 996) took 1519 ms. Trace:
I20260709 13:07:24.113471 16269 rpcz_store.cc:276] 0709 13:07:22.557099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.557667 (+   568us) service_pool.cc:224] Handling call
0709 13:07:24.076151 (+1518484us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54007701d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.076324 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623750400}
I20260709 13:07:24.076570 18422 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:24.077821 16278 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:24.057377 18533 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.081653 17976 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:24.072603 18434 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:24.096963 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.125304 16276 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:24.090381 18529 consensus_queue.cc:1059] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:24.091046 18477 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:24.140316 16269 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:24.100373 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:24.141604 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.106176 18554 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.143419 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.144390 15649 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:24.147112 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.106549 16277 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.107766 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.070996 15578 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:24.127292 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.148874 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.149415 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:24.126375 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1666) took 1254 ms. Trace:
I20260709 13:07:24.152858 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.125192 17976 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.138160 18434 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.157374 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.150139 15573 rpcz_store.cc:276] 0709 13:07:22.871637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.805872 (+934235us) service_pool.cc:224] Handling call
0709 13:07:23.806330 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.806769 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:23.983567 (+176798us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.123686 (+140119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.123792 (+   106us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.126086 (+  2294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.126167 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.126308 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163619,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":11231,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14279,"thread_start_us":282340,"threads_started":2}
I20260709 13:07:24.155350 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 819) took 1083 ms. Trace:
I20260709 13:07:24.162691 16277 rpcz_store.cc:276] 0709 13:07:23.072215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.071694 (+999479us) service_pool.cc:224] Handling call
0709 13:07:24.106372 (+ 34678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.155161 (+ 48789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.155305 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:24.172976 16276 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:24.173127 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74511.1us
W20260709 13:07:24.176558 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68861.3us
I20260709 13:07:24.145309 18500 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:24.177873 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.179505 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.151727 18501 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.152263 18487 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.114501 18372 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.124104 18422 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.156530 18554 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:24.184866 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:24.186645 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.155829 18507 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.166949 18585 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.124246 18506 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.167575 18434 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.154537 18566 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:24.157912 18574 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.172037 18525 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.175872 18527 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:07:24.222107 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64667.9us
I20260709 13:07:24.223049 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:24.153669 18433 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:24.183498 18451 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.182070 18500 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:24.195030 18564 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.224879 18385 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:24.203744 18324 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:24.244658 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:24.246698 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.247501 18577 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.249588 16274 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:24.251048 18577 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.230640 18629 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:24.235778 18451 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:24.239528 18500 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.269475 18506 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.269558 18422 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.270058 18385 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.275568 18528 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:24.276145 18528 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:24.264842 18507 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:24.282280 18525 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.283005 18525 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.285835 18525 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.243747 18554 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:24.293457 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48879us
I20260709 13:07:24.300043 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1677) took 1223 ms. Trace:
W20260709 13:07:24.303725 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.300570 15577 rpcz_store.cc:276] 0709 13:07:23.076148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.978438 (+902290us) service_pool.cc:224] Handling call
0709 13:07:23.978765 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.990665 (+ 11900us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:23.990699 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.071345 (+ 80646us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.229635 (+158290us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.229689 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.229782 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.299753 (+ 69971us) raft_consensus.cc:1685] finished
0709 13:07:24.299779 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.299958 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6475,"thread_start_us":77868,"threads_started":1,"wal-append.queue_time_us":159018}
W20260709 13:07:24.318174 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.365419 18574 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:24.368534 18570 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:24.245398 18501 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:24.261197 18564 raft_consensus.cc:2764] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:24.287386 18506 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:24.385211 15654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 532) took 1379 ms (client timeout 1527 ms). Trace:
I20260709 13:07:24.288774 18451 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:24.385677 15654 rpcz_store.cc:269] 0709 13:07:23.006105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.022479 (+ 16374us) service_pool.cc:224] Handling call
0709 13:07:24.384987 (+1362508us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.385126 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164547456}
I20260709 13:07:24.389183 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.295006 18385 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.390530 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.391041 15571 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.391388 18372 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.391767 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.391969 18506 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.392346 15573 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:24.393256 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.394433 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.395846 15579 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:24.392395 18506 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:24.277209 18528 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.398864 18554 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.266865 18629 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:24.448302 15571 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:24.457783 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.374397 18525 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:24.400759 18626 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:24.471618 18372 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.470991 18533 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:24.635896 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.650686 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.651561 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.651736 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:24.652917 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:24.649727 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.657147 15578 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:24.659694 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.667114 15573 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:24.681665 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 434996us
I20260709 13:07:24.686209 15721 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:24.687312 15724 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.691958 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.692919 15571 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:24.649483 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:24.694080 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.689836 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:24.696115 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.697238 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:24.700573 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 51188.8us
I20260709 13:07:24.702697 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.703305 15571 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.709132 15571 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:24.713160 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:24.712850 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 192892us
W20260709 13:07:24.714591 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.715063 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.538681 18564 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.719844 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:24.724485 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.724505 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.724936 15578 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:24.716073 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.727442 18577 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.728084 18577 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:24.728662 18577 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.730479 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.730213 15728 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:24.731711 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:24.731815 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.732622 15723 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:24.733681 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.724442 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.734335 16273 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.735754 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.736306 15573 raft_consensus.cc:2376] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8. Re-sending same reply.
I20260709 13:07:24.738269 16277 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:07:24.739485 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.733692 15723 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:24.688970 18489 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.701320 18529 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.697183 18570 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.697968 18528 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:24.695411 18531 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.759524 15571 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:24.760737 15578 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:07:24.786545 15574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.038s	sys 0.064s
I20260709 13:07:24.755172 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.739992 18483 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:24.824963 15574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.039s	sys 0.065s
I20260709 13:07:24.826756 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 821) took 1189 ms. Trace:
I20260709 13:07:24.740191 16277 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 2.
I20260709 13:07:24.689682 18372 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.777144 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:24.499122 18525 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.712987 18385 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:24.838410 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.745738 16273 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:24.793892 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.823556 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.823939 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.840961 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.841550 15571 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:24.620247 18501 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.710090 18487 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:24.846176 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.847498 16273 raft_consensus.cc:2410] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:24.754016 18527 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:24.787050 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:24.827608 16272 rpcz_store.cc:276] 0709 13:07:23.636991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.108082 (+471091us) service_pool.cc:224] Handling call
0709 13:07:24.108408 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.108813 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.108838 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.109272 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.220888 (+111616us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.220927 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.220994 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.799237 (+578243us) raft_consensus.cc:1685] finished
0709 13:07:24.799267 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.826679 (+ 27412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":111221,"threads_started":1,"wal-append.queue_time_us":178354}
I20260709 13:07:24.713320 18533 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:07:24.852988 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:24.841674 16277 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:24.620748 18629 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.797968 18519 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:24.850801 15578 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:24.774235 18529 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:24.857643 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:24.849967 17976 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
W20260709 13:07:24.847548 18425 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.831s	user 0.006s	sys 0.006s
I20260709 13:07:24.771845 18489 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.794979 18570 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.838565 18635 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.748376 18564 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.861941 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.864862 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:24.856310 18422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.041s	sys 0.057s
I20260709 13:07:24.872659 16272 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 3: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:24.870050 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.870705 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.871927 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.865880 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.874046 15723 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:24.854687 18633 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.875801 16273 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:24.863613 18529 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.846743 18385 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.859623 18566 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.879693 15724 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:24.864087 18519 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.859303 18632 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.880533 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.884754 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.855026 18527 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.840155 18483 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:24.874019 18422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.041s	sys 0.058s
I20260709 13:07:24.868613 18635 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.889042 15579 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.915684 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.916448 15723 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:24.883886 18434 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
I20260709 13:07:24.889161 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:24.917186 15578 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.919719 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.920938 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:24.922175 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.922904 16269 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:24.923310 18564 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:24.923671 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.923868 18374 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:24.924232 18489 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.924780 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.925540 16269 raft_consensus.cc:2410] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:24.926942 18525 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.928033 18527 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.889673 18566 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.886351 18324 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.880414 18633 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:24.931384 18451 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:07:24.931797 18451 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.933174 18633 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:24.891860 18519 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.900835 18531 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.867347 17976 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.879794 18425 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:24.930462 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 817) took 1858 ms. Trace:
I20260709 13:07:24.915475 18635 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.893150 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1674) took 1951 ms. Trace:
I20260709 13:07:24.988160 15578 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:24.992302 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:24.992475 16278 rpcz_store.cc:276] 0709 13:07:23.071592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.016140 (+944548us) service_pool.cc:224] Handling call
0709 13:07:24.077650 (+ 61510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.123286 (+ 45636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.930272 (+806986us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54007701d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:24.930403 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140109056}
I20260709 13:07:24.988176 18434 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:25.008616 18434 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.009586 18434 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.931309 18324 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:24.989522 18531 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:24.903306 18570 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:24.987675 18506 consensus_meta.cc:287] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.004s
I20260709 13:07:25.001058 18425 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:24.995746 15578 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:25.010403 15573 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:25.012271 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.994856 15574 rpcz_store.cc:276] 0709 13:07:22.941335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.853132 (+911797us) service_pool.cc:224] Handling call
0709 13:07:23.871362 (+ 18230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.871715 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:24.099231 (+227516us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b180041cb00. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:07:24.158486 (+ 59255us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.825489 (+667003us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.826112 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.826307 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.826361 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.826465 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.885211 (+ 58746us) raft_consensus.cc:1685] finished
0709 13:07:24.889526 (+  4315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.893078 (+  3552us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99001,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":48058,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":36221,"spinlock_wait_cycles":5785856,"thread_start_us":713302,"threads_started":3,"wal-append.queue_time_us":76679}
I20260709 13:07:25.039492 15648 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.019160 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:24.992302 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:25.027136 15721 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:25.033218 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:25.046808 15579 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:25.033780 16272 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:07:25.034196 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.097436 16278 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:25.098505 15650 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:25.099025 15650 pending_rounds.cc:85] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 5
I20260709 13:07:25.099341 15650 pending_rounds.cc:107] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:25.099640 15650 raft_consensus.cc:2889] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:25.078926 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.151892 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:25.067839 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.153178 15651 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:25.050828 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.151082 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.154091 15648 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.047920 16277 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 2.
I20260709 13:07:25.155872 16272 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:25.051652 16270 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:25.020460 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1683) took 2178 ms. Trace:
I20260709 13:07:25.157495 15647 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:25.157935 15653 rpcz_store.cc:276] 0709 13:07:22.841761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.698367 (+856606us) service_pool.cc:224] Handling call
0709 13:07:23.728412 (+ 30045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.991760 (+263348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.020245 (+1028485us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:25.020405 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585843456}
I20260709 13:07:25.159519 16269 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:25.160040 16269 pending_rounds.cc:85] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 5
I20260709 13:07:25.160318 16269 pending_rounds.cc:107] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:25.160615 16269 raft_consensus.cc:2889] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.163770 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:25.016732 18585 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.000s
I20260709 13:07:25.156873 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.166168 16278 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:07:25.167816 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.171607 15692 connection.cc:256] RPC call timeout handler was delayed by -1.4162788890000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:07:25.023274 18566 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.175135 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.026890 17976 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.010018 18434 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.175884 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.019156 18632 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:25.177816 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 457083us
W20260709 13:07:25.025215 18573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.021s
I20260709 13:07:25.185869 16272 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:25.018589 18528 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:25.024746 18385 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:25.048135 18498 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.180719 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:25.152156 18603 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:25.189514 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.021745 18324 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:25.031414 18372 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.033212 18519 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.029884 18425 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.194856 15655 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.201824 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.202761 15654 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:25.187844 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.176990 18585 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.167505 18483 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.025453 18506 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.199826 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 342248us
I20260709 13:07:25.024036 18531 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:25.186254 18573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.008s	sys 0.027s
I20260709 13:07:25.195744 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.184074 18434 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.221432 15543 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:25.240450 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.237707 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.241150 15647 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.241607 15654 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:25.246942 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.247176 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.011s	sys 0.011s
W20260709 13:07:25.247481 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.011s
W20260709 13:07:25.247793 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 559206us
I20260709 13:07:25.248994 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:25.252348 15648 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:25.253726 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.254559 15648 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:25.255636 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.256911 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:25.258283 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.005s	sys 0.024s
I20260709 13:07:25.259227 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:25.218124 18519 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.262820 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:25.275216 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.215466 18588 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:25.287130 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:25.247545 18500 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.001s
W20260709 13:07:25.275952 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.006s	sys 0.024s
I20260709 13:07:25.240763 18483 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:25.288331 18500 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.285380 15544 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.027s
I20260709 13:07:25.197708 18528 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.290742 18500 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.291116 18528 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.283805 15655 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:25.197861 18498 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.295933 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.015s
W20260709 13:07:25.296320 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.015s
I20260709 13:07:25.270347 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:25.203379 18603 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:25.284381 15543 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:25.308812 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:25.300933 15544 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.027s
W20260709 13:07:25.311450 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 603096us
I20260709 13:07:25.316928 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.317634 15654 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:25.275162 18531 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.276233 18634 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:25.321378 15647 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:25.324524 15647 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:25.257948 18527 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:25.295991 18451 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.286402 18585 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:25.333758 15654 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:25.276923 18525 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:25.346078 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.303882 15648 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:25.346927 15647 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:25.367431 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.368070 15647 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.300163 18588 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.285665 18519 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.391279 15647 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:25.343704 18425 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:25.456996 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:25.357735 18632 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:25.337997 18422 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:25.460832 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.459028 15693 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:25.420667 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50279.7us
W20260709 13:07:25.385805 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.404325 18553 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:25.446843 18577 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.718s	user 0.014s	sys 0.001s
I20260709 13:07:25.473078 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:25.483358 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:25.355779 18585 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.484577 16270 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:25.445994 18554 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:25.486491 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:25.445590 18588 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.491505 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.444317 18519 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:25.486894 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:25.446802 18501 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.457947 18648 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:25.468540 18374 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:25.468524 18422 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:25.513147 18422 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.515060 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.515863 15647 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:25.516717 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.492714 18577 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.520488 18577 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:25.521831 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.522710 16273 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:25.523728 18649 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:07:25.525360 18643 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:25.525520 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.503420 15654 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:25.526135 15726 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:25.526629 17976 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:25.526881 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.460605 18451 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:25.528389 18506 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.404525 18635 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.529299 18648 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:25.486089 18654 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:25.503595 18554 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.508813 18104 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:25.551898 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:25.557613 16270 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.492602 18385 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.510589 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.565150 15724 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:25.517766 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:25.498881 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:25.522521 18657 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:25.527024 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.567611 15726 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:25.568498 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:25.568673 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 69871.5us
I20260709 13:07:25.470937 18433 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:25.532083 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1679) took 1145 ms. Trace:
I20260709 13:07:25.442128 18498 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.457614 18629 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:25.534798 15650 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:25.536139 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.537110 15651 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:25.544493 16273 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:25.404306 18650 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.570158 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 291396us
I20260709 13:07:25.492112 18487 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.491595 18633 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.529763 18653 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:25.528263 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.569468 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:25.491321 18372 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:07:25.556986 18104 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:25.621134 15654 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:25.589967 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 103562us
I20260709 13:07:25.575031 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:25.598354 15725 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:25.631861 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.600555 18483 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:25.632447 15725 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:25.633476 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.634716 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.606065 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.635774 15724 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:25.602007 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:25.570632 15577 rpcz_store.cc:276] 0709 13:07:24.387146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.443392 (+ 56246us) service_pool.cc:224] Handling call
0709 13:07:24.443924 (+   532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.489288 (+ 45364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.489339 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.702012 (+212673us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.163116 (+461104us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:25.163164 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.163252 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.531806 (+368554us) raft_consensus.cc:1685] finished
0709 13:07:25.531833 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.532015 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44754,"raft.queue_time_us":44887,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":432737,"threads_started":1,"wal-append.queue_time_us":606946}
I20260709 13:07:25.555954 18570 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:25.539074 18645 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:25.624568 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.645682 15650 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:25.534513 18501 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.638149 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.592306 18635 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.652318 15725 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:25.653636 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.654268 15725 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.643127 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:25.644836 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:25.494232 18553 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.647662 18655 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:07:25.563470 18574 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:07:25.656257 15724 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:25.570958 18506 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:07:25.567122 18603 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:25.610312 18658 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.660167 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:25.662382 15724 raft_consensus.cc:2368] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:25.643692 18525 consensus_queue.cc:1243] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:25.607973 18646 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:25.649040 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:25.601121 18433 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.670001 15654 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:25.652559 18650 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:25.648444 18104 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.680769 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.657516 18647 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:25.700330 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.736548 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 810) took 2706 ms (client timeout 2022 ms). Trace:
I20260709 13:07:25.663808 18658 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:25.629004 18659 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:25.637245 18653 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.742448 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.777662 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.743088 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 472802us
W20260709 13:07:25.743865 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.740578 16271 rpcz_store.cc:269] 0709 13:07:22.974918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.975834 (+   916us) service_pool.cc:224] Handling call
0709 13:07:25.680721 (+2704887us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:25.680865 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926970112}
W20260709 13:07:25.811616 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.779852 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:25.858561 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.018s	sys 0.017s
W20260709 13:07:25.859767 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.018s	sys 0.017s
I20260709 13:07:25.652534 18645 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:25.866927 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 87149.5us
I20260709 13:07:25.878186 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:25.879066 15578 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:25.880271 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:25.881101 15578 raft_consensus.cc:2368] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:25.881929 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:25.885385 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:25.888495 15578 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:25.892391 15724 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:25.895387 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.742820 18527 raft_consensus.cc:2764] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:25.857355 18577 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.751083 18642 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:25.898988 18434 consensus_meta.cc:287] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.007s
I20260709 13:07:25.919364 18434 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.924011 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:25.926548 18434 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:25.911182 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:25.934687 18570 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:25.911469 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:25.865353 18528 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:25.782477 18658 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.869518 18104 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:25.907296 18451 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.936069 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 291248us
I20260709 13:07:25.910184 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:25.864023 18665 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:25.738651 18650 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.907585 18633 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:25.939301 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.666697 18483 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:25.494501 18641 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:25.941820 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 334603us
I20260709 13:07:25.935062 15575 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:25.942229 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 436069us
I20260709 13:07:25.900583 18425 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.900597 18519 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.890185 17976 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:25.857723 18498 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:07:25.900534 18573 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.953583 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 605) took 1188 ms. Trace:
W20260709 13:07:25.951423 18671 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:07:25.953799 18664 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
I20260709 13:07:25.945411 18374 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:25.947286 18570 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:25.959426 18669 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 13:07:25.908032 18634 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:25.866182 18372 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:07:25.938392 15580 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:26.044420 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:25.999739 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1627) took 1234 ms. Trace:
I20260709 13:07:26.458518 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:26.458806 18374 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.457980 18634 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.459468 18527 raft_consensus.cc:2764] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:07:26.033752 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1669) took 3132 ms. Trace:
I20260709 13:07:26.465070 18634 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:26.460412 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1624) took 1706 ms. Trace:
I20260709 13:07:25.971411 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:26.466939 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2212) took 1427 ms. Trace:
I20260709 13:07:26.461184 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1820) took 1742 ms. Trace:
I20260709 13:07:26.467401 16271 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:26.468430 18678 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.467265 15576 rpcz_store.cc:276] 0709 13:07:24.754084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.755337 (+  1253us) service_pool.cc:224] Handling call
0709 13:07:24.822213 (+ 66876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.201710 (+379497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.201739 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.218256 (+ 16517us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.462736 (+244480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:25.474574 (+ 11838us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.498652 (+ 24078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.499226 (+   574us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.460202 (+960976us) raft_consensus.cc:1685] finished
0709 13:07:26.460226 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.460357 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27348,"prepare.queue_time_us":12162,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":152265,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"thread_start_us":551657,"threads_started":2,"wal-append.queue_time_us":382483}
I20260709 13:07:26.469152 18678 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.467536 15655 rpcz_store.cc:276] 0709 13:07:25.039219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.292420 (+253201us) service_pool.cc:224] Handling call
0709 13:07:25.292729 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.293066 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.293093 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.293565 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.503421 (+209856us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.503474 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.503558 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.466761 (+963203us) raft_consensus.cc:1685] finished
0709 13:07:26.466780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.466888 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199431,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":36136,"thread_start_us":209402,"threads_started":1,"wal-append.queue_time_us":365458}
I20260709 13:07:26.471796 18678 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:26.468300 15728 rpcz_store.cc:276] 0709 13:07:24.718502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.720955 (+  2453us) service_pool.cc:224] Handling call
0709 13:07:24.721357 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.721711 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:24.746618 (+ 24907us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.031913 (+285295us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b1800465160. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:07:25.359448 (+327535us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.439867 (+ 80419us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.440109 (+   242us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:25.440161 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.440260 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.460900 (+1020640us) raft_consensus.cc:1685] finished
0709 13:07:26.461002 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.461128 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23849,"raft.queue_time_us":7814,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":32731,"spinlock_wait_cycles":14405888,"thread_start_us":319423,"threads_started":1,"wal-append.queue_time_us":842291}
I20260709 13:07:26.038941 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:26.473256 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:26.473423 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:26.473933 15728 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:26.473817 18665 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.474329 18678 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.474905 18678 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:26.475318 18678 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.476053 18665 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:26.457830 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 578) took 1239 ms. Trace:
I20260709 13:07:26.478176 15729 rpcz_store.cc:276] 0709 13:07:25.218609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.044188 (+825579us) service_pool.cc:224] Handling call
0709 13:07:26.457771 (+413583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:25.971638 18648 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:26.036180 18422 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:07:26.480459 17976 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.481161 18422 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.482160 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.482915 18537 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:25.996927 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 814) took 2926 ms (client timeout 3189 ms). Trace:
I20260709 13:07:26.464877 15572 rpcz_store.cc:276] 0709 13:07:22.901460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.830817 (+929357us) service_pool.cc:224] Handling call
0709 13:07:23.839816 (+  8999us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:23.840176 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.840203 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:23.851329 (+ 11126us) log.cc:844] Serialized 52 byte log entry
0709 13:07:23.932588 (+ 81259us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:24.078246 (+145658us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.079054 (+   808us) log.cc:844] Serialized 14 byte log entry
0709 13:07:24.082222 (+  3168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.082294 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.028675 (+1946381us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b18002e8b20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:26.033485 (+  4810us) raft_consensus.cc:1685] finished
0709 13:07:26.033514 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.033680 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38993,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":1128,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":3524,"spinlock_wait_cycles":67205504,"thread_start_us":179619,"threads_started":2,"wal-append.queue_time_us":210575}
I20260709 13:07:26.035244 15725 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:25.983596 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.901863 18670 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.474404 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 575) took 1299 ms. Trace:
W20260709 13:07:26.459769 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 890347us
I20260709 13:07:26.023150 16270 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:26.040010 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.039830 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:26.550546 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2251) took 1236 ms. Trace:
I20260709 13:07:26.550657 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:26.551046 15722 rpcz_store.cc:276] 0709 13:07:25.314303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.039592 (+725289us) service_pool.cc:224] Handling call
0709 13:07:26.550490 (+510898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.551354 18553 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:26.550494 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:26.460981 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 550836us
I20260709 13:07:26.552119 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:26.552434 15655 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:26.552659 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.473394 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 583) took 1224 ms. Trace:
I20260709 13:07:26.554052 15727 rpcz_store.cc:276] 0709 13:07:25.249028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.038679 (+789651us) service_pool.cc:224] Handling call
0709 13:07:26.473342 (+434663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.460424 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:26.049822 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 607) took 1273 ms. Trace:
W20260709 13:07:26.286146 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.545694 16275 rpcz_store.cc:269] 0709 13:07:23.070587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.074139 (+  3552us) service_pool.cc:224] Handling call
0709 13:07:25.970968 (+2896829us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400542254. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:25.996858 (+ 25890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440686336}
I20260709 13:07:26.545799 15724 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:26.176539 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.010s
I20260709 13:07:26.540701 15728 rpcz_store.cc:276] 0709 13:07:25.174520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.472999 (+1298479us) service_pool.cc:224] Handling call
0709 13:07:26.474352 (+  1353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.483314 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.034873 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2247) took 1186 ms. Trace:
W20260709 13:07:25.967175 18662 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:07:26.545457 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 573) took 1371 ms. Trace:
W20260709 13:07:26.291551 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.543251 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:26.559441 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.008s	sys 0.015s
W20260709 13:07:26.564007 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 920918us
I20260709 13:07:26.564257 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:26.564640 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.565296 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:26.547425 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:26.566344 15693 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:25.950655 18661 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:07:26.567570 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1822) took 1848 ms. Trace:
W20260709 13:07:26.542897 18529 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.656s	user 0.010s	sys 0.002s
I20260709 13:07:25.959681 18433 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.458003 15571 rpcz_store.cc:276] 0709 13:07:24.765179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.842603 (+ 77424us) service_pool.cc:224] Handling call
0709 13:07:24.843047 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.166198 (+323151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.166231 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.172582 (+  6351us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.490857 (+318275us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.490911 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.491009 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.999523 (+508514us) raft_consensus.cc:1685] finished
0709 13:07:25.999546 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.999684 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82544,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":591403,"threads_started":2,"wal-append.queue_time_us":712604}
I20260709 13:07:26.488384 16277 rpcz_store.cc:276] 0709 13:07:24.764873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.155543 (+390670us) service_pool.cc:224] Handling call
0709 13:07:25.155772 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.474813 (+319041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.482556 (+  7743us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.491910 (+  9354us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.683642 (+191732us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.737425 (+ 53783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.737759 (+   334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.953234 (+215475us) raft_consensus.cc:1685] finished
0709 13:07:25.953268 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.953494 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65591,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5185,"thread_start_us":437777,"threads_started":2,"wal-append.queue_time_us":446397}
I20260709 13:07:26.029287 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1682) took 3201 ms. Trace:
W20260709 13:07:25.966631 18644 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:26.556476 16273 rpcz_store.cc:276] 0709 13:07:24.776569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.018846 (+242277us) service_pool.cc:224] Handling call
0709 13:07:26.049590 (+1030744us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400542754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.049746 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106546944}
I20260709 13:07:26.567942 15721 rpcz_store.cc:276] 0709 13:07:24.719087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.732895 (+ 13808us) service_pool.cc:224] Handling call
0709 13:07:24.733224 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.046150 (+312926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.567355 (+1521205us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54003bf1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:26.567518 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675382016}
I20260709 13:07:26.569144 15728 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:25.953933 18603 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:25.913892 18676 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.549453 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:26.752516 15472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 368) took 22251 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.032739 18585 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.754896 15649 rpcz_store.cc:276] 0709 13:07:22.828106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.642574 (+814468us) service_pool.cc:224] Handling call
0709 13:07:23.642972 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.144771 (+501799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.028945 (+1884174us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400369054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:26.029191 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152769408}
I20260709 13:07:26.138077 18554 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:26.613517 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2250) took 1299 ms (client timeout 1714 ms). Trace:
W20260709 13:07:26.563446 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.941509 18577 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.528712 18665 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:26.604465 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1623) took 1850 ms (client timeout 1695 ms). Trace:
I20260709 13:07:26.736663 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 579) took 1516 ms. Trace:
I20260709 13:07:25.295476 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:26.728278 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.549324 18653 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:26.575474 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:26.544517 18645 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.571553 15575 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:26.542142 18451 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.557572 18519 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.494596 18680 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:26.504333 18648 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.537866 18633 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.797003 18648 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.641292 18422 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.799144 18648 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.449669 18682 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:26.799466 18633 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.799832 18682 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.802616 18682 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.563048 15725 rpcz_store.cc:276] 0709 13:07:25.173932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.653389 (+479457us) service_pool.cc:224] Handling call
0709 13:07:26.545377 (+891988us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:26.602329 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 595) took 2940 ms (client timeout 1633 ms). Trace:
W20260709 13:07:26.803481 16274 rpcz_store.cc:269] 0709 13:07:23.661614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.839235 (+177621us) service_pool.cc:224] Handling call
0709 13:07:26.602109 (+2762874us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400630e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.602250 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941545856}
I20260709 13:07:26.804291 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2248) took 1491 ms. Trace:
I20260709 13:07:26.804682 15725 rpcz_store.cc:276] 0709 13:07:25.313328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.803543 (+1490215us) service_pool.cc:224] Handling call
0709 13:07:26.803818 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.803999 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.804024 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.804065 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:26.804094 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.804145 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.804239 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.623325 15647 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:26.754482 15472 rpcz_store.cc:269] 0709 13:07:04.500792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.500926 (+   134us) service_pool.cc:224] Handling call
0709 13:07:26.752441 (+22251515us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:21.525712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:21.544128 (+ 18416us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:21.562661 (+ 18533us) write_op.cc:435] Acquired schema lock
0709 13:07:21.562683 (+    22us) tablet.cc:662] Decoding operations
0709 13:07:21.757976 (+195293us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:21.787884 (+ 29908us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:21.790407 (+  2523us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:22.113348 (+322941us) tablet.cc:701] Row locks acquired
0709 13:07:22.115834 (+  2486us) write_op.cc:260] PREPARE: finished
0709 13:07:22.116028 (+   194us) write_op.cc:270] Start()
0709 13:07:22.116187 (+   159us) write_op.cc:276] Timestamp: P: 1783602442115958 usec, L: 0
0709 13:07:22.116208 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.116924 (+   716us) log.cc:844] Serialized 3243 byte log entry
0709 13:07:23.142383 (+1025459us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d929090ac 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b
0709 13:07:24.074121 (+931738us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18002e7da0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:24.074448 (+   327us) op_driver.cc:464] REPLICATION: finished
0709 13:07:24.293431 (+218983us) write_op.cc:301] APPLY: starting
0709 13:07:24.369573 (+ 76142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:24.369881 (+   308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:24.369928 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:24.382247 (+ 12319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:24.382680 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:24.382749 (+    69us) write_op.cc:312] APPLY: finished
0709 13:07:24.383199 (+   450us) log.cc:844] Serialized 65 byte log entry
0709 13:07:24.478374 (+ 95175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.488338 (+  9964us) write_op.cc:454] Released schema lock
0709 13:07:24.552681 (+ 64343us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:24.739208 (+186527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.748220 (+  9012us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3466191,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":164145,"apply.run_cpu_time_us":4588,"apply.run_wall_time_us":438036,"num_ops":8,"prepare.queue_time_us":222812,"prepare.run_cpu_time_us":43157,"prepare.run_wall_time_us":2288510,"raft.queue_time_us":471701,"raft.run_cpu_time_us":41122,"raft.run_wall_time_us":109998,"replication_time_us":1958088,"spinlock_wait_cycles":27325184,"thread_start_us":2179756,"threads_started":4,"wal-append.queue_time_us":1145844,"wal-append.run_cpu_time_us":21312,"wal-append.run_wall_time_us":2086047}]]}
I20260709 13:07:26.806596 15647 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:26.807337 15647 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.808391 15647 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:26.556934 18658 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
I20260709 13:07:26.810271 18658 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.812367 18658 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:26.815402 15725 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:26.816056 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 588) took 1349 ms. Trace:
I20260709 13:07:26.816349 15725 rpcz_store.cc:276] 0709 13:07:25.466312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.805587 (+1339275us) service_pool.cc:224] Handling call
0709 13:07:26.805832 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.815797 (+  9965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.816004 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.603215 18434 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.746722 18603 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:25.970731 18672 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:26.028218 18528 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:26.489388 18573 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:26.602859 18531 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.276s	user 0.011s	sys 0.000s
W20260709 13:07:26.697733 18507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.842s	user 0.038s	sys 0.058s
W20260709 13:07:26.785674 15726 rpcz_store.cc:269] 0709 13:07:25.313960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.568250 (+254290us) service_pool.cc:224] Handling call
0709 13:07:26.613294 (+1045044us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540011c1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.613439 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067052928}
W20260709 13:07:26.789283 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.788372 15573 rpcz_store.cc:269] 0709 13:07:24.753683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.754877 (+  1194us) service_pool.cc:224] Handling call
0709 13:07:26.604260 (+1849383us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000c7bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.604394 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426278656}
W20260709 13:07:26.789659 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 214262us
I20260709 13:07:26.846979 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:26.847602 15649 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:26.612795 16235 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:26.788506 15728 rpcz_store.cc:276] 0709 13:07:25.220369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.559745 (+1339376us) service_pool.cc:224] Handling call
0709 13:07:26.568885 (+  9140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.736345 (+167460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.736600 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.588187 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.609601 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 6 to 7, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), pending config changed. New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:26.850911 15579 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:26.570773 18527 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:26.614265 18654 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.852459 18654 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.852922 18654 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.560302 15723 rpcz_store.cc:276] 0709 13:07:24.848562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.051787 (+203225us) service_pool.cc:224] Handling call
0709 13:07:25.167246 (+115459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.332202 (+164956us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:25.350048 (+ 17846us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.915927 (+565879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.915979 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:25.916024 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.034658 (+118634us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400399754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:26.034702 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.034819 (+   117us) inbound_call.cc:177] Queueing success response
0709 13:07:26.035738 (+   919us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b1800271420. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
Metrics: {"mutex_wait_us":64169,"prepare.queue_time_us":23987,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":49,"raft.queue_time_us":202576,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":109435,"spinlock_wait_cycles":453216128,"thread_start_us":501257,"threads_started":2,"wal-append.queue_time_us":340653}
I20260709 13:07:26.853777 18372 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.600705 18374 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.854786 18374 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:26.854980 18372 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:26.855333 18374 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.855551 18372 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:26.856606 18372 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.601800 18525 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.858317 18525 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:26.858548 18574 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:26.859735 18574 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:26.860213 18574 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:26.594795 18543 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.864030 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.864672 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.865455 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.628332 18500 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.866103 15572 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:26.866218 18500 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:26.866392 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.644797 18501 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:26.625777 18642 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:26.867954 18642 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.760183 15724 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:26.870363 15724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 570) took 1697 ms (client timeout 2107 ms). Trace:
W20260709 13:07:26.870821 15724 rpcz_store.cc:269] 0709 13:07:25.173130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.907358 (+734228us) service_pool.cc:224] Handling call
0709 13:07:26.870290 (+962932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.756489 18677 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.871891 18677 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.827171 15647 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:26.594271 18689 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.561151 18634 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.264s
I20260709 13:07:26.874483 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2214) took 1500 ms. Trace:
I20260709 13:07:26.874938 15647 rpcz_store.cc:276] 0709 13:07:25.374503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.571395 (+196892us) service_pool.cc:224] Handling call
0709 13:07:25.571688 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.623225 (+1051537us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54000a8aa0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598adc0 00007f2d95a151c0 00007f2d95a16231 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c
0709 13:07:26.874190 (+250965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.874413 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148374400}
I20260709 13:07:26.831274 15722 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:07:26.876286 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 830) took 2585 ms. Trace:
I20260709 13:07:26.560209 18425 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.794504 18630 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.794423 18585 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.823019 18653 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.598970 18678 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.753471 18529 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.849668 15653 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:26.859552 18525 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.943198 15572 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:26.606123 18533 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:26.866657 18500 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.629437 18489 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.879155 15721 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:26.879474 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 266776us
I20260709 13:07:26.876794 16276 rpcz_store.cc:276] 0709 13:07:24.290462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.290592 (+   130us) service_pool.cc:224] Handling call
0709 13:07:24.373486 (+ 82894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.654389 (+280903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.654424 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.654976 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.296657 (+641681us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:25.296696 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.296761 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.876049 (+1579288us) raft_consensus.cc:1685] finished
0709 13:07:26.876072 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.876216 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":315678,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":14676,"thread_start_us":565594,"threads_started":1,"wal-append.queue_time_us":955060}
I20260709 13:07:26.974615 16235 leader_election.cc:400] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:26.895279 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:26.845016 18507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.022s	user 0.040s	sys 0.059s
I20260709 13:07:26.843248 18573 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.923488 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.833084 18680 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:26.933233 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:26.978909 15579 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:26.788822 18676 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.924424 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 574) took 1750 ms. Trace:
I20260709 13:07:26.945847 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:26.979518 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 496233us
W20260709 13:07:26.949249 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.963976 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1694) took 1904 ms. Trace:
I20260709 13:07:26.984270 15722 rpcz_store.cc:276] 0709 13:07:25.174257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.551731 (+1377474us) service_pool.cc:224] Handling call
0709 13:07:26.552042 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:26.876258 (+324216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.924062 (+ 47804us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:26.924350 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641529216}
I20260709 13:07:26.985494 15653 rpcz_store.cc:276] 0709 13:07:25.059250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.159550 (+100300us) service_pool.cc:224] Handling call
0709 13:07:26.963779 (+1804229us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54002e2554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.963918 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3700225280}
I20260709 13:07:26.948029 15473 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:26.930771 18651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:07:26.970834 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.987689 15571 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:26.902460 18665 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.991228 15693 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:26.957129 18372 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.976640 16235 leader_election.cc:403] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.947060 15572 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:07:26.988348 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.978569 18633 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.990823 15473 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 5, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.970952 18501 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.990309 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.994083 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:26.974788 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2218) took 1599 ms. Trace:
I20260709 13:07:26.996572 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:26.990198 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 582) took 1749 ms. Trace:
I20260709 13:07:26.936722 18585 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:26.998075 15721 rpcz_store.cc:276] 0709 13:07:25.240720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.784860 (+1544140us) service_pool.cc:224] Handling call
0709 13:07:26.877839 (+ 92979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.973621 (+ 95782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.983055 (+  9434us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b5400002150. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.990145 (+  7090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130059648}
I20260709 13:07:26.996781 15651 rpcz_store.cc:276] 0709 13:07:25.375738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.599251 (+223513us) service_pool.cc:224] Handling call
0709 13:07:26.963935 (+1364684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.964249 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.964277 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.964320 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:26.964349 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.964404 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.974630 (+ 10226us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002e2550. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:26.974738 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":574,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5272,"spinlock_wait_cycles":3090578176}
I20260709 13:07:26.832237 18672 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:27.010247 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 456501us
I20260709 13:07:26.973489 18489 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:27.009335 15473 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.013154 15647 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
W20260709 13:07:27.014550 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 449279us
I20260709 13:07:26.979542 18533 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:26.995991 18324 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.025755 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.010784 18525 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.996117 18570 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.946616 18603 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:26.972087 18653 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:26.975847 18528 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.020221 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.027997 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:27.076334 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56150.7us
I20260709 13:07:27.077157 15724 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.033824 15651 raft_consensus.cc:2368] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:27.000118 18677 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.026929 15473 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.047641 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:26.995774 18633 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.080569 15721 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:27.054750 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 507413us
I20260709 13:07:27.082157 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.082787 15543 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:27.083707 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.085062 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.086200 15653 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:27.087533 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:27.068593 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.006s
W20260709 13:07:27.089641 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.011s	sys 0.006s
I20260709 13:07:27.032549 18665 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.020602 18531 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:27.093231 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.103399 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.103801 15723 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:27.093721 15619 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.013897 18501 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.033984 18650 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.097309 15728 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:27.112799 16270 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:27.113122 15724 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:27.100965 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:27.043313 18670 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:27.046326 18570 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.085741 15651 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:27.027724 18658 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:27.048115 18498 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.140529 18104 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.005s
I20260709 13:07:27.140635 18498 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.141384 18104 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:27.142795 18104 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:27.107441 15473 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 4, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:27.144055 18574 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.145287 18574 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.144606 15473 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 6 to 7, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.103942 15653 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:27.146368 18702 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.146889 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.147671 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:27.148655 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.148880 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2246) took 2311 ms. Trace:
I20260709 13:07:27.108887 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.149219 15720 rpcz_store.cc:276] 0709 13:07:24.837613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.033921 (+196308us) service_pool.cc:224] Handling call
0709 13:07:25.034924 (+  1003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.101395 (+ 66471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.101453 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.600398 (+1498945us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b2c0013e688. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:07:26.600840 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.993302 (+392462us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:26.993346 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.993540 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.148588 (+155048us) raft_consensus.cc:1685] finished
0709 13:07:27.148607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.148823 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":114514,"spinlock_wait_cycles":134753664,"thread_start_us":392102,"threads_started":1,"wal-append.queue_time_us":546259}
I20260709 13:07:27.156033 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.156873 15723 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:27.090327 18693 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.074976 18537 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.080237 18519 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.120460 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.100339 18422 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.110044 18489 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.138200 18533 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.128974 18570 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.139355 18527 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.139528 18653 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.142787 18650 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.146400 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 52772.8us
I20260709 13:07:27.107178 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:27.096927 18507 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:27.159019 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:27.160836 15651 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:27.164100 18500 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.164386 18374 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.165421 16274 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:27.165622 18577 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.166260 18425 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:27.166765 18434 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.229390 18434 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.118106 18585 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.231658 18434 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.166832 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:27.167275 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.167649 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.220839 18705 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.236586 18705 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.237041 18705 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.238837 15646 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:27.243628 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:27.245263 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.246160 18507 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:27.247052 18324 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:27.247795 18324 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.254905 18674 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.247071 18507 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.255614 18674 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.110009 18680 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.246019 15726 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:27.263955 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:27.220171 15473 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:27.167577 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 222897us
I20260709 13:07:27.133641 18670 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:27.092803 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 632396us
W20260709 13:07:27.265969 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.266053 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:27.109772 18692 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:07:27.096611 18665 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.172338 15721 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:27.109293 18603 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.151799 18104 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:27.149634 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:27.188877 18700 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.221072 18682 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:27.177726 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 179898us
W20260709 13:07:27.179075 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58711.1us
I20260709 13:07:27.284304 15473 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 4 to 5, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.158490 18554 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:27.209501 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50554.8us
I20260709 13:07:27.176738 18422 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.210419 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.119120 18707 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
W20260709 13:07:27.222500 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.218729 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 50103.3us
I20260709 13:07:27.225847 18672 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.226531 18374 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:27.175170 18693 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.226897 18645 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:27.271610 15726 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:27.190675 18690 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:07:27.180833 18566 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:27.218444 18678 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:27.175655 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 179163us
I20260709 13:07:27.286470 15473 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 5 to 6, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.293423 18570 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.261683 18642 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.278472 18677 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.307462 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:27.356236 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1018) took 1804 ms. Trace:
W20260709 13:07:27.356473 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 49091us
W20260709 13:07:27.353684 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 73952.3us
I20260709 13:07:27.358462 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:27.310206 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 99854.3us
I20260709 13:07:27.275817 18529 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.274700 18665 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.312588 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.369700 15572 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 5: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:27.370832 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.271127 18543 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.314011 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.318709 16276 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:27.325917 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:27.327669 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:27.329253 15618 connection.cc:256] RPC call timeout handler was delayed by -2.6488373610000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 13:07:27.281584 18685 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.279184 18451 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.339114 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.224328 18650 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.285388 18682 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.346529 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.317420 15571 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:27.351636 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:27.402535 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51016us
I20260709 13:07:27.352834 18653 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:27.330638 18433 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:27.359653 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.358577 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:27.406702 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48225.1us
I20260709 13:07:27.406944 15723 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:27.404799 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 106090us
I20260709 13:07:27.407689 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.362848 15619 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.355942 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.356634 16272 rpcz_store.cc:276] 0709 13:07:25.551442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.552410 (+   968us) service_pool.cc:224] Handling call
0709 13:07:25.590641 (+ 38231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.591083 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.591124 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.626251 (+ 35127us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.941599 (+315348us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:25.941647 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.941713 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.356020 (+1414307us) raft_consensus.cc:1685] finished
0709 13:07:27.356039 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.356173 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9992,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":2895,"thread_start_us":278184,"threads_started":1,"wal-append.queue_time_us":1172120}
I20260709 13:07:27.368325 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.372107 16275 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:27.409123 15578 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:27.378902 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.382879 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2203) took 4459 ms. Trace:
I20260709 13:07:27.409963 15646 rpcz_store.cc:276] 0709 13:07:22.923314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.729365 (+806051us) service_pool.cc:224] Handling call
0709 13:07:23.741838 (+ 12473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.239359 (+3497521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.382607 (+143248us) spinlock_profiling.cc:243] Waited 3.5 s on lock 0x7b540017c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:27.382807 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8041447168}
I20260709 13:07:27.383675 18678 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.396620 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:27.398703 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.399381 15653 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:27.402963 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.411339 16275 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:27.400190 15473 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to <none>, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:27.412386 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.369199 18645 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.429304 15572 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:27.416612 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:27.419414 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56664.7us
I20260709 13:07:27.424353 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:27.426684 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.426880 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.431018 16274 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
W20260709 13:07:27.431830 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.368350 18676 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:27.440508 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.441879 15618 connection.cc:256] RPC call timeout handler was delayed by -1.5985373610000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3189s for a response
W20260709 13:07:27.442188 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.442417 15618 connection.cc:256] RPC call timeout handler was delayed by -1.4435628780000798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:07:27.442461 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.443212 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:27.357275 18577 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:07:27.339232 18700 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:27.404290 18682 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.399771 18385 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.492233 15646 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.446743 15473 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.406440 18701 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.320061 18554 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.449661 18425 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.450479 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:27.494431 15473 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.356931 18566 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.420218 18483 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:27.398818 18658 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:07:27.504046 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.439658 18706 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:27.413270 18630 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.361183 18104 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.378157 18677 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.392956 18707 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:27.511178 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.535923 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:27.537340 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.511750 15726 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.446554 18529 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.441267 18702 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:27.523751 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 164185us
I20260709 13:07:27.512023 15721 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:27.440521 18633 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.398965 18685 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.528193 15646 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:27.558261 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.530602 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.426431 18678 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.497826 18501 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.542137 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.515051 18425 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.554417 18731 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:27.554812 18715 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 13:07:27.554978 18714 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:07:27.524554 18483 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.497298 18645 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:07:27.539669 15473 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.505470 18374 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:07:27.549202 18704 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:07:27.539237 18729 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.547303 18702 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:27.558358 18500 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:27.586675 18654 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
I20260709 13:07:27.574993 18633 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.556154 18529 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.583779 18731 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:27.584364 18425 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.641456 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1703) took 1154 ms. Trace:
I20260709 13:07:27.642061 15655 rpcz_store.cc:276] 0709 13:07:26.487461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.553076 (+ 65615us) service_pool.cc:224] Handling call
0709 13:07:26.553379 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.997533 (+444154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.997563 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.009951 (+ 12388us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.204068 (+194117us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:27.204115 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.204183 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.641131 (+436948us) raft_consensus.cc:1685] finished
0709 13:07:27.641163 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.641366 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7849,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":29789,"thread_start_us":604543,"threads_started":2,"wal-append.queue_time_us":261837}
I20260709 13:07:27.591073 18483 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.611991 15473 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:27.634478 18722 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:07:27.634675 18372 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
W20260709 13:07:27.634907 18724 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:07:27.626590 18654 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.629925 18642 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.629794 18633 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.637451 18324 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:27.637786 18529 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.638530 18731 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.638443 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:27.623554 18585 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:27.603731 18422 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.606562 18702 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.601506 18725 raft_consensus.cc:2764] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:07:27.675637 15473 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:27.734464 15473 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 5, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.613979 18729 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:27.708787 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 266426us
I20260709 13:07:27.744542 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:27.708662 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 61971.5us
W20260709 13:07:27.701754 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 251829us
I20260709 13:07:27.710202 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:27.710827 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:27.747324 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:27.717072 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1702) took 1230 ms. Trace:
I20260709 13:07:27.719288 15575 raft_consensus.cc:2410] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:27.651448 18570 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:27.733176 15576 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.748624 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.747964 15654 rpcz_store.cc:276] 0709 13:07:26.487103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.487214 (+   111us) service_pool.cc:224] Handling call
0709 13:07:26.553422 (+ 66208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.001323 (+447901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.001356 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.001807 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.173220 (+171413us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.173254 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.173314 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.716806 (+543492us) raft_consensus.cc:1685] finished
0709 13:07:27.716833 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.716987 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292,"raft.queue_time_us":52204,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"thread_start_us":589411,"threads_started":2,"wal-append.queue_time_us":293617}
I20260709 13:07:27.749665 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:27.754698 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 576) took 2579 ms. Trace:
I20260709 13:07:27.755242 15727 rpcz_store.cc:276] 0709 13:07:25.203746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.554678 (+1350932us) service_pool.cc:224] Handling call
0709 13:07:26.554937 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.555140 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.555164 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.555567 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.033673 (+478106us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.033713 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.033786 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.754437 (+720651us) raft_consensus.cc:1685] finished
0709 13:07:27.754464 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.754624 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":477773,"threads_started":1,"wal-append.queue_time_us":559224}
I20260709 13:07:27.757434 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.758466 15544 leader_election.cc:400] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:27.759037 15544 leader_election.cc:403] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.759538 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.649246 18385 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:07:27.715956 18650 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.763149 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:27.763525 15473 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.766336 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:27.768301 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58171.9us
W20260709 13:07:27.735927 18573 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.004s
W20260709 13:07:27.818814 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 55787.9us
I20260709 13:07:27.822590 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:27.824590 15727 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:07:27.863399 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.753343 18653 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:27.864450 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.761649 18422 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.867430 15473 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 5 to 6, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:27.868660 18730 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:27.871155 18729 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:27.761065 18642 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:27.874599 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:27.774928 18739 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:27.824222 18650 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:27.877182 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.879783 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.769802 18706 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
W20260709 13:07:27.827504 18723 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:07:27.824045 18570 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.875538 18566 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.942871 18324 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:27.943248 18732 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:07:27.899621 15473 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.880319 18422 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:27.904902 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:27.876879 15652 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:27.906849 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 87450.2us
I20260709 13:07:27.876139 18501 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:27.888230 18717 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 13:07:27.881844 18658 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.820367 18728 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.135s
W20260709 13:07:27.941507 16236 connection.cc:256] RPC call timeout handler was delayed by -2.2391480569999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2818s for a response
I20260709 13:07:27.942945 18566 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.823302 18693 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:27.893014 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:27.903059 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:27.975327 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:27.866954 18725 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:27.824810 18573 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:27.967547 16236 connection.cc:256] RPC call timeout handler was delayed by -2.1522621980000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:07:27.938932 18570 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:27.909083 18678 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.980221 15473 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.974717 18566 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:28.009232 16236 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.559s (SENT)
I20260709 13:07:27.862913 18645 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:28.017153 18501 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:28.019609 18501 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.019961 18501 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:28.021763 18574 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.876s	user 0.014s	sys 0.000s
I20260709 13:07:27.914297 18741 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:07:28.022414 15727 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:27.963348 18324 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:28.023787 18324 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.024161 18324 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:28.024681 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.025347 15727 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:28.030225 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.009105 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:27.943262 18654 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:27.938886 18739 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:28.016388 18570 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:28.014359 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 111343us
I20260709 13:07:28.015535 15473 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.911186 18642 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:27.962570 18658 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.938643 18685 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:28.016876 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 270348us
I20260709 13:07:28.023113 18498 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:27.962484 18451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.003s	sys 0.011s
W20260709 13:07:28.026533 18740 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:28.072631 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:28.095911 18451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.013s
I20260709 13:07:28.024968 18324 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.015021 18734 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:28.040503 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2253) took 1016 ms. Trace:
W20260709 13:07:28.043177 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 592364us
I20260709 13:07:28.089200 18633 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:28.109649 18654 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:28.043883 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.110332 18654 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.110531 18324 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:28.042335 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 493946us
I20260709 13:07:28.012184 18554 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.015187 18725 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.063449 15727 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.063647 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54597.1us
I20260709 13:07:28.047693 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.068022 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.115645 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:28.115849 15473 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.116626 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.117239 15728 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:28.018810 18566 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.067579 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:28.119573 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:28.062573 18603 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
I20260709 13:07:28.072122 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.117481 15473 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 5, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.121156 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.121984 15728 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
W20260709 13:07:28.018185 16236 connection.cc:256] RPC call timeout handler was delayed by -2.090796381999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:07:28.108820 15722 rpcz_store.cc:276] 0709 13:07:27.024479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.024662 (+   183us) service_pool.cc:224] Handling call
0709 13:07:27.047879 (+ 23217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.299333 (+251454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.299378 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.312324 (+ 12946us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.824574 (+512250us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:27.824615 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.824699 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.040253 (+215554us) raft_consensus.cc:1685] finished
0709 13:07:28.040272 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.040430 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713,"raft.queue_time_us":49621,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5281,"thread_start_us":710586,"threads_started":2,"wal-append.queue_time_us":626273}
I20260709 13:07:28.109876 18658 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.110724 18654 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.014707 18385 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.961015 18422 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:28.063408 18525 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.012s	user 0.004s	sys 0.012s
I20260709 13:07:28.010207 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.089092 18507 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.124089 15473 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 5, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.124097 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:28.103603 18705 consensus_meta.cc:287] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.001s
I20260709 13:07:28.127914 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:28.136744 15728 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:28.141762 15650 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:28.064713 18574 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:28.126734 18703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.012s	sys 0.034s
W20260709 13:07:28.127120 18682 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:07:28.148151 18642 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.149215 18573 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:28.161734 16236 connection.cc:256] RPC call timeout handler was delayed by -2.0436940719999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:07:28.162202 16236 connection.cc:256] RPC call timeout handler was delayed by -1.8273332679999612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:07:28.150753 18425 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:07:28.151346 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:28.151796 18697 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.974s	user 0.000s	sys 0.003s
I20260709 13:07:28.118934 18739 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:28.154882 16237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.021s	sys 0.039s
I20260709 13:07:28.136404 18645 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:28.156598 15618 leader_election.cc:400] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6.
I20260709 13:07:28.059619 18543 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:28.134454 18385 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.158762 15473 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.134552 18650 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:28.162501 16236 connection.cc:256] RPC call timeout handler was delayed by -1.7134958120000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
I20260709 13:07:28.073244 18500 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:07:28.156577 18703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.012s	sys 0.034s
I20260709 13:07:28.145515 18451 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:28.193042 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:28.176504 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50459.9us
W20260709 13:07:28.253897 16237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.021s	sys 0.048s
W20260709 13:07:28.155699 18700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.001s	sys 0.021s
I20260709 13:07:28.149966 18104 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:28.252682 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96220.2us
I20260709 13:07:28.204282 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:28.229285 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.274278 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.259121 15473 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 1 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 3 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.260627 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.145759 18498 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.263262 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:28.266527 18719 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.820s	user 0.007s	sys 0.000s
I20260709 13:07:28.267210 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 571) took 3093 ms. Trace:
I20260709 13:07:28.279896 15729 rpcz_store.cc:276] 0709 13:07:25.173407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.479123 (+1305716us) service_pool.cc:224] Handling call
0709 13:07:26.479500 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.561594 (+ 82094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.561626 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.562205 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.018626 (+456421us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.018664 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.018727 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.151263 (+1132536us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:28.266868 (+115605us) raft_consensus.cc:1685] finished
0709 13:07:28.266894 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.267141 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81655,"raft.queue_time_us":87857,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":20071296,"thread_start_us":423263,"threads_started":1,"wal-append.queue_time_us":508060}
I20260709 13:07:28.268033 18725 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:28.270387 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.270766 18754 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:28.159514 18693 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.277290 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:28.203979 18553 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.278752 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.253096 18451 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:28.158766 18685 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:28.224720 18677 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.176515 18425 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:28.273522 18700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.002s	sys 0.022s
W20260709 13:07:28.297631 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.260977 18385 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.154217 18705 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.164476 18682 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.282267 15473 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:28.297494 18701 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.342409 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:28.329246 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.161232 18527 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:07:28.272879 18528 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.331583 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:28.153563 18507 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.191974 17976 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:07:28.339138 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.334285 18678 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.365098 15725 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:28.366752 15723 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.357602 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.367643 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.323758 15654 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:28.330497 18483 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.647s	user 0.003s	sys 0.007s
W20260709 13:07:28.329902 18665 consensus_meta.cc:287] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.926s	user 0.006s	sys 0.006s
I20260709 13:07:28.296198 18693 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:28.345099 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.345383 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.345593 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.373847 15720 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:28.374357 16272 raft_consensus.cc:2410] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:28.298468 18498 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:28.298219 18553 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:28.324862 18685 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:28.351886 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.285638 18501 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.377314 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.355969 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2231) took 1263 ms. Trace:
I20260709 13:07:28.356217 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.383919 16276 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.368341 16269 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:28.382434 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:28.386895 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.387501 18577 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:28.387959 18577 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:28.388218 18702 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 13:07:28.387729 16275 raft_consensus.cc:2410] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:28.389719 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.390569 15649 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:28.390479 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.391554 16277 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:28.383682 15648 rpcz_store.cc:276] 0709 13:07:27.092602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.155939 (+ 63337us) service_pool.cc:224] Handling call
0709 13:07:27.156240 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.156530 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.156568 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.156931 (+   363us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.275138 (+118207us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.275192 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.275285 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.265715 (+990430us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:28.355690 (+ 89975us) raft_consensus.cc:1685] finished
0709 13:07:28.355712 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.355913 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13919,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3839,"spinlock_wait_cycles":103416192,"thread_start_us":117840,"threads_started":1,"wal-append.queue_time_us":194741}
I20260709 13:07:28.393160 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.394297 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.336671 18728 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:28.399490 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:28.399092 18519 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.368898 18570 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.401386 18750 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:28.402275 18711 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:07:28.402855 18570 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:28.402407 18766 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:07:28.372623 18672 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.392673 18702 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.357627 18528 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.412425 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:28.375414 18693 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.410580 18577 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.419149 18705 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.420410 18682 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.439881 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:28.441053 15577 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:28.417608 16276 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:28.370719 18678 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.373046 18483 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.382543 18665 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.446118 15577 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:28.395640 18554 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:28.367267 18451 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.447818 18507 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.447572 18658 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.448099 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:28.448472 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:28.448302 18498 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.450618 18702 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.451659 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:28.473389 15576 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:28.443997 18553 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.453817 15646 raft_consensus.cc:2376] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6. Re-sending same reply.
I20260709 13:07:28.474997 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:28.414849 18672 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:28.475611 18672 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.475831 18483 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.464151 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:28.425149 18759 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:28.467089 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.479033 15648 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:28.399336 18422 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.433835 18570 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.435999 18501 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.453411 18766 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:28.485116 18766 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:28.485569 18772 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:28.440297 18685 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.476200 18425 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.483114 15580 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:28.486752 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 109492us
I20260709 13:07:28.472744 18507 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.473270 18554 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.491981 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:28.492735 18685 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.493052 18658 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.477147 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:28.494907 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.497587 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.461527 18654 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.520140 15577 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:28.484110 18451 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.494508 18501 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.527427 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.528748 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.529697 16275 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:28.587854 18762 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:28.486088 18772 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.528795 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.486258 18766 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.508478 18554 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.521306 18651 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:28.534719 18501 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.592377 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.520521 18483 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:28.519856 18682 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.495335 18570 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.494432 18507 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:28.624450 18767 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.079s	user 0.003s	sys 0.003s
I20260709 13:07:28.597975 16275 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:28.602121 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73422.7us
W20260709 13:07:28.606190 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.606130 18772 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.606959 18700 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:28.608843 18731 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.877s	user 0.005s	sys 0.004s
I20260709 13:07:28.611467 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.618698 16274 raft_consensus.cc:2393] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:28.519520 18425 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.650892 18756 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.623378 18528 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.626085 18682 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.634102 18507 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.621366 18766 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:28.666762 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.674005 18525 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:28.679873 18422 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.680122 18525 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.681859 18570 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.650352 18702 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.634334 18651 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:28.706527 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.659003 18701 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.659674 18678 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.690929 18385 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.702410 18654 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:28.704582 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.666478 18703 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.686085 18770 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.007s
I20260709 13:07:28.721037 18501 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.669101 18425 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:28.668087 18756 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.656440 18731 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.685829 18525 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.687072 18682 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:28.732548 18507 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.679944 18757 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.760080 15721 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:28.751825 18554 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.733347 18693 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.733600 18702 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.752178 18674 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:28.740326 18703 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.732343 18701 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.810988 15575 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:28.787513 18385 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:28.793532 18566 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.010s
W20260709 13:07:28.824810 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.836314 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.837222 15726 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:28.841006 15726 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:28.795760 18668 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.841969 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:28.843065 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.843314 15722 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.843976 15726 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:28.843369 15724 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:28.847391 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 470536us
I20260709 13:07:28.847407 15722 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:28.796686 18651 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.854513 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:28.854811 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:28.855944 15726 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:28.857412 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.858537 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.859699 15726 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:28.861620 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.863042 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.863785 15724 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:28.871582 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:28.872525 15726 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:28.873970 15722 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.785461 18757 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:28.877601 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.880472 18756 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.796257 18425 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.841876 18566 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.886579 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:28.887619 15724 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:28.879325 18104 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.004s
I20260709 13:07:28.889671 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.890364 16270 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:28.886102 18733 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.895455 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.895980 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.896387 16278 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.896668 16270 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
W20260709 13:07:28.898650 15572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 571) took 1531 ms (client timeout 1729 ms). Trace:
W20260709 13:07:28.899035 15572 rpcz_store.cc:269] 0709 13:07:27.367732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.370526 (+  2794us) service_pool.cc:224] Handling call
0709 13:07:28.898502 (+1527976us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:28.898595 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132737408}
I20260709 13:07:28.883955 18531 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.900274 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:28.901005 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:28.878782 18501 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:28.863160 18668 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.902693 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.908754 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.909039 15724 raft_consensus.cc:2410] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:28.883671 18651 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:07:28.910108 16270 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:28.911389 18728 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.911839 18728 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.912194 18728 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.912338 18731 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:28.914058 18501 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.914418 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.916286 18501 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:28.917802 18718 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.342s	user 0.000s	sys 0.004s
I20260709 13:07:28.922889 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.895553 18434 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:28.884953 18528 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:07:28.898211 18642 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.893524 18756 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:07:28.886319 18498 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:28.907543 18531 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.935292 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 3.
I20260709 13:07:28.928810 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.953817 16278 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:07:28.960816 15692 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.020s
I20260709 13:07:28.955515 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:28.961530 15692 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.013s	sys 0.020s
I20260709 13:07:28.922412 18674 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:28.956969 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.968557 15543 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:28.961810 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 518820us
I20260709 13:07:28.969367 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.970199 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:28.971143 16278 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:28.953305 18729 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:28.910676 18733 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:28.974094 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.978574 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:28.994534 16278 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.004323 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:28.962110 18531 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.963092 18528 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.009949 16278 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:29.005149 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:28.972239 18702 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.032631 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.033928 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.034547 15654 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.982889 18585 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.040941 18537 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.041600 18537 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:28.984139 18674 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.044705 18674 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.006788 18729 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:29.046329 18729 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.047422 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2236) took 1001 ms. Trace:
I20260709 13:07:29.047837 15650 rpcz_store.cc:276] 0709 13:07:28.045777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.046600 (+   823us) service_pool.cc:224] Handling call
0709 13:07:29.047240 (+1000640us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5400156154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.047360 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49068800}
I20260709 13:07:29.048960 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.050540 18566 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.050937 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.009886 18703 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.051502 15649 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.055253 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.055866 15646 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:29.056579 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.049938 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:28.956377 18434 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:29.014374 18778 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:07:29.018076 18699 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.018522 18757 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.019356 15543 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:29.072609 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2222) took 2019 ms. Trace:
W20260709 13:07:29.072830 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53577.1us
I20260709 13:07:29.012600 16272 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:29.002251 18693 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.013363 18433 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.023350 18685 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:29.023757 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1704) took 2370 ms. Trace:
I20260709 13:07:29.024336 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:29.029083 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:29.155197 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 126202us
W20260709 13:07:29.155331 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 131065us
I20260709 13:07:29.156038 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.042718 18537 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:28.973591 18501 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.061503 15654 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:29.126220 18372 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:29.062383 15649 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:29.063917 15726 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:29.066169 15720 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:29.071017 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:29.020587 16270 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:07:29.128928 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 246256us
I20260709 13:07:29.091241 15543 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:29.073144 15647 rpcz_store.cc:276] 0709 13:07:27.052904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.154892 (+101988us) service_pool.cc:224] Handling call
0709 13:07:27.155244 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.155589 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.155624 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.156051 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.363506 (+207455us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.363559 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.363652 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.917214 (+1553562us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:29.060256 (+143042us) raft_consensus.cc:1685] finished
0709 13:07:29.060286 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.072528 (+ 12242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13457,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3568,"spinlock_wait_cycles":25130752,"thread_start_us":207029,"threads_started":1,"wal-append.queue_time_us":359063}
I20260709 13:07:29.010756 18528 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:29.087131 18699 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.093354 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.091941 18566 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.211086 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:28.961054 18642 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:29.146332 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.150274 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.157218 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:29.165977 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.213009 15651 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:29.203246 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.213604 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56418.7us
I20260709 13:07:29.214074 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.203415 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:29.151477 18451 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.007s
I20260709 13:07:29.146873 18768 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.216298 18768 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.217475 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.218300 15654 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.095381 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.201154 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.213830 15726 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:29.214941 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:29.219369 15649 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:29.219585 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.219830 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.208699 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.220077 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:29.220167 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.220834 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.221577 18451 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:29.221704 18525 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:29.222057 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.222218 18451 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.222374 18525 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.222788 18451 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.225025 18525 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.220928 15649 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:29.209208 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 118048us
I20260709 13:07:29.230638 15543 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:29.238478 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.239151 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:29.241159 15578 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:07:29.243307 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.243688 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:29.214620 15720 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:29.244650 15651 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.245348 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.245937 15720 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:29.175377 18425 raft_consensus.cc:2764] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:29.175127 18716 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.258198 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.248627 15578 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.258821 15650 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.259971 15574 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:29.260064 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:29.174631 18668 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:29.178006 18585 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.219046 18768 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:29.232457 15653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2230) took 2140 ms (client timeout 2218 ms). Trace:
I20260709 13:07:29.249027 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:29.251869 15649 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:29.266379 15653 rpcz_store.cc:269] 0709 13:07:27.092335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.149433 (+ 57098us) service_pool.cc:224] Handling call
0709 13:07:29.232250 (+2082817us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400156654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.232401 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276567808}
I20260709 13:07:29.267426 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.152253 18433 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:29.174227 15652 rpcz_store.cc:276] 0709 13:07:26.653072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.653211 (+   139us) service_pool.cc:224] Handling call
0709 13:07:26.653669 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.962394 (+1308725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.023439 (+1061045us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:29.023678 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681597312}
I20260709 13:07:29.247115 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.267534 15543 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:29.232187 18685 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.257136 15654 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:29.211544 18566 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.232992 18693 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.263427 15580 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.280455 15654 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.268011 15653 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.176404 18501 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.269174 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.265367 15576 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:29.254144 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:29.286746 15651 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.247583 18422 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:29.247846 18570 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.249485 18537 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:29.263005 18709 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.735s	user 0.047s	sys 0.051s
W20260709 13:07:29.313685 18709 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.806s	user 0.047s	sys 0.052s
I20260709 13:07:29.252228 18731 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.292887 18501 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.316707 18699 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.279987 18566 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.265089 18682 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.286844 15724 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:29.318329 15651 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:29.232899 18372 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.276010 18554 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.319375 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.319479 18554 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.319952 18554 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.319974 15651 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:29.320439 18372 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.265973 18385 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.312476 18570 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.323019 18642 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.323684 18570 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.278090 18425 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:29.257959 18507 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:29.306748 18728 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.306880 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:29.325672 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:29.290930 18773 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:07:29.279098 18768 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.329655 15650 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:29.280283 18693 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.324759 18507 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:29.352312 18507 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.329762 18682 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:29.355285 15725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1839) took 1843 ms (client timeout 1743 ms). Trace:
I20260709 13:07:29.354926 18682 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:29.355871 15725 rpcz_store.cc:269] 0709 13:07:27.512056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.537061 (+ 25005us) service_pool.cc:224] Handling call
0709 13:07:29.354978 (+1817917us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b5400399c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.355169 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901556096}
I20260709 13:07:29.357686 15725 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.332863 18531 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:29.333757 18782 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:07:29.278164 18668 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:29.281662 18776 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:07:29.340523 18701 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.290380 18528 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.388365 18528 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.343029 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.394924 15647 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:29.343726 18680 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.396162 18680 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:29.397177 18680 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.398416 18680 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:29.401921 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.330052 18385 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:29.403563 18385 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.360280 18553 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.360826 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.407047 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.407595 15655 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:29.408665 15655 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:29.409188 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 571) took 1042 ms. Trace:
I20260709 13:07:29.409472 15655 rpcz_store.cc:276] 0709 13:07:28.366488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.408173 (+1041685us) service_pool.cc:224] Handling call
0709 13:07:29.408460 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.408967 (+   507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.409137 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:29.361753 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2266) took 1590 ms (client timeout 2035 ms). Trace:
W20260709 13:07:29.411207 15721 rpcz_store.cc:269] 0709 13:07:27.771696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.009937 (+238241us) service_pool.cc:224] Handling call
0709 13:07:29.361550 (+1351613us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540004a454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.361693 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434186112}
I20260709 13:07:29.413218 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.413960 15647 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:29.415122 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:29.415952 18570 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:29.416474 18570 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.416878 18570 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.417169 18701 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.417704 18701 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.419842 18701 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.416491 15647 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.293807 18422 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:29.290356 18733 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:29.334069 18577 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.371641 16269 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:29.333124 18672 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.006s
W20260709 13:07:29.334357 18781 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:07:29.373145 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.328642 18525 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.331166 18716 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:07:29.362390 18693 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.492091 18501 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.375710 18705 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.494292 18705 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.375608 18728 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.375487 18451 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.376626 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.377751 15646 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:29.496292 18705 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.496693 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1715) took 1178 ms. Trace:
I20260709 13:07:29.497013 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:29.497099 15646 rpcz_store.cc:276] 0709 13:07:28.318448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.056382 (+737934us) service_pool.cc:224] Handling call
0709 13:07:29.496529 (+440147us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540006a9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.496641 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737143168}
I20260709 13:07:29.498073 18716 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.498360 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:29.377274 18729 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:29.499620 15729 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:29.329716 18642 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.500674 18642 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:29.378520 15619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.743s (SENT) [suppressed 19 similar messages]
I20260709 13:07:29.501597 18642 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.424461 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.502925 15721 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.425957 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 572) took 1052 ms. Trace:
I20260709 13:07:29.506287 18668 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.506598 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1661) took 1040 ms. Trace:
I20260709 13:07:29.506839 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:29.506948 18668 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.425796 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 573) took 1048 ms. Trace:
I20260709 13:07:29.507753 15655 rpcz_store.cc:276] 0709 13:07:28.377587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.424117 (+1046530us) service_pool.cc:224] Handling call
0709 13:07:29.425287 (+  1170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.425454 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.425479 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.425569 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:29.425598 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.425650 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.425742 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.506183 15647 rpcz_store.cc:276] 0709 13:07:28.373103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.416018 (+1042915us) service_pool.cc:224] Handling call
0709 13:07:29.416320 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.425631 (+  9311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.425884 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.375531 18531 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:29.458489 18766 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.759s	user 0.000s	sys 0.012s
I20260709 13:07:29.460403 18570 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.304616 18687 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:07:29.465937 18553 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:29.474893 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.371313 18768 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:29.482808 18665 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.483544 18434 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.566706 16270 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:29.484666 18525 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.464438 18422 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.486707 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1663) took 1013 ms. Trace:
I20260709 13:07:29.446010 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.498492 18716 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:29.424388 15653 raft_consensus.cc:2410] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:29.364174 15725 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.582183 15651 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.507077 15575 rpcz_store.cc:276] 0709 13:07:28.466152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.470110 (+  3958us) service_pool.cc:224] Handling call
0709 13:07:29.506410 (+1036300us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400370354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.506539 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770671360}
I20260709 13:07:29.508008 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:29.518157 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.525131 15721 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:29.507469 18668 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.496955 18451 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.539348 18728 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:29.563010 18791 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:29.564409 16274 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:29.546861 18553 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:29.574530 15577 rpcz_store.cc:276] 0709 13:07:28.473767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.476852 (+  3085us) service_pool.cc:224] Handling call
0709 13:07:29.486526 (+1009674us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b54003f98d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.486654 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20600192}
I20260709 13:07:29.487241 18776 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:29.583377 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 75461.8us
I20260709 13:07:29.584806 18665 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.584213 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 138310us
I20260709 13:07:29.589403 15650 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:29.476372 18672 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.584992 18434 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.613204 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 352067us
I20260709 13:07:29.591697 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.571486 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 574) took 1183 ms. Trace:
I20260709 13:07:29.593674 16274 pending_rounds.cc:85] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 6
I20260709 13:07:29.565761 18768 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.614108 15575 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:29.613976 15646 rpcz_store.cc:276] 0709 13:07:28.388156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.570487 (+1182331us) service_pool.cc:224] Handling call
0709 13:07:29.570853 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.571063 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.571100 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.571154 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:29.571201 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.571268 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.571417 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.614109 16274 pending_rounds.cc:107] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:29.615598 16274 raft_consensus.cc:2889] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.604678 15579 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:29.605894 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.616719 15577 raft_consensus.cc:2410] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:29.591001 18577 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.589217 18528 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:29.605777 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.628463 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.626888 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.627019 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.628706 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.632339 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.632174 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.629351 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:29.624300 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 353045us
I20260709 13:07:29.637212 15648 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:29.639420 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.642704 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:29.644313 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.645522 15721 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:29.645881 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.648545 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.649585 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.656446 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.658492 15721 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:29.605221 18728 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:29.613241 18630 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.635641 18641 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.625687 18434 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:29.671191 18795 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:07:29.671631 18739 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:29.640039 18553 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.677030 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.678256 18501 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.679092 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.684515 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.712073 15576 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:29.685904 18525 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.604260 18665 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.629585 18577 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:29.665584 16236 leader_election.cc:336] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.698s (SENT)
I20260709 13:07:29.693780 18543 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.659957 18531 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.613708 18776 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.659708 18537 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:29.742236 18553 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.743012 18537 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.743499 18537 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:29.744539 18537 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.747699 18776 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.747285 18728 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.750072 18755 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.750639 18755 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.752553 18755 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.753961 18566 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.756099 18566 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.636211 18716 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.757246 18716 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:29.760854 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.766724 18528 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:29.767769 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.768419 15724 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:29.769271 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.772819 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2240) took 1455 ms. Trace:
I20260709 13:07:29.773200 15649 rpcz_store.cc:276] 0709 13:07:28.316970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.267322 (+950352us) service_pool.cc:224] Handling call
0709 13:07:29.267680 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.268174 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.268199 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.275229 (+  7030us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.585745 (+310516us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:29.585784 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.585847 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.772626 (+186779us) raft_consensus.cc:1685] finished
0709 13:07:29.772646 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.772767 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23859,"raft.queue_time_us":4604,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4829,"thread_start_us":307602,"threads_started":1,"wal-append.queue_time_us":430655}
I20260709 13:07:29.778908 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 620) took 1252 ms. Trace:
I20260709 13:07:29.779407 16273 rpcz_store.cc:276] 0709 13:07:28.526911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.527088 (+   177us) service_pool.cc:224] Handling call
0709 13:07:29.778704 (+1251616us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540073ebd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.778839 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336974208}
I20260709 13:07:29.782616 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.783416 18672 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.784160 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.784893 15722 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:29.787554 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.788329 15580 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:29.792281 18665 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:29.794673 18570 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.660744 18554 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.795573 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 562) took 1631 ms. Trace:
I20260709 13:07:29.795991 15648 rpcz_store.cc:276] 0709 13:07:28.163825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.479832 (+316007us) service_pool.cc:224] Handling call
0709 13:07:29.795326 (+1315494us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540006a754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:29.795507 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569258240}
I20260709 13:07:29.796986 18554 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.726493 18577 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.799365 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.800379 15577 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:29.801452 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.796015 15572 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:29.805267 15577 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.785770 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.807587 15722 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:29.709878 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.701228 18712 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:29.718487 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.718998 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:29.719872 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.815554 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 150008us
I20260709 13:07:29.815853 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.816457 15725 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.720189 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.817404 15721 raft_consensus.cc:2368] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:29.794740 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.818254 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.818979 15721 raft_consensus.cc:2368] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5.
I20260709 13:07:29.819777 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.820399 15721 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6.
I20260709 13:07:29.685658 18693 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.726935 18543 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:29.734452 18701 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.735301 18434 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:29.697726 18630 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.738277 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2241) took 1421 ms. Trace:
I20260709 13:07:29.837013 15725 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:29.738641 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:29.739701 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 97104.7us
I20260709 13:07:29.740222 18709 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:29.819033 15655 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.822770 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.838961 15729 raft_consensus.cc:2368] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:29.839771 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:29.840641 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.840754 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.822930 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.841537 15577 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:29.829969 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:29.842442 15724 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 4: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:29.832973 18543 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.834561 18691 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.789824 18422 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.818822 18570 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:29.843065 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.844223 15727 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:29.818572 18712 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:29.845715 15618 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.875833 15727 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:07:29.846649 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.881281 15729 raft_consensus.cc:2410] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:29.837509 15652 rpcz_store.cc:276] 0709 13:07:28.317272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.272882 (+955610us) service_pool.cc:224] Handling call
0709 13:07:29.282660 (+  9778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.282870 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.282895 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.283308 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:07:29.593111 (+309803us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:29.593174 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.593274 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.738049 (+144775us) raft_consensus.cc:1685] finished
0709 13:07:29.738070 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.738217 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":279241,"threads_started":1,"wal-append.queue_time_us":431256}
I20260709 13:07:29.848259 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.817924 18653 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.884907 15575 raft_consensus.cc:2393] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:29.841905 15721 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.882431 15580 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.884227 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.889801 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.890672 15724 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:29.892266 15724 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:29.882881 15725 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:07:29.883875 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:29.893842 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48239us
I20260709 13:07:29.894878 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.896687 15725 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:29.898803 15654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.028s	sys 0.016s
W20260709 13:07:29.899240 15654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.028s	sys 0.016s
I20260709 13:07:29.901852 15722 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:29.903692 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:29.888653 15576 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
W20260709 13:07:29.908046 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.829252 18537 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.911374 15721 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:29.913120 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.846315 18709 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.883987 18543 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:29.918619 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.895248 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:29.919656 15618 connection.cc:256] RPC call timeout handler was delayed by -1.0806395790000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:07:29.920737 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:29.921558 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.850486 18691 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:29.937312 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:29.939314 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.922219 15576 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:29.940903 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.941658 15576 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:29.942713 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:29.943603 15576 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:29.875842 18797 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:29.948045 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:29.951574 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:29.954581 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.960958 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.963582 18433 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:29.965081 18433 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.967912 18712 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:29.969336 18712 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.970916 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:29.895606 18798 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.992663 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.995146 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:29.996416 15576 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:29.932961 18422 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:29.903195 18701 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.000370 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.906174 18755 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.002990 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:30.003957 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:30.006796 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58863.2us
I20260709 13:07:29.918363 18785 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.885499 18570 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.000676 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:29.922459 18709 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.023900 15724 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:30.016268 15576 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:29.946113 18528 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.945338 18682 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.993563 18385 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.836946 18668 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:30.025735 15619 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.035s
I20260709 13:07:30.037328 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1717) took 1718 ms. Trace:
I20260709 13:07:30.042241 15651 rpcz_store.cc:276] 0709 13:07:28.319040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.320710 (+1001670us) service_pool.cc:224] Handling call
0709 13:07:29.581936 (+261226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.582687 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.037059 (+454372us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540024aed0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:30.037249 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600067456}
I20260709 13:07:30.044028 15651 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:30.044834 15619 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.017s	sys 0.035s
W20260709 13:07:30.045315 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 666767us
W20260709 13:07:30.049523 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.050680 15651 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:30.026158 18603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.025s	sys 0.028s
I20260709 13:07:30.013932 18451 raft_consensus.cc:2764] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:07:30.057955 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.060448 18489 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.062424 18570 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.069024 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:30.059108 18603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.026s	sys 0.028s
I20260709 13:07:30.002010 18797 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.094527 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:30.008083 18798 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.094466 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2286) took 1020 ms. Trace:
I20260709 13:07:30.008306 15721 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:30.050999 18755 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:30.109218 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:30.109534 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:30.105011 15726 rpcz_store.cc:276] 0709 13:07:29.074628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.222852 (+148224us) service_pool.cc:224] Handling call
0709 13:07:29.223130 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.223308 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:29.598231 (+374923us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.007660 (+409429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.007731 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.007797 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.008629 (+   832us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.094413 (+ 85784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25682,"prepare.queue_time_us":57129,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":6985,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3305,"thread_start_us":739270,"threads_started":2}
I20260709 13:07:30.117112 15722 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:30.122571 16271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.014s
W20260709 13:07:30.130782 16271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.015s
I20260709 13:07:30.134198 18797 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.137127 18642 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.147951 18630 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:30.064010 18691 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.160449 18691 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.172971 18693 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.206624 18798 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:30.215858 18804 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:07:30.220096 18803 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 13:07:30.266120 15574 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.272974 15576 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:30.012720 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.274267 15575 raft_consensus.cc:606] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:30.275714 15576 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.299816 15576 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:30.303367 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.304740 15646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.004s	sys 0.034s
W20260709 13:07:30.305295 15646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.004s	sys 0.034s
I20260709 13:07:30.306766 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1725) took 1280 ms. Trace:
I20260709 13:07:30.309072 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2252) took 1183 ms. Trace:
I20260709 13:07:30.309262 18104 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:30.311260 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.310765 18104 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.313285 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 576) took 1065 ms. Trace:
W20260709 13:07:30.314674 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 497781us
I20260709 13:07:30.314971 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1714) took 1996 ms. Trace:
I20260709 13:07:30.315847 18104 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:30.318346 18507 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:30.319272 18507 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.319944 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1052) took 1034 ms. Trace:
I20260709 13:07:30.320508 18687 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.320436 16270 rpcz_store.cc:276] 0709 13:07:29.285720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.285849 (+   129us) service_pool.cc:224] Handling call
0709 13:07:30.319361 (+1033512us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400090454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:30.319601 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553465728}
I20260709 13:07:30.321532 18687 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.325325 18687 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:30.327737 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.331501 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1050) took 1047 ms. Trace:
W20260709 13:07:30.303547 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.273741 15572 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.313884 15653 rpcz_store.cc:276] 0709 13:07:29.247770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.014847 (+767077us) service_pool.cc:224] Handling call
0709 13:07:30.015150 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.059174 (+ 44024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.059211 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.059251 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.059288 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.312607 (+253319us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b5400084154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:30.312690 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.313027 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100691840}
I20260709 13:07:30.332037 18668 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:30.397905 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.398720 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.399204 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.315407 15654 rpcz_store.cc:276] 0709 13:07:28.318118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.281231 (+963113us) service_pool.cc:224] Handling call
0709 13:07:29.307148 (+ 25917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.323799 (+ 16651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.323845 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.324456 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:07:29.899659 (+575203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:29.948743 (+ 49084us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.949518 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.949600 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.220748 (+271148us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b180002cf80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:30.314263 (+ 93515us) raft_consensus.cc:1685] finished
0709 13:07:30.314500 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.314795 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16173,"prepare.queue_time_us":105179,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":62999,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":34907,"spinlock_wait_cycles":9645824,"thread_start_us":574800,"threads_started":1,"wal-append.queue_time_us":788378}
I20260709 13:07:30.410791 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.412017 18733 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:30.416157 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1721) took 2027 ms. Trace:
I20260709 13:07:30.416731 15655 rpcz_store.cc:276] 0709 13:07:28.388976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.573001 (+1184025us) service_pool.cc:224] Handling call
0709 13:07:29.803041 (+230040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.844897 (+ 41856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.415603 (+570706us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540006a750. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:30.415929 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528169856}
W20260709 13:07:30.418434 18716 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.007s
W20260709 13:07:30.422472 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 409678us
I20260709 13:07:30.423914 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:30.426157 15571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.025s	sys 0.042s
W20260709 13:07:30.426661 15571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.026s	sys 0.042s
I20260709 13:07:30.307350 15646 rpcz_store.cc:276] 0709 13:07:29.025998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.614994 (+588996us) service_pool.cc:224] Handling call
0709 13:07:29.615323 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.615662 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.615691 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.626580 (+ 10889us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.306187 (+679607us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:30.306304 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.306431 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.306473 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:30.306484 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.306661 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420,"raft.queue_time_us":433,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":16238,"thread_start_us":612441,"threads_started":1,"wal-append.queue_time_us":560402}
I20260709 13:07:30.434751 15577 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:30.332042 16271 rpcz_store.cc:276] 0709 13:07:29.283928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.284067 (+   139us) service_pool.cc:224] Handling call
0709 13:07:29.311701 (+ 27634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.311915 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:29.607208 (+295293us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.330537 (+723329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.330684 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.330836 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.330987 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.331246 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":478198,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"thread_start_us":819615,"threads_started":2,"wal-append.queue_time_us":585640}
I20260709 13:07:30.393723 18507 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:30.435906 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.434744 18451 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.440066 16270 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:30.440629 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.441594 16273 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.448724 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.449149 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.449846 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.450734 16269 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.454950 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.455929 16276 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.456629 18716 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:30.449855 16275 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:30.458281 18825 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.458909 18825 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:30.460425 18825 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.413203 18733 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.472762 18733 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.309670 15649 rpcz_store.cc:276] 0709 13:07:29.127207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.776061 (+648854us) service_pool.cc:224] Handling call
0709 13:07:29.776332 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.776533 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:29.822652 (+ 46119us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.308258 (+485606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.308370 (+   112us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.308496 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.308595 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.308836 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47021,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1247,"raft.queue_time_us":9876,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":425,"thread_start_us":484931,"threads_started":1,"wal-append.queue_time_us":376051}
I20260709 13:07:30.479401 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.480553 16272 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:30.447582 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:30.482709 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:30.483242 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57424.5us
I20260709 13:07:30.446308 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:30.485073 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 107648us
I20260709 13:07:30.485234 18828 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.488286 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.489226 15572 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:30.490262 18507 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.490942 18507 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.493109 18507 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:30.493445 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.494222 15577 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.494403 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.494714 16278 raft_consensus.cc:2368] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:30.499838 16273 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:30.477912 15580 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.003s
W20260709 13:07:30.508117 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 129426us
I20260709 13:07:30.495155 15575 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:30.518129 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.511953 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101552us
I20260709 13:07:30.523072 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.530215 18104 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:30.530508 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48015.9us
I20260709 13:07:30.530875 18104 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:30.531509 18104 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.532497 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:30.533854 18691 raft_consensus.cc:2764] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:30.534555 18641 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.540560 16277 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:30.540829 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.542725 18645 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:30.545084 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.548349 16270 raft_consensus.cc:2410] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:30.511282 18825 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.553748 15577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:30.538271 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.554746 15577 raft_consensus.cc:606] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:30.554697 16269 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:30.557188 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.555240 15577 raft_consensus.cc:614] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:30.541810 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.552385 15580 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:30.574193 16273 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:30.575351 16269 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:07:30.577034 18507 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.577545 18507 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.577941 18507 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.579798 18104 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.582579 18104 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:30.583652 18709 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.011s
I20260709 13:07:30.584316 18709 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.586109 15647 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.586711 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.570061 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.588428 16278 raft_consensus.cc:2368] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8.
I20260709 13:07:30.589107 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:30.588147 18489 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.006s
I20260709 13:07:30.595510 18709 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.599464 16274 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.602471 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.605533 18733 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.605835 16275 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.606069 15577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:07:30.606778 15577 raft_consensus.cc:606] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:30.607172 15577 raft_consensus.cc:614] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:30.610280 18765 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.610906 18765 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.612485 15573 raft_consensus.cc:2410] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:30.614112 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.614369 16269 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:30.614799 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.614936 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:30.615315 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1696) took 3288 ms (client timeout 3866 ms). Trace:
W20260709 13:07:30.615783 15573 rpcz_store.cc:269] 0709 13:07:27.327245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.327386 (+   141us) service_pool.cc:224] Handling call
0709 13:07:30.615036 (+3287650us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b5400109854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:30.615235 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7445586304}
I20260709 13:07:30.616189 18451 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.616637 18451 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.616816 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.617046 18451 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.617647 15649 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:30.619076 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.017s	sys 0.010s
I20260709 13:07:30.620469 18765 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:30.621229 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.017s	sys 0.011s
I20260709 13:07:30.631662 16277 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 4.
I20260709 13:07:30.622819 16272 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:30.639804 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 575) took 1435 ms. Trace:
I20260709 13:07:30.642730 16270 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.645483 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:30.605892 18543 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.667s	user 0.017s	sys 0.001s
I20260709 13:07:30.620580 18755 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.640399 15647 rpcz_store.cc:276] 0709 13:07:29.204892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.952786 (+747894us) service_pool.cc:224] Handling call
0709 13:07:29.953128 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.599944 (+646816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.633762 (+ 33818us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54002e4354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:30.639722 (+  5960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454740864}
W20260709 13:07:30.650120 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.650825 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:30.656375 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.664366 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:30.647778 18668 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.668237 18634 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:30.665396 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:30.660255 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:30.670259 18828 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.671773 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:07:30.672667 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 120731us
W20260709 13:07:30.673242 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.677448 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.677578 15653 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.676805 18634 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:30.675922 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 574730us
I20260709 13:07:30.683139 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1692) took 3364 ms. Trace:
I20260709 13:07:30.689189 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:30.697912 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2255) took 1535 ms. Trace:
I20260709 13:07:30.699283 15652 rpcz_store.cc:276] 0709 13:07:29.156150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.882102 (+725952us) service_pool.cc:224] Handling call
0709 13:07:29.907708 (+ 25606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.907898 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:30.404212 (+496314us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.658498 (+254286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.670291 (+ 11793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.679067 (+  8776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.680535 (+  1468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.691186 (+ 10651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28428,"prepare.queue_time_us":313158,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":8999,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":16350,"thread_start_us":639940,"threads_started":2}
I20260709 13:07:30.672021 18828 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.702482 18672 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.704483 18828 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:30.705109 18489 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:30.683328 18668 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.709067 18668 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:30.709749 18642 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.676482 18507 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.691329 18709 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:30.686008 15571 rpcz_store.cc:276] 0709 13:07:27.316541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.316720 (+   179us) service_pool.cc:224] Handling call
0709 13:07:27.317059 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.317280 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:27.444328 (+127048us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.818793 (+2374465us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180043fa80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:07:30.427225 (+608432us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.634167 (+206942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.640763 (+  6596us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.659582 (+ 18819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.664517 (+  4935us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.681161 (+ 16644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4548,"prepare.queue_time_us":334611,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":53,"raft.queue_time_us":43810,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":29670,"spinlock_wait_cycles":5410688,"thread_start_us":903257,"threads_started":3,"wal-append.queue_time_us":406731,"wal-append.run_cpu_time_us":16031,"wal-append.run_wall_time_us":1324054}
I20260709 13:07:30.721244 16272 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:30.723310 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:30.724961 18104 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.724972 18755 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:30.725674 18104 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:30.726202 18634 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.725871 18755 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.728664 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.726197 18104 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.729264 18825 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.730705 18755 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:30.731739 18701 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.006s
I20260709 13:07:30.732160 18701 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.711531 18642 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:30.734967 18577 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.912s	user 0.013s	sys 0.006s
W20260709 13:07:30.735811 18835 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.052s	user 0.003s	sys 0.001s
I20260709 13:07:30.729792 16273 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:30.735486 18577 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.713874 18709 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.739029 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:30.738904 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:30.740459 18709 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.745705 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2253) took 1578 ms. Trace:
W20260709 13:07:30.756070 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.746275 15648 rpcz_store.cc:276] 0709 13:07:29.149486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.797009 (+647523us) service_pool.cc:224] Handling call
0709 13:07:29.797440 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.797891 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.797925 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:29.822947 (+ 25022us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.424560 (+601613us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b1800450340. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:07:30.654671 (+230111us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.681653 (+ 26982us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.702153 (+ 20500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.704680 (+  2527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:30.719559 (+ 14879us) raft_consensus.cc:1685] finished
0709 13:07:30.722545 (+  2986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.727315 (+  4770us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3250,"prepare.queue_time_us":13051,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":21572,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":29988,"spinlock_wait_cycles":8554752,"thread_start_us":173261,"threads_started":1,"wal-append.queue_time_us":844871}
W20260709 13:07:30.756983 18537 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.830s	user 0.000s	sys 0.015s
I20260709 13:07:30.758154 18825 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.754074 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:30.753182 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.768548 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.769449 15653 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:30.754220 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:30.775665 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.770586 16269 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:30.779270 16274 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:30.781086 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.782419 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 85862.3us
I20260709 13:07:30.783411 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.755143 18507 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.776928 18755 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.784457 18733 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.784756 18755 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.767249 18642 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:30.750982 18104 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.788535 18645 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.789423 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:30.789839 18645 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:30.790378 18645 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.791887 18755 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.794399 18701 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.796216 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 618) took 1055 ms. Trace:
I20260709 13:07:30.797499 18672 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:30.796644 15727 rpcz_store.cc:276] 0709 13:07:29.741159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.876841 (+135682us) service_pool.cc:224] Handling call
0709 13:07:29.877094 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.056073 (+178979us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:30.398563 (+342490us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.598676 (+200113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.601165 (+  2489us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:30.637894 (+ 36729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.794602 (+156708us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800319c00. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928f42a6 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419
0709 13:07:30.795857 (+  1255us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000e4a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:30.795905 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.796041 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278535,"prepare.queue_time_us":40388,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":39425,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3561,"spinlock_wait_cycles":413690880,"thread_start_us":464659,"threads_started":2,"wal-append.queue_time_us":248833}
I20260709 13:07:30.799160 16273 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.800052 16275 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.801004 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.788704 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:30.802224 15619 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:30.803140 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.803539 18543 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.803853 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.803941 15647 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:30.789793 15543 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.802675 16278 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.802626 16273 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:30.805980 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.806068 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.806946 18489 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.807257 18733 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.807593 18489 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:30.808068 18634 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.808386 18755 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.808728 18634 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:30.808885 18755 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.809466 18755 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.808938 18489 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.809720 18634 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.810734 18765 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.807691 18733 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:30.804947 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.813162 18733 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.807631 18433 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:07:30.815471 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.816471 15652 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:30.817112 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.804036 18543 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.817811 18543 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.818578 18716 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:30.819133 18577 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:30.820927 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.821462 18729 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.821796 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:30.807140 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.823832 16278 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:30.804162 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:30.830436 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.836612 18641 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:30.834074 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47238.6us
I20260709 13:07:30.837210 18641 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:30.843130 16276 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.844815 18691 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:30.846211 18691 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.846555 18691 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:30.847548 18691 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.848850 18691 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.842526 18641 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.862161 15653 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:30.862658 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.864369 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.865666 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.866463 15571 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:07:30.873320 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.865756 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.880245 15653 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:30.851447 18543 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.881992 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.885567 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:30.886014 16270 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:30.885136 15543 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.892760 16269 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:30.893422 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.903357 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.905309 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:30.834352 18645 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.909505 18645 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.911820 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.913293 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.914281 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:30.914872 18689 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:30.883309 18825 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:30.889853 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.921783 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.923182 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:30.923465 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.922824 15573 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:30.922421 16270 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:30.921949 18689 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.928151 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:30.928498 16235 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:30.929775 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:30.930176 15580 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:30.930433 15576 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.931238 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.931393 18642 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:30.931860 18577 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.932471 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.933626 18825 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:30.934129 15571 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.934338 18825 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:30.935362 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:30.936048 15572 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:30.936576 18825 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.935900 18642 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:30.941597 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 108624us
W20260709 13:07:30.946192 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 74264.5us
I20260709 13:07:30.948226 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:30.948650 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57652.8us
I20260709 13:07:30.949740 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:30.952195 16276 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:30.952261 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58776.3us
I20260709 13:07:30.956367 16275 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 7. Ops: []
I20260709 13:07:30.945639 18645 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:30.929826 18689 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:30.982048 15576 raft_consensus.cc:2410] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:30.984361 16274 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:30.986622 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:30.966722 16236 leader_election.cc:336] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.904s (SENT)
I20260709 13:07:30.989861 15619 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:30.991357 16269 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:30.945179 18451 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:30.961256 18709 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.007596 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:30.999393 18645 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:31.002514 18104 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:30.984151 18825 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:30.997099 18668 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:31.018566 15647 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:31.035207 18543 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.036687 18489 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.041613 18642 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:31.043813 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 92180.7us
I20260709 13:07:31.056370 15653 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:31.057318 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 89349.1us
W20260709 13:07:31.057554 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 87880.9us
I20260709 13:07:31.059845 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.060429 18641 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.061020 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.061410 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.061849 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.062077 15729 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.062745 15723 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:31.062953 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58900
I20260709 13:07:31.060993 18641 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.063524 15653 raft_consensus.cc:606] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:31.063863 15653 raft_consensus.cc:614] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:31.064224 15724 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:31.065234 18641 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.069361 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.069782 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.070106 15724 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:31.073657 18641 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.073688 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:31.033272 18668 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:31.091727 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:31.092074 15648 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.092376 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.091651 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.092226 16235 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.077461 18729 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.027566 18672 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:31.118690 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.094460 15727 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:31.096839 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:31.130613 15655 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:31.132565 15646 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.093667 18577 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:31.122413 16236 leader_election.cc:336] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.951s (SENT)
I20260709 13:07:31.097456 18641 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.144541 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.090307 18689 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:31.147490 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:31.148147 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 92824us
W20260709 13:07:31.146245 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 55969.5us
I20260709 13:07:31.077178 18489 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.154479 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:31.160441 18841 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:07:31.162205 18507 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:31.162976 18507 consensus_queue.cc:1243] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:31.141213 18104 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:31.166582 18642 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.167245 18642 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:31.167280 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48788.7us
W20260709 13:07:31.168051 16236 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.018s (SENT)
I20260709 13:07:31.168479 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.168342 18642 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.169528 18425 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:31.169682 16236 leader_election.cc:336] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.032s (SENT)
I20260709 13:07:31.175496 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.170161 15653 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.148953 18641 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.178639 18641 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.170462 18645 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.182893 18709 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.183454 18850 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:31.184489 15526 auto_rebalancer.cc:893] Removing replace marker failed: Replica 680390d3f0884c91bf1f22ba914b438a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:31.184636 18850 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:31.184933 15526 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:07:31.185097 18850 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:31.185287 15526 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:31.186195 15649 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:31.186480 18733 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.187501 18104 consensus_queue.cc:1243] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:31.188093 18104 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.188405 18104 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.189225 18104 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.190547 18755 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.147367 18433 raft_consensus.cc:2764] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:31.175020 15729 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:31.190323 15725 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.192709 18755 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.193174 18845 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.193614 18845 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.193987 18845 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.194255 18856 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:31.196113 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:31.137269 18785 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.199186 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:31.199404 18785 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.199739 15576 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.199970 18785 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.200837 15646 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:31.201668 18425 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:31.202366 18425 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.202831 18425 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.204190 18489 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.204777 18425 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:31.205003 18709 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:31.207952 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58969.9us
I20260709 13:07:31.210675 15653 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:31.191579 18104 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.212915 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:31.213640 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 123238us
W20260709 13:07:31.229452 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.208055 16276 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:31.223812 15576 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
W20260709 13:07:31.236831 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.238261 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.241643 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:31.241868 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89519.3us
I20260709 13:07:31.205134 18668 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.249321 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.250635 15575 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:31.239496 16236 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.107s (SENT)
I20260709 13:07:31.246236 18577 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.210887 18850 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.252003 18489 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:31.260074 18577 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.260349 18850 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.260565 18577 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.261049 18672 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.261571 18672 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.262493 15572 raft_consensus.cc:2393] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:31.262471 18672 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.249502 18451 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:31.274892 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.275450 15573 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:31.275776 15577 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:31.274935 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.250118 18733 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:31.278589 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 65110.2us
W20260709 13:07:31.279345 16236 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.183s (SENT)
I20260709 13:07:31.253346 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:31.279778 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.281590 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:31.281858 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:31.282851 16269 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:07:31.283218 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 53662.7us
I20260709 13:07:31.286850 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:31.287508 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.282200 16271 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.290416 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.289870 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.293293 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:31.294195 16274 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:31.294984 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:31.298651 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.282565 18828 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.346237 15575 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:07:31.341589 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 194157us
I20260709 13:07:31.283461 18733 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.343600 18425 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.348095 18653 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.294620 18489 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:31.350142 18653 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.350660 18653 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.350992 18489 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.351946 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:31.281242 18577 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.357726 15619 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:31.356638 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.365108 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.348412 18425 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.370498 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.371321 15729 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.373926 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:31.348130 18733 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:31.378638 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.378839 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:31.377600 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:31.378306 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.370147 18425 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.382397 15575 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:31.382310 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 92512.6us
I20260709 13:07:31.366451 18691 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.387836 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.388715 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:31.388916 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:31.390486 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:31.392020 15727 raft_consensus.cc:2376] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7. Re-sending same reply.
I20260709 13:07:31.396157 15723 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.396484 18433 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:31.396754 18733 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:31.397732 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 148530us
I20260709 13:07:31.401029 18828 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:31.402189 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.403052 15720 raft_consensus.cc:2368] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:31.406246 15649 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.409175 18641 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.410130 18849 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.410708 18849 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.413031 18849 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.414155 15572 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
W20260709 13:07:31.416608 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 64760.7us
I20260709 13:07:31.418000 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.424322 15729 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:31.422441 15723 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:31.419449 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.430747 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:31.431934 16271 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:31.435415 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.435495 18755 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:31.437363 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.437855 15720 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:31.438335 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.438426 18433 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:31.438617 18425 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.439853 15692 leader_election.cc:400] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:31.443641 15692 leader_election.cc:403] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.440860 18425 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.440788 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.441516 18653 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.441890 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.443005 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:31.439559 18433 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.442340 18668 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.446547 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:31.447335 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.449301 18701 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.449844 18849 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.450738 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.450981 18672 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:31.451432 18634 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:31.451514 18543 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:31.425704 18691 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.440694 18850 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.452773 15728 raft_consensus.cc:2368] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8.
I20260709 13:07:31.453235 15726 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:31.447250 18755 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.456092 18845 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:31.487524 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47842.7us
I20260709 13:07:31.472775 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.479274 15649 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:31.418459 18785 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.470045 18451 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:07:31.492980 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.494056 18856 raft_consensus.cc:2764] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:31.494341 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.482282 18701 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.495543 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.496805 18701 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.478824 18634 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:31.497293 18850 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:31.497460 18634 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:31.498644 18768 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.499552 18850 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.485859 18672 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.497589 18507 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.502998 18672 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.504810 18653 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:31.506652 18691 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.510160 18849 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:31.511324 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.512681 18849 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.512770 18689 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.506656 18641 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:31.516517 18840 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:07:31.516947 18845 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.463682 18668 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:31.496758 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.474960 18425 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.479167 18543 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.571520 15648 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:31.573078 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 177600us
I20260709 13:07:31.570380 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:31.574862 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78196.6us
I20260709 13:07:31.546509 18689 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.580116 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:31.580760 15580 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.579885 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.582608 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.586485 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:31.585659 18839 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.451s	user 0.002s	sys 0.000s
I20260709 13:07:31.585920 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:31.588357 18425 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.588702 15573 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.588920 18425 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.589187 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.589445 18425 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.591586 15692 leader_election.cc:400] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8.
I20260709 13:07:31.581233 18849 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.592732 18689 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.593096 18849 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.594331 18825 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.594990 18825 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:31.595121 18849 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.572752 18845 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:31.599522 15573 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:31.603511 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.605532 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.606279 18642 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.606911 18642 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:31.607929 18642 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.582664 18768 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:31.619235 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 199862us
I20260709 13:07:31.621449 18716 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.614494 18709 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.621966 18716 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:31.620471 18689 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.622208 18668 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.620962 18856 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.623342 18668 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.623070 18716 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.624601 18716 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.622872 18689 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:31.576198 18634 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.603600 18755 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.603739 18825 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.611421 18507 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.604588 18577 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:31.606240 18845 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:31.636859 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54336.9us
I20260709 13:07:31.649997 18709 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:31.651280 15575 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:31.659008 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.635905 15580 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:31.666236 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:31.641211 18768 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:31.667096 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74674.7us
I20260709 13:07:31.648654 18507 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:31.670317 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48266.9us
I20260709 13:07:31.659933 18634 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.680246 16271 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:31.685070 16277 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:31.688092 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.678529 18577 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.653537 18543 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.698805 18577 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:31.699153 18872 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.699393 18543 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.699676 18872 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.699986 18577 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:31.701275 18878 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:31.702306 18797 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:31.702759 18797 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:31.703610 18797 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.704710 18797 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.706686 18507 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.713006 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.693800 18785 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.720764 18845 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.723534 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:31.724303 16273 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:31.725128 18425 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.713832 18768 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.730397 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.731050 15728 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:31.714713 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.731889 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.732591 15726 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:31.732946 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.733822 18877 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.734588 18877 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:31.734920 18877 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.735275 18877 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:31.715408 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47926.8us
I20260709 13:07:31.716109 18852 raft_consensus.cc:2764] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:31.716806 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:31.717139 18842 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.675s	user 0.004s	sys 0.001s
I20260709 13:07:31.717229 18489 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.718322 18857 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.744606 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:31.749830 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:31.750540 15575 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:31.756065 15728 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.737916 18543 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.792160 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:31.794744 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63198.8us
I20260709 13:07:31.798653 15726 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:31.801541 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 113969us
I20260709 13:07:31.805284 18868 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:31.808125 18868 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.808560 18868 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:31.805447 18885 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.810601 18885 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.812857 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:31.813196 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.814139 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 69664.2us
I20260709 13:07:31.815521 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.799883 18765 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.749799 18825 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.818883 15727 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:31.819267 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:31.826923 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 94048.8us
I20260709 13:07:31.789656 18642 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:31.844919 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1071) took 1021 ms. Trace:
I20260709 13:07:31.847837 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:31.854096 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:31.856412 15725 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.809448 18868 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:31.859364 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 43952.7us
I20260709 13:07:31.829038 18765 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:31.845542 16278 rpcz_store.cc:276] 0709 13:07:30.823313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.831955 (+  8642us) service_pool.cc:224] Handling call
0709 13:07:30.841911 (+  9956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.844986 (+  3075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.845020 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.845577 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.939902 (+ 94325us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.939935 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.940070 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.716886 (+776816us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b24003a7dc8. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d927ac9c4 00007f2d927aaacb 00007f2d92965dc9 00007f2d92965a55 00007f2d9296509d 00007f2d9559710e 00007f2d955ae88c 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221
0709 13:07:31.841510 (+124624us) raft_consensus.cc:1685] finished
0709 13:07:31.841538 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.844831 (+  3293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3384,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":8179456,"thread_start_us":93936,"threads_started":1,"wal-append.queue_time_us":183166}
I20260709 13:07:31.859997 15726 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
W20260709 13:07:31.863489 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.864379 15727 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:31.852320 18543 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.861963 18785 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.895494 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:31.873091 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:31.884943 18887 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:31.887466 18885 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.863709 18451 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.865734 18765 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:31.891183 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.898685 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:31.909507 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.911659 18642 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.913564 18709 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.914153 18709 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.914615 18709 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.919747 15649 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:31.922981 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.911963 18425 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:31.930444 18869 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.939023 18869 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.939510 18869 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.932651 18862 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.934469 18825 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:31.934998 18876 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:07:31.954345 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.873333 18868 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.947767 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:31.949059 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:31.953188 15728 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:31.895196 18785 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:31.897572 18872 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:31.962359 18689 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:31.962824 18845 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:31.963280 18845 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:31.963640 18845 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:31.967226 18883 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:31.972421 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:31.947400 18489 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.984158 18877 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.984941 18489 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:31.985425 18489 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.986441 18889 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.987092 18889 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:31.988938 18873 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
I20260709 13:07:31.989233 18889 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:31.973487 18689 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:31.990056 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 94678us
I20260709 13:07:31.974200 18879 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.990871 18689 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.975282 18691 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.976238 15726 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:31.977784 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 83747.6us
I20260709 13:07:31.990883 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:31.994167 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.995659 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:31.997323 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:31.978646 18851 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:31.958174 18828 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:32.011729 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:31.979091 18845 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:31.980582 18850 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.020292 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.020639 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.021515 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.022346 15648 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.982225 15649 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:31.982291 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:31.983419 15655 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:31.984004 18451 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:31.984268 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:32.020484 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.025898 15575 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.959939 18785 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.010982 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 131672us
I20260709 13:07:32.024829 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.032822 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.034202 15693 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:32.035717 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 44924.3us
I20260709 13:07:32.034981 18701 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.013676 18768 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:32.046320 15580 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.048178 18577 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.048768 18577 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:32.050134 18862 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.050585 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.050900 18862 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.054402 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.055816 18863 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:32.058786 16271 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.025386 18543 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:32.067407 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.074144 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:32.066386 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.029289 18451 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.081115 15646 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:32.083177 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.053925 18862 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.032039 18668 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.088802 18768 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:32.089241 18857 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:32.108767 18857 raft_consensus.cc:3055] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.109278 18857 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:32.110365 18857 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.111963 18857 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.090000 18899 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.088847 18733 consensus_queue.cc:1059] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:07:32.063405 18889 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.090453 18900 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.029500 18850 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.075850 18877 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.077625 15575 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:32.073709 15580 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:32.101392 18910 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:32.121505 18104 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:32.150277 18104 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:32.065404 18691 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:07:32.135178 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 61223.2us
I20260709 13:07:32.107002 18825 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.148434 18908 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:32.128580 18701 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:32.155997 18797 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.156176 18904 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:07:32.156883 18903 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:07:32.157760 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:32.149695 18900 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.049923 18577 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.161531 18910 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.222587 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.223524 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:32.223955 18910 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.163586 18850 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.164016 15653 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.224321 15727 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:32.223556 18900 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:32.225610 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 67932.3us
I20260709 13:07:32.226285 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.229212 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:32.229925 15728 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:32.152918 18889 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.128510 18668 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.165877 18765 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:32.155292 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 72159.5us
I20260709 13:07:32.129108 18899 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.161342 18869 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:32.251801 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.254020 15720 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:32.254132 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.254683 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.254894 15651 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:32.255960 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.198570 18104 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:32.199741 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 49275us
I20260709 13:07:32.205191 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.213958 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.216310 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.224102 15729 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.259622 16269 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:32.225706 18645 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.156034 18907 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.232008 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:32.260571 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.233210 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.233866 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.261618 15723 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:32.235054 15648 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:32.196276 18543 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:32.164321 18709 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.260667 16271 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:32.264001 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.265781 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.275171 15727 raft_consensus.cc:2410] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:32.267032 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.270117 16274 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:32.271911 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.279260 15728 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:32.280646 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.282308 15651 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:32.201431 18825 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.287014 15652 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:32.250973 18899 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.286360 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.293915 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.294574 15651 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:32.295869 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.296797 16270 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:32.297480 18104 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.300110 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.315163 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:32.315802 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.318471 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:32.318907 15649 raft_consensus.cc:2368] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:32.281659 18537 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:32.327270 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.327934 15648 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.328903 15724 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:32.328971 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:32.257325 18797 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.212646 18908 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.294368 18900 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.338155 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.295446 18828 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.340467 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:32.341545 16270 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:32.281427 18877 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:32.349254 18797 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.354118 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.355268 15650 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:32.356125 18908 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.356353 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.357323 15650 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 5: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:32.359705 18825 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:32.361207 18917 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.362510 16278 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:32.362910 16278 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:32.363000 18543 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.363720 16278 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.364693 16278 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.159473 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.365284 15476 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 7, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:32.329962 18845 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:32.368947 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 67362.9us
I20260709 13:07:32.371140 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:32.377048 18905 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:32.378702 18915 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.379422 18915 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.380736 15646 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:32.337607 18850 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.383939 18869 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.386196 18920 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:07:32.388029 18912 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.390324 15720 pending_rounds.cc:85] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
I20260709 13:07:32.390672 15720 pending_rounds.cc:107] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:07:32.390952 15720 raft_consensus.cc:2889] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.440340 15648 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:32.441474 15654 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:32.449674 15650 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:32.362174 18917 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:32.453294 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 75160.8us
I20260709 13:07:32.454277 18850 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:32.457028 16273 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:32.469502 15647 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:32.471735 15647 pending_rounds.cc:85] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:07:32.472043 15647 pending_rounds.cc:107] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:32.472327 15647 raft_consensus.cc:2889] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.499352 18916 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 13:07:32.377660 18785 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.503911 15649 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:32.518965 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.393360 18877 consensus_queue.cc:1243] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:32.346444 18900 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:32.528753 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 376325us
I20260709 13:07:32.557068 18733 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.336772 18701 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.332970 18907 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.546236 18765 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.572678 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:32.564535 18877 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.696139 15646 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:32.692731 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:32.710142 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.721361 15651 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:32.696708 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 325598us
I20260709 13:07:32.721701 18733 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.723130 18425 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.697870 18915 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:32.695199 18489 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:07:32.719992 18877 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:32.594409 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.725610 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:32.729416 18877 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.731184 18425 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:32.732136 18425 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:32.694671 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.726190 18489 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.733482 18425 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.705801 18863 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.692456 18785 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.735805 18489 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.573590 18889 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.735927 18863 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:32.529567 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 281769us
I20260709 13:07:32.745122 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:32.747248 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 174652us
W20260709 13:07:32.747485 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 52249.2us
I20260709 13:07:32.748392 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:32.755921 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:32.751036 18645 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.758147 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:32.747407 18921 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:07:32.770357 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.680512 18862 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.771117 15576 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:32.772635 16236 leader_election.cc:400] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:32.773279 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:32.773558 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.774209 15648 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:32.747193 18689 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.775732 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.782485 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.783342 15646 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:32.776002 15580 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:32.724005 18733 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:32.784940 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.789988 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.792795 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.796916 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.797655 15573 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.798974 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.804286 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:32.761180 18645 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.807082 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.802258 15693 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:32.770995 18489 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.779359 18918 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.775449 18668 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:32.821429 15650 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:32.795279 18689 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.824260 18689 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:32.789546 18797 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.754097 18850 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.815073 18645 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.830097 18900 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.830397 18870 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.831615 18863 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:32.819419 18918 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:32.833675 18906 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.833642 18918 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.835650 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.836037 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.836382 15576 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:32.837015 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.837319 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.838356 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.838819 18653 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:32.839030 18922 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:32.839272 18653 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:32.839951 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.792395 18785 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.841761 15573 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:32.842536 15577 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:32.795835 18845 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:32.846009 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.847178 15576 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:32.804623 18709 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.810422 18907 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:32.856003 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.851377 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.857395 15650 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:32.858158 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:32.858628 15650 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:32.796836 18862 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.861508 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.844091 18915 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.864470 15571 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:32.862286 15574 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.869910 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.834399 18906 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.883234 16278 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:07:32.886860 16278 pending_rounds.cc:85] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 5
I20260709 13:07:32.887279 16278 pending_rounds.cc:107] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:07:32.887545 16278 raft_consensus.cc:2889] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.807837 18911 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.411s
I20260709 13:07:32.889842 15651 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:32.884811 15579 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:32.885720 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:32.882526 15576 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:32.865025 18716 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.862627 18828 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.893234 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:32.861605 18927 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:32.848778 18785 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.864764 18909 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:32.840204 18653 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:32.850149 18845 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:32.902880 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.895483 18716 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:32.942438 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.947178 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:32.952639 15579 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:32.961406 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.937103 18716 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.973438 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:32.929241 18927 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:32.975701 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:32.972668 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:32.986784 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 230971us
I20260709 13:07:32.933813 18926 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.974062 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 85991.5us
I20260709 13:07:32.993749 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:32.903484 18828 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.000768 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:32.998566 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:32.987646 18451 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.006s
I20260709 13:07:33.011981 15579 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:32.985067 18849 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.013274 15572 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:32.981761 18877 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:33.017453 15648 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:33.017720 15580 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:32.985934 18668 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:32.931150 18909 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.002344 18701 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.022290 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:33.026187 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:33.027853 15726 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.021821 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:33.030385 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 226196us
I20260709 13:07:33.031002 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.031258 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.013859 18641 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.041672 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:33.036057 18850 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.019420 18925 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:33.063840 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 45445.6us
I20260709 13:07:33.067807 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:33.019181 18849 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:33.066483 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:33.069752 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:33.009691 18863 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:07:33.044896 18755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.004s	sys 0.014s
I20260709 13:07:33.018509 18451 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.027050 18668 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.036195 18701 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:33.090408 18701 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.065659 18825 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.077327 18634 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.073585 18849 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.093431 18927 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.110565 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:33.111905 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:33.112423 18930 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:07:33.113454 18845 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.098228 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:33.098868 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.103477 16275 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:33.119853 15574 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:33.122148 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:33.118476 16275 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:33.124400 15576 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:33.065373 18915 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.067288 18926 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.130015 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:33.141881 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:33.096406 18755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.005s	sys 0.014s
I20260709 13:07:33.072024 18925 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.071283 18797 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:33.107275 18931 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:33.096285 18825 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.025290 18877 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.100447 18857 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.097630 18785 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.106385 18862 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.077816 18543 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.179801 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.096740 18906 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.106673 18828 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:33.130614 18451 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.129884 18900 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.211946 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.191231 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.065567 18689 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:07:33.197364 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.213155 15574 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:33.202174 15725 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:33.214895 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.213763 15572 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:33.072432 18641 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.185798 16275 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:33.189739 18912 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.004s
I20260709 13:07:33.207454 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.172009 18925 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.169271 18870 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:33.188728 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 90579us
I20260709 13:07:33.105053 18701 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.231199 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.240689 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.252753 16275 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.243579 15576 raft_consensus.cc:2393] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:33.243690 15544 leader_election.cc:400] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:33.257458 15544 leader_election.cc:403] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:33.217191 18828 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.197525 18915 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:33.203919 18929 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:33.257771 15572 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:33.259125 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.252095 18932 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.007s
I20260709 13:07:33.247167 18451 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.174788 18926 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.270871 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.251209 18912 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:33.318476 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 317803us
I20260709 13:07:33.320470 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.267761 18765 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8.
I20260709 13:07:33.258301 18825 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.257530 18543 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.258546 18944 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.332413 16236 leader_election.cc:400] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8.
I20260709 13:07:33.311793 18938 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:07:33.335038 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 161398us
I20260709 13:07:33.338407 16236 leader_election.cc:403] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:07:33.340687 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 308728us
I20260709 13:07:33.338778 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.271833 18489 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:07:33.345767 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.271965 18634 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:07:33.304373 18870 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:07:33.316782 18929 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:33.356915 18955 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:33.357307 18945 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:07:33.357546 18923 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.798s	user 0.001s	sys 0.003s
I20260709 13:07:33.357693 18929 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.358548 18950 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.359068 18950 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:33.359432 18950 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.360589 18889 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.360991 18889 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.361316 18889 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.345204 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.304706 18857 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:07:33.345212 18425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.026s
I20260709 13:07:33.319475 18863 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.362999 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.340642 18912 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.376569 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:33.339128 18825 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.272825 18828 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:33.369295 18645 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:07:33.355892 18765 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:33.330076 18451 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:33.374392 18425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.003s	sys 0.026s
W20260709 13:07:33.431595 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55147.4us
I20260709 13:07:33.374591 18845 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.410974 18899 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.071s	user 0.003s	sys 0.010s
I20260709 13:07:33.435451 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.399544 18906 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.400110 18825 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.379055 18909 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:33.343690 18543 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:33.446070 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 107362us
W20260709 13:07:33.451438 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 191223us
I20260709 13:07:33.344615 18944 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.521147 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:33.441495 18935 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:07:33.428795 18765 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:33.363160 18949 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:07:33.435644 18668 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.411463 18912 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.399489 18863 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.432380 18645 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:33.560199 15726 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.000s
I20260709 13:07:33.560650 15726 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:33.440546 18709 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:33.517340 18425 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.515679 18862 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:33.555656 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 223354us
W20260709 13:07:33.555745 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 284943us
I20260709 13:07:33.442443 18899 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.530051 18909 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:33.357590 18955 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.435150 18915 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.566566 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:33.516505 18785 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:07:33.557360 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 116467us
I20260709 13:07:33.572646 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:33.563126 18701 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.573988 18709 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:33.532066 18877 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.587146 18955 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.589323 18828 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.590553 18951 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.590637 18641 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.591295 18645 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.592147 15723 raft_consensus.cc:2368] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:33.593132 18543 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.593315 18899 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:33.594082 18934 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:07:33.594195 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:33.595676 16275 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:33.595463 18909 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.596953 18849 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.569729 18862 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.634951 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2307) took 1243 ms. Trace:
I20260709 13:07:33.604245 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.559198 18668 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:07:33.623265 18926 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:33.635416 15720 rpcz_store.cc:276] 0709 13:07:32.386703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.389591 (+  2888us) service_pool.cc:224] Handling call
0709 13:07:32.390000 (+   409us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:32.673937 (+283937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.673966 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:32.695437 (+ 21471us) log.cc:844] Serialized 78 byte log entry
0709 13:07:32.889426 (+193989us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:32.936536 (+ 47110us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.629373 (+692837us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.629587 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.629672 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.629715 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:33.629735 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.629867 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692398,"prepare.queue_time_us":43943,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":16248,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":76730,"thread_start_us":138210,"threads_started":1,"wal-append.queue_time_us":271656}
I20260709 13:07:33.651006 15720 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:33.651329 15720 pending_rounds.cc:85] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 7
I20260709 13:07:33.651535 15720 pending_rounds.cc:107] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:33.651754 15720 raft_consensus.cc:2889] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.605891 18928 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:33.615139 18955 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.655350 18956 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.655910 18956 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.659578 18909 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:33.659826 18962 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:33.663993 18911 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:33.664585 18911 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:33.664670 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2303) took 1337 ms. Trace:
I20260709 13:07:33.664907 18944 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.614337 18951 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.665592 18911 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.610906 18768 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:33.616226 18451 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.619210 18958 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.619478 18104 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.690950 18104 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:33.691277 18768 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.691866 18104 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.692937 18104 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.693673 18768 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.690960 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2275) took 1333 ms. Trace:
I20260709 13:07:33.694785 15647 rpcz_store.cc:276] 0709 13:07:32.350778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.367844 (+ 17066us) service_pool.cc:224] Handling call
0709 13:07:32.375911 (+  8067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.514382 (+138471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.683664 (+1169282us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:33.683906 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141231488}
I20260709 13:07:33.690822 18958 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:33.620728 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:33.620854 15646 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:07:33.619395 18709 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.700325 18958 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.701148 15646 pending_rounds.cc:85] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 5
I20260709 13:07:33.701486 15646 pending_rounds.cc:107] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:07:33.701715 15646 raft_consensus.cc:2889] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.624820 16275 pending_rounds.cc:85] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 6
I20260709 13:07:33.703004 16275 pending_rounds.cc:107] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:33.703258 16275 raft_consensus.cc:2889] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.703943 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 878) took 1458 ms. Trace:
I20260709 13:07:33.626076 18963 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.704455 18925 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.704773 18963 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.705664 15580 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:33.706966 18963 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:33.627209 18948 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:07:33.613400 18939 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:07:33.708313 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2299) took 1474 ms. Trace:
I20260709 13:07:33.638010 18960 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:33.709461 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2302) took 1415 ms. Trace:
I20260709 13:07:33.657616 18825 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.638295 18862 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.638717 18965 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:33.640542 18716 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 13:07:33.642158 18912 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.644234 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:33.647264 18863 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.647442 18849 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.577421 18765 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.652421 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2310) took 1264 ms. Trace:
I20260709 13:07:33.615053 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:33.667347 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63231.9us
I20260709 13:07:33.667009 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 879) took 1419 ms. Trace:
I20260709 13:07:33.672446 15693 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:33.665277 15729 rpcz_store.cc:276] 0709 13:07:32.327115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.337328 (+ 10213us) service_pool.cc:224] Handling call
0709 13:07:33.663677 (+1326349us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:33.663919 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.664183 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.664220 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.664303 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:33.664347 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.664478 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.664596 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10816768}
I20260709 13:07:33.707297 18956 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:33.708742 15724 rpcz_store.cc:276] 0709 13:07:32.233379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.233478 (+    99us) service_pool.cc:224] Handling call
0709 13:07:33.708142 (+1474664us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400399754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:33.708238 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155512064}
I20260709 13:07:33.832718 15653 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:33.710040 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 880) took 1461 ms. Trace:
I20260709 13:07:33.834228 15649 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
W20260709 13:07:33.805213 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.760385 16277 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:33.776525 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2306) took 1390 ms. Trace:
I20260709 13:07:33.709884 15727 rpcz_store.cc:276] 0709 13:07:32.294086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.297270 (+  3184us) service_pool.cc:224] Handling call
0709 13:07:32.331929 (+ 34659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.453613 (+121684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.453657 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.454269 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.805573 (+351304us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:32.805629 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.709044 (+903415us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b540012dc54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:33.709102 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.709155 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:33.709172 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.709408 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2302,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":18168,"spinlock_wait_cycles":83391744,"thread_start_us":350825,"threads_started":1,"wal-append.queue_time_us":440831}
I20260709 13:07:33.834512 16273 rpcz_store.cc:276] 0709 13:07:32.249615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.357192 (+107577us) service_pool.cc:224] Handling call
0709 13:07:32.357532 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.471262 (+113730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.709770 (+1238508us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54006306d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:33.709966 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228149632}
W20260709 13:07:33.827436 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 254855us
W20260709 13:07:33.744360 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 223284us
I20260709 13:07:33.842603 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:33.840560 15720 rpcz_store.cc:276] 0709 13:07:32.387687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.650339 (+1262652us) service_pool.cc:224] Handling call
0709 13:07:33.650666 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.652176 (+  1510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.652353 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:33.836367 15728 rpcz_store.cc:276] 0709 13:07:32.386315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.459825 (+ 73510us) service_pool.cc:224] Handling call
0709 13:07:32.700535 (+240710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.700796 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:32.701183 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.629044 (+927861us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18000183a0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:07:33.775643 (+146599us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.776051 (+   408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.776119 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.776182 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.776268 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.776444 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8184,"prepare.queue_time_us":713980,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":673,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":41966,"spinlock_wait_cycles":35616512,"thread_start_us":369238,"threads_started":2,"wal-append.queue_time_us":296405}
W20260709 13:07:33.852504 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 180165us
I20260709 13:07:33.704257 16275 rpcz_store.cc:276] 0709 13:07:32.245632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.251133 (+  5501us) service_pool.cc:224] Handling call
0709 13:07:32.272224 (+ 21091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.103370 (+831146us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400631620. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598adc0 00007f2d95a151c0 00007f2d95a16231 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c
0709 13:07:33.703691 (+600321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.703887 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648674048}
I20260709 13:07:33.844281 16270 rpcz_store.cc:276] 0709 13:07:32.247828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.342262 (+ 94434us) service_pool.cc:224] Handling call
0709 13:07:32.374542 (+ 32280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.478008 (+103466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.478073 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.699660 (+221587us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.928218 (+228558us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.133159 (+204941us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.133493 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.133629 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.133694 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.643564 (+509870us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800145540. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:33.666697 (+ 23133us) raft_consensus.cc:1685] finished
0709 13:07:33.666728 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.666913 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":656324,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4080,"raft.queue_time_us":278978,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":34553,"spinlock_wait_cycles":18788992,"thread_start_us":387465,"threads_started":2,"wal-append.queue_time_us":503568}
I20260709 13:07:33.856184 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.860631 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.861268 15577 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:33.861274 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.862866 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:33.863786 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.864621 15574 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
W20260709 13:07:33.865752 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 874) took 1642 ms (client timeout 1949 ms). Trace:
W20260709 13:07:33.867566 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.709910 18872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:33.872771 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.821146 18955 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:33.866320 16274 rpcz_store.cc:269] 0709 13:07:32.213259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.213389 (+   130us) service_pool.cc:224] Handling call
0709 13:07:33.854933 (+1641544us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:33.855113 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23014144}
I20260709 13:07:33.665701 18951 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.830209 18913 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.780828 18925 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.838778 18965 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.893286 15572 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:33.913384 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2308) took 1526 ms. Trace:
I20260709 13:07:33.892617 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.879051 15579 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:33.909986 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67162.5us
W20260709 13:07:33.875753 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 304449us
I20260709 13:07:33.912624 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:33.851935 18642 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.902189 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:33.902367 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.904917 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.919466 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.850306 18716 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.875394 18425 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8.
I20260709 13:07:33.712585 18918 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.865706 18912 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.916087 16235 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:33.920694 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:33.920980 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:33.915967 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2311) took 1528 ms. Trace:
I20260709 13:07:33.961035 16273 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.961263 15727 rpcz_store.cc:276] 0709 13:07:32.387983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.892369 (+1504386us) service_pool.cc:224] Handling call
0709 13:07:33.915478 (+ 23109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.915648 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.915674 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.915721 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.915755 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.915818 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.915919 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:33.858680 18962 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.905234 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.913801 15722 rpcz_store.cc:276] 0709 13:07:32.387014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.391304 (+  4290us) service_pool.cc:224] Handling call
0709 13:07:32.700514 (+309210us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.758806 (+ 58292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.758862 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.806926 (+ 48064us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.987122 (+180196us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:33.902344 (+915222us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.903094 (+   750us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.913057 (+  9963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.913132 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.913168 (+    36us) raft_consensus.cc:1685] finished
0709 13:07:33.913182 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.913322 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":693923,"prepare.queue_time_us":654014,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":53241,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":15732,"spinlock_wait_cycles":48128,"thread_start_us":427433,"threads_started":2,"wal-append.queue_time_us":387007}
I20260709 13:07:33.831158 18889 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.806530 18958 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.925005 18104 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:33.981499 18104 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.874971 18849 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.935431 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.985630 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.927269 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 69848.6us
I20260709 13:07:33.874794 18955 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.928759 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.940732 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.988276 16270 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:33.989383 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:33.832571 18950 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:33.916023 18965 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.992022 18950 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.966722 15726 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:33.998410 18965 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:33.967195 15571 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:33.916349 18765 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.959621 18768 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:33.972956 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:33.923740 18642 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.000540 15722 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:34.000581 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.893227 18963 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:34.001399 16270 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:33.926553 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:33.982227 18104 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:33.983294 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 67321.8us
I20260709 13:07:33.998733 18954 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.978857 16269 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
W20260709 13:07:33.966866 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 72238.7us
I20260709 13:07:34.001587 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.012205 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.018602 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:34.034044 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.036760 16273 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:33.965868 18825 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:34.032363 15722 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:34.048374 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.960559 18912 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.060668 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.061713 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:34.061057 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 74103.6us
I20260709 13:07:34.041716 18104 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.064610 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.067363 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.068033 16271 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:34.068753 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.069144 16271 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:34.069697 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:33.968380 18785 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.075769 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:34.078363 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.080314 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.080796 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.081182 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.080391 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:33.916854 18913 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.001590 18642 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.074896 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.088176 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:34.088881 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.089146 18104 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:33.981283 18543 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:07:34.014487 18955 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.007920 18716 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.046231 18849 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.010646 18951 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.095484 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:34.185664 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.158615 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.204988 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.510347 15571 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:34.511420 16271 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.213263 15651 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:34.431028 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.512069 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:34.438678 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.070662 18912 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.214274 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:34.466698 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.215024 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.514889 15655 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:34.514762 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.291829 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1687) took 1110 ms. Trace:
I20260709 13:07:34.516031 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.277809 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2312) took 1884 ms. Trace:
I20260709 13:07:34.158480 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.517186 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:34.164868 18889 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.205257 18911 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.517133 15722 rpcz_store.cc:276] 0709 13:07:32.388275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.089649 (+1701374us) service_pool.cc:224] Handling call
0709 13:07:34.272207 (+182558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.272372 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.272396 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.272436 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:34.272479 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.272532 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.272643 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.160416 18965 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.288722 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:34.238507 15476 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.519187 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:34.519790 15722 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.205293 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.287184 18962 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:34.520401 15647 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:34.520823 18962 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.106056 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:34.100427 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 80460.9us
I20260709 13:07:34.522677 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.523037 18962 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.158293 18433 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:34.183727 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.060130 18954 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:34.524494 15646 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:34.159729 15724 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:07:34.183013 15650 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:34.082479 18916 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.526906 18916 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.229691 15727 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:34.527355 18916 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.215760 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.528460 15654 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:34.529613 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.156948 18653 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.530866 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.531579 16273 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:34.532610 18577 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.060635 18915 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.534595 16271 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:34.534349 18915 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.535527 15729 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:34.537627 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.532701 16273 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:34.533130 18912 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.541730 15725 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:34.542200 16273 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:34.542640 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.542841 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.543334 18912 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.549589 16276 raft_consensus.cc:2410] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:34.544503 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1895) took 2081 ms. Trace:
I20260709 13:07:34.544927 16271 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:34.551059 16276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 872) took 2341 ms (client timeout 2216 ms). Trace:
W20260709 13:07:34.551553 16276 rpcz_store.cc:269] 0709 13:07:32.210074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.212371 (+  2297us) service_pool.cc:224] Handling call
0709 13:07:34.550766 (+2338395us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b540073ebd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:34.550943 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5341033856}
I20260709 13:07:34.543257 15725 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:34.551942 16271 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:34.552711 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.552886 16272 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:34.553220 16272 pending_rounds.cc:85] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 6
I20260709 13:07:34.552935 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.553692 16272 pending_rounds.cc:107] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:34.553957 15725 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:34.554085 16272 raft_consensus.cc:2889] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.554798 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.555378 15725 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:34.556010 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 877) took 2312 ms. Trace:
I20260709 13:07:34.215607 18862 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.556464 16272 rpcz_store.cc:276] 0709 13:07:32.243702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.245299 (+  1597us) service_pool.cc:224] Handling call
0709 13:07:34.552530 (+2307231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.554721 (+  2191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.555770 (+  1049us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b540073ebd0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:34.555923 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5256902912}
I20260709 13:07:34.277415 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.558727 18862 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.212113 18913 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:34.203689 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 277195us
I20260709 13:07:34.290411 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:34.335098 18907 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:34.561089 18907 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.562999 18849 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:34.525856 15724 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 4
I20260709 13:07:34.563830 15724 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:34.564230 15724 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.565140 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2313) took 2176 ms. Trace:
W20260709 13:07:34.565652 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53682us
I20260709 13:07:34.565958 18907 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.211071 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.566340 18918 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:34.565061 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 490198us
I20260709 13:07:34.566988 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.515959 15580 rpcz_store.cc:276] 0709 13:07:33.181111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.181276 (+   165us) service_pool.cc:224] Handling call
0709 13:07:34.291587 (+1110311us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54003f9dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:34.291728 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132002560}
I20260709 13:07:34.568260 18716 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.565065 18825 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.569056 18913 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:34.569284 18825 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.513140 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.568153 18912 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:34.569844 18825 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:34.570932 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.545986 18104 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.571583 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:34.571492 18104 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.525188 18954 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.573377 18104 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:34.569917 18716 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.574348 18716 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.576517 18716 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.544062 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.577579 18716 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:34.578002 18716 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:34.578805 18716 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.579551 15728 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.584542 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1897) took 2081 ms. Trace:
I20260709 13:07:34.550383 15729 rpcz_store.cc:276] 0709 13:07:32.463060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.161367 (+1698307us) service_pool.cc:224] Handling call
0709 13:07:34.161921 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.535827 (+373906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.544287 (+  8460us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400107554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:34.544432 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858516352}
W20260709 13:07:34.523818 15618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.949s (SENT) [suppressed 22 similar messages]
W20260709 13:07:34.587029 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63242.3us
I20260709 13:07:34.587580 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1899) took 1834 ms. Trace:
I20260709 13:07:34.587958 18104 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.588953 18104 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.589862 18915 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.591166 18104 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.588076 15729 rpcz_store.cc:276] 0709 13:07:32.753668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.586587 (+1832919us) service_pool.cc:224] Handling call
0709 13:07:34.586881 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.587098 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.587136 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.587191 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:34.587236 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.587331 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.587482 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.594179 16272 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:34.594540 16272 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:34.595656 16272 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.596611 16272 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.599434 15720 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:34.587944 15618 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.216s (SENT)
W20260709 13:07:34.215830 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 138998us
I20260709 13:07:34.585217 15728 rpcz_store.cc:276] 0709 13:07:32.503413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.578996 (+2075583us) service_pool.cc:224] Handling call
0709 13:07:34.579345 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.584222 (+  4877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.584475 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.604351 15576 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:34.625355 16271 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.518555 18911 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.608376 16272 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:34.608893 18951 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.075515 18785 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.611229 15574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.007s
W20260709 13:07:34.653865 15574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.007s
I20260709 13:07:34.611786 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:34.215467 18668 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.618369 15722 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:34.656910 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 643) took 1616 ms. Trace:
I20260709 13:07:34.561054 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:34.659232 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 98270.9us
W20260709 13:07:34.617403 18958 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.001s
I20260709 13:07:34.524102 18433 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:34.565696 15724 rpcz_store.cc:276] 0709 13:07:32.388561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.158945 (+1770384us) service_pool.cc:224] Handling call
0709 13:07:34.159300 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.564892 (+405592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.565085 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.517654 15649 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:34.662091 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74178.6us
I20260709 13:07:34.510192 15652 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
W20260709 13:07:34.662789 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.624864 15576 pending_rounds.cc:85] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 7
I20260709 13:07:34.665885 15576 pending_rounds.cc:107] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:34.666252 15576 raft_consensus.cc:2889] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:34.652206 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.657406 15722 rpcz_store.cc:276] 0709 13:07:33.040681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.655908 (+1615227us) service_pool.cc:224] Handling call
0709 13:07:34.656281 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.656506 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.656547 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.656599 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:34.656641 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.656708 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.656850 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.585381 18825 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.649441 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 638) took 1610 ms. Trace:
I20260709 13:07:34.667457 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:34.667322 15720 rpcz_store.cc:276] 0709 13:07:33.039026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.598901 (+1559875us) service_pool.cc:224] Handling call
0709 13:07:34.599234 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.649172 (+ 49938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.649377 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:34.668862 15720 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:34.653565 18577 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.678980 18577 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.679443 15720 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:34.675523 18104 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.686439 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:34.700482 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.655972 18785 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.700039 18951 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.659853 18925 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:34.724086 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56696us
I20260709 13:07:34.669746 18852 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:34.735204 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 168273us
I20260709 13:07:34.746346 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:34.739563 16278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.038s
W20260709 13:07:34.747402 16278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.040s
I20260709 13:07:34.656092 18965 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:34.680610 18845 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:34.743374 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:34.676453 18907 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:34.782987 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.759083 15720 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:34.804235 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.806577 15724 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:34.735436 18917 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.734494 18849 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:34.795264 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 227493us
I20260709 13:07:34.723814 18537 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.719132 18975 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:34.721184 18958 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:34.816498 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:34.669528 18668 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.750753 18915 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:34.720268 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:34.826210 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:34.826725 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 106532us
I20260709 13:07:34.827241 15651 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:34.827416 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.748414 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1097) took 1033 ms. Trace:
I20260709 13:07:34.808239 15720 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:34.737228 18951 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.834306 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:34.792834 18691 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.840065 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.841118 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:34.821620 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.824193 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.809604 18104 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.830224 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.828074 16278 rpcz_store.cc:276] 0709 13:07:33.714636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.716810 (+  2174us) service_pool.cc:224] Handling call
0709 13:07:33.717149 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.717374 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:34.168492 (+451118us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b1800390dc0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf
0709 13:07:34.168690 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.747961 (+579271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.748038 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.748100 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.748188 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.748343 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120777,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":97,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":19879,"spinlock_wait_cycles":58972032,"thread_start_us":747711,"threads_started":2}
I20260709 13:07:34.788722 18845 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.839291 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:34.847342 15646 raft_consensus.cc:2410] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:34.858498 15653 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.845661 15652 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:34.815569 18917 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.847029 18104 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.865296 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.841043 15720 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 4.
I20260709 13:07:34.863507 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.867084 15648 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:34.846365 15724 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:34.818218 18849 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.818792 18543 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.868410 18577 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.898415 18577 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.898494 18543 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:34.868626 18924 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.899418 18924 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.899374 18543 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:34.871133 18765 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 13:07:34.874421 16270 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:34.875793 18668 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.860922 18691 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.901109 18691 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.902532 18689 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:34.903039 18689 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:34.905086 18689 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.905638 18689 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.839485 18889 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.825320 18733 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.906340 18733 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.906826 18733 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.895401 18825 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:34.898867 18577 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:34.908601 18577 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.868662 18911 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:34.909442 18825 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.839540 18768 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.909638 18911 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.906350 18889 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.911078 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:34.897502 18845 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.790230 18907 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.918349 15647 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.912570 15476 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 9, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:34.911337 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:34.931958 18104 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:34.933202 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:34.935135 15652 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:34.833346 18955 raft_consensus.cc:2764] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:34.849493 18642 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.942188 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:34.931967 15476 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 5, term changed from 4 to 5, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to <none>, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:34.913833 18917 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.819483 18537 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.910210 18825 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.901912 18543 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:34.966792 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:34.962255 15653 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:34.914052 18849 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.965356 15476 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:34.973987 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:34.981195 15720 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:34.983310 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.983477 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:34.983790 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 201181us
I20260709 13:07:34.984519 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.985458 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.986176 18104 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.952504 18425 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.987484 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:34.988226 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.988947 18104 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:34.990197 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:34.990918 18104 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.991591 18104 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:34.992429 18104 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:34.953033 18642 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:34.934068 18689 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:35.008526 18642 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.012115 18988 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.988525 18543 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.022553 18537 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.022997 18543 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.023504 18543 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:35.014245 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 105250us
I20260709 13:07:34.935004 18911 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:35.028942 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:35.032521 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 191319us
I20260709 13:07:35.033861 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.043497 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:34.943738 18768 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.053308 18104 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.050774 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.046849 15576 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.055091 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:35.055333 15653 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:35.058483 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 644) took 1200 ms. Trace:
I20260709 13:07:35.058954 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.061162 18988 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:35.062196 18433 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.062346 18988 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:35.063882 18954 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.064404 18954 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.053936 18104 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:35.028674 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 314476us
W20260709 13:07:35.074476 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.075362 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.076220 15578 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:35.077498 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:35.080893 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1102) took 1250 ms. Trace:
I20260709 13:07:35.081423 16275 rpcz_store.cc:276] 0709 13:07:33.830411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.858937 (+ 28526us) service_pool.cc:224] Handling call
0709 13:07:33.859224 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.990258 (+131034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.990290 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:33.990330 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:33.990364 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.080600 (+1090236us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540044c5d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:35.080662 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.080822 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300899584}
I20260709 13:07:35.086958 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:35.087984 15646 raft_consensus.cc:2368] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9.
W20260709 13:07:35.092566 15723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 636) took 2054 ms (client timeout 2107 ms). Trace:
W20260709 13:07:35.093156 15723 rpcz_store.cc:269] 0709 13:07:33.038430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.121856 (+ 83426us) service_pool.cc:224] Handling call
0709 13:07:35.092292 (+1970436us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54001a4ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.092490 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078855040}
I20260709 13:07:35.094714 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:35.095464 15723 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:35.096694 15723 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.097078 15654 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.101725 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.103188 15651 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:35.109326 15728 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:35.111387 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2309) took 2724 ms (client timeout 1978 ms). Trace:
W20260709 13:07:35.111761 15721 rpcz_store.cc:269] 0709 13:07:32.387350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.391670 (+  4320us) service_pool.cc:224] Handling call
0709 13:07:33.605573 (+1213903us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:35.111039 (+1505466us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b54003cb828. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7f0924 00007f2d9a9d9227 00007f2d9a9d8ab8 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:35.111293 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16124160}
I20260709 13:07:35.059001 16269 rpcz_store.cc:276] 0709 13:07:33.857875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.893200 (+ 35325us) service_pool.cc:224] Handling call
0709 13:07:35.058269 (+1165069us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54004c2054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.058399 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120881408}
I20260709 13:07:35.033574 15476 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 6, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), now has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:35.114593 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54346.1us
W20260709 13:07:35.117681 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.113862 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1903) took 1243 ms. Trace:
I20260709 13:07:35.027473 18965 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:35.124817 15721 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:35.046387 18537 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:35.150724 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.123411 15722 rpcz_store.cc:276] 0709 13:07:33.868574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.674057 (+805483us) service_pool.cc:224] Handling call
0709 13:07:34.702444 (+ 28387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.702703 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:35.032040 (+329337us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.096767 (+ 64727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.097444 (+   677us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:35.098834 (+  1390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.106495 (+  7661us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.111059 (+  4564us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13680,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":337411,"threads_started":2}
I20260709 13:07:35.054708 18975 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.134057 15578 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.147289 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:35.056524 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.154536 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.115967 18989 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.011655 18425 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.156229 15476 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 5, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:35.138173 18872 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:35.174842 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.148288 18983 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:07:35.167091 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:35.212296 15723 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.206748 15476 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 5, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 5 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.157023 18975 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.172279 16275 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:35.215929 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:35.218631 15721 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:35.214804 16236 leader_election.cc:336] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.107s (SENT)
W20260709 13:07:35.162194 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 105772us
W20260709 13:07:35.205485 18916 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 13:07:35.235473 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:35.220443 15476 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.164331 19002 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.246398 15576 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:35.246512 15473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 348) took 18045 ms (client timeout 15000 ms). Trace:
I20260709 13:07:35.167083 18914 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:35.148459 18965 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:35.219626 18975 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.236459 18543 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.250094 18954 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:35.245934 18857 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.249725 18962 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:35.157238 18997 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:07:35.245627 18537 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:35.236315 18951 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:35.251768 18998 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:35.284343 18998 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.251813 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.250061 18916 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.287050 15578 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:35.256158 18691 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.287761 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:35.288035 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:35.288326 15651 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.252112 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.270761 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:35.274101 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 59343.3us
I20260709 13:07:35.276448 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 620) took 1048 ms. Trace:
I20260709 13:07:35.279084 15476 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 5, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 5 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:35.289860 15721 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:35.281172 16275 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:35.286896 15580 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:35.268530 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1749) took 1394 ms. Trace:
I20260709 13:07:35.301769 15647 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:35.275743 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.302973 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:35.303433 15576 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:35.273993 15723 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:35.299254 15574 rpcz_store.cc:276] 0709 13:07:33.874177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.874339 (+   162us) service_pool.cc:224] Handling call
0709 13:07:33.874698 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.904452 (+ 29754us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:33.984932 (+ 80480us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.654400 (+669468us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.659051 (+  4651us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.659175 (+   124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:34.659405 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.659577 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.659644 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.100586 (+440942us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b1800382f60. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:35.241733 (+141147us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b1800382f60. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:35.268296 (+ 26563us) raft_consensus.cc:1685] finished
0709 13:07:35.268322 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.268456 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":324955,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":13016,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":19010,"spinlock_wait_cycles":62931968,"thread_start_us":611348,"threads_started":2,"wal-append.queue_time_us":599002}
I20260709 13:07:35.329125 15476 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:35.290374 15579 rpcz_store.cc:276] 0709 13:07:34.228004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.228148 (+   144us) service_pool.cc:224] Handling call
0709 13:07:34.247703 (+ 19555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.248092 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.248129 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.603027 (+354898us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.953238 (+350211us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:34.953275 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.953344 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.276180 (+322836us) raft_consensus.cc:1685] finished
0709 13:07:35.276206 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.276381 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":259,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7294,"thread_start_us":335257,"threads_started":1,"wal-append.queue_time_us":653222}
W20260709 13:07:35.262656 18986 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:07:35.267916 18987 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:07:35.263190 18990 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:35.262560 18689 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.262830 18907 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:35.266362 18985 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260709 13:07:35.347508 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:35.359150 15476 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 6 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.360170 15574 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:35.349519 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.335215 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.350486 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:35.344321 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 296461us
I20260709 13:07:35.265231 18965 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:35.352694 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.362828 15574 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.282424 18889 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.280977 18911 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:35.266701 18825 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.354112 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:35.304775 18852 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.278462 18996 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.261790 18733 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.273699 18962 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.288319 18916 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.305574 18543 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.358887 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:35.273257 18857 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:35.272461 18577 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.236935 18872 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.333623 18954 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.363498 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 235235us
I20260709 13:07:35.260138 18642 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.368269 15655 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:35.363255 15579 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:35.371186 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.509519 16275 raft_consensus.cc:2410] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:35.510658 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.372104 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:35.376062 15647 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:35.512286 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.513381 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.513974 15647 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:35.379878 15476 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 7 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.516731 15476 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 2, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.286125 18845 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:35.278896 18537 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.282658 18915 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:35.337478 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:35.279635 19006 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:07:35.424063 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.344369 18992 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:07:35.359393 18689 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.441934 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 621) took 1165 ms. Trace:
W20260709 13:07:35.519045 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0677642369998921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:07:35.548913 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:35.442893 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 892) took 1392 ms. Trace:
I20260709 13:07:35.550341 16273 rpcz_store.cc:276] 0709 13:07:34.050708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.546597 (+495889us) service_pool.cc:224] Handling call
0709 13:07:34.546890 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.553058 (+  6168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.553087 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.553501 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.843005 (+289504us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:34.843061 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.843151 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.442608 (+599457us) raft_consensus.cc:1685] finished
0709 13:07:35.442629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.442807 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":289116,"threads_started":1,"wal-append.queue_time_us":465233}
I20260709 13:07:35.552055 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.552629 16273 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:35.552755 18425 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.443549 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1896) took 2949 ms. Trace:
I20260709 13:07:35.405066 18998 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:35.443614 18733 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.404529 18852 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.444259 15729 raft_consensus.cc:1217] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-6.7]   Dedup: 4.6->[6.7-6.7]
I20260709 13:07:35.446344 15578 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.382822 19012 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:35.404379 18996 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:35.428427 18653 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:35.485121 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 149974us
I20260709 13:07:35.467391 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.487900 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 623) took 1200 ms. Trace:
W20260709 13:07:35.247076 15473 rpcz_store.cc:269] 0709 13:07:17.030995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.031370 (+   375us) service_pool.cc:224] Handling call
0709 13:07:34.966149 (+17934779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:28.857416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:28.858005 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:28.858061 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:28.858080 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:28.860042 (+  1962us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:28.860129 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:28.860158 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:07:28.919880 (+ 59722us) tablet.cc:701] Row locks acquired
0709 13:07:28.919902 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:07:28.920086 (+   184us) write_op.cc:270] Start()
0709 13:07:28.920204 (+   118us) write_op.cc:276] Timestamp: P: 1783602448920032 usec, L: 0
0709 13:07:28.920228 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:29.069625 (+149397us) log.cc:844] Serialized 11320 byte log entry
0709 13:07:30.211249 (+1141624us) op_driver.cc:464] REPLICATION: finished
0709 13:07:30.662853 (+451604us) write_op.cc:301] APPLY: starting
0709 13:07:30.663040 (+   187us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:30.663702 (+   662us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:30.676775 (+ 13073us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:30.700731 (+ 23956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:30.701325 (+   594us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:07:30.701378 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:30.703364 (+  1986us) log.cc:844] Serialized 188 byte log entry
0709 13:07:30.704864 (+  1500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.705320 (+   456us) write_op.cc:454] Released schema lock
0709 13:07:30.705409 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:30.727405 (+ 21996us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:30.729199 (+  1794us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1660078,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":451214,"apply.run_cpu_time_us":7866,"apply.run_wall_time_us":59432,"num_ops":28,"prepare.queue_time_us":396404,"prepare.run_cpu_time_us":37692,"prepare.run_wall_time_us":516500,"raft.queue_time_us":409591,"raft.run_cpu_time_us":71469,"raft.run_wall_time_us":472391,"replication_time_us":1290813,"thread_start_us":1474492,"threads_started":4,"wal-append.queue_time_us":524156,"wal-append.run_cpu_time_us":33855,"wal-append.run_wall_time_us":2107908}]]}
I20260709 13:07:35.489890 15619 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:35.492242 16269 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:35.494961 18785 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
W20260709 13:07:35.474761 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 239989us
I20260709 13:07:35.521183 16272 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:35.536688 15476 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 5, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 5 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.483287 18954 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.542348 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.506119 18691 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.492609 18911 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:07:35.544238 18917 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.006s
I20260709 13:07:35.491199 19018 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:35.553489 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:35.606508 18969 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.547269 15575 rpcz_store.cc:276] 0709 13:07:34.276600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.276739 (+   139us) service_pool.cc:224] Handling call
0709 13:07:34.287556 (+ 10817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.287941 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.287971 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.511233 (+223262us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.720337 (+209104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:34.720376 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.720444 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.441693 (+721249us) raft_consensus.cc:1685] finished
0709 13:07:35.441712 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.441859 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":208721,"threads_started":1,"wal-append.queue_time_us":345959}
I20260709 13:07:35.573691 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 660) took 1418 ms. Trace:
W20260709 13:07:35.605484 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 56647.6us
I20260709 13:07:35.666836 18913 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:35.667335 18642 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.667610 15476 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 5, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 5 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.584692 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:35.668854 15729 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:07:35.668951 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 84362.3us
I20260709 13:07:35.644671 15652 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:35.672462 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:35.563800 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 651) took 1650 ms (client timeout 1580 ms). Trace:
I20260709 13:07:35.652171 15651 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:35.559366 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 642) took 2519 ms. Trace:
I20260709 13:07:35.674934 15728 rpcz_store.cc:276] 0709 13:07:33.040400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.625597 (+1585197us) service_pool.cc:224] Handling call
0709 13:07:35.109084 (+483487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.109923 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.559179 (+449256us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001a4ad0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.559308 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111261568}
W20260709 13:07:35.572116 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.636734 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.681087 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.682354 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.665570 16270 rpcz_store.cc:276] 0709 13:07:34.155783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.522436 (+366653us) service_pool.cc:224] Handling call
0709 13:07:35.573448 (+1051012us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540053a054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.573612 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807423744}
W20260709 13:07:35.611788 19005 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:07:35.705597 15544 leader_election.cc:400] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9.
I20260709 13:07:35.722965 16275 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:35.723356 15544 leader_election.cc:403] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.622697 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:35.718312 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.557278 15649 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:35.696893 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:35.664351 16273 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.605489 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:35.664412 15577 rpcz_store.cc:276] 0709 13:07:34.287952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.290787 (+  2835us) service_pool.cc:224] Handling call
0709 13:07:34.520054 (+229267us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.520398 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.520425 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.520962 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.729871 (+208909us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:34.729909 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.729981 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.487618 (+757637us) raft_consensus.cc:1685] finished
0709 13:07:35.487642 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.487835 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4249,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":208564,"threads_started":1,"wal-append.queue_time_us":450769}
W20260709 13:07:35.673756 16274 rpcz_store.cc:269] 0709 13:07:33.913419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.917997 (+  4578us) service_pool.cc:224] Handling call
0709 13:07:35.563537 (+1645540us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54006847d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.563715 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287398272}
I20260709 13:07:35.695456 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.729638 16272 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:35.670843 15476 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 5 to 7, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:35.733748 15476 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 3, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 3 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:35.725277 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 235451us
W20260709 13:07:35.671417 18849 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.003s
I20260709 13:07:35.724349 16277 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:35.611002 18577 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.522672 18862 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.174s
W20260709 13:07:35.610530 19014 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:07:35.722901 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:35.840698 15578 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:35.695894 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:35.611166 19013 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:35.854398 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1913) took 1045 ms. Trace:
I20260709 13:07:35.854897 15720 rpcz_store.cc:276] 0709 13:07:34.808500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.008866 (+200366us) service_pool.cc:224] Handling call
0709 13:07:35.009506 (+   640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.010444 (+   938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.011920 (+  1476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.034820 (+ 22900us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.247961 (+213141us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.248003 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.248072 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.854090 (+606018us) raft_consensus.cc:1685] finished
0709 13:07:35.854117 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.854299 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":542,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11316,"spinlock_wait_cycles":2304,"thread_start_us":93149,"threads_started":1,"wal-append.queue_time_us":235940}
I20260709 13:07:35.586122 18634 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:35.820657 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:35.608251 18689 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.670388 15725 rpcz_store.cc:276] 0709 13:07:32.494315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.555936 (+2061621us) service_pool.cc:224] Handling call
0709 13:07:34.556230 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.593852 (+ 37622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.593882 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.089615 (+495733us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b2c0013e688. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:07:35.090392 (+   777us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.248324 (+157932us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.248372 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.248446 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.443242 (+194796us) raft_consensus.cc:1685] finished
0709 13:07:35.443261 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.443490 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37217,"raft.queue_time_us":39688,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"spinlock_wait_cycles":13723392,"thread_start_us":157428,"threads_started":1,"wal-append.queue_time_us":292294}
I20260709 13:07:35.618322 19024 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:35.838614 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:35.678550 18996 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.834682 19016 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:35.664350 18917 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.588619 18924 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.593230 18768 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:35.848623 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.033794 15575 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:35.849320 15652 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.850101 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.035054 15571 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:35.830870 18849 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:35.852185 18916 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:36.037994 15650 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:35.857831 15655 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.836740 16274 pending_rounds.cc:85] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 6
I20260709 13:07:35.848018 19036 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:35.861119 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1901) took 3047 ms (client timeout 2638 ms). Trace:
I20260709 13:07:35.868101 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
W20260709 13:07:35.823158 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 217722us
I20260709 13:07:35.877688 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.052919 15573 raft_consensus.cc:2393] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:35.671767 18785 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:35.888877 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 258365us
W20260709 13:07:36.047014 15726 rpcz_store.cc:269] 0709 13:07:32.813343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.607143 (+793800us) service_pool.cc:224] Handling call
0709 13:07:35.860850 (+2253707us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003cb9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:35.861035 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281758464}
I20260709 13:07:35.705871 18911 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:35.858418 18634 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:35.838768 18913 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.705370 18956 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 13:07:35.986446 18857 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:36.026289 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 353901us
I20260709 13:07:36.030259 18962 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:35.664412 18969 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:36.032377 15727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1904) took 2163 ms (client timeout 2249 ms). Trace:
W20260709 13:07:36.034606 19022 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:07:35.820526 18965 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:36.041651 16274 pending_rounds.cc:107] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:36.079169 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.079598 16274 raft_consensus.cc:2889] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.057972 16235 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:35.686179 19012 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.063176 18911 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.063014 16278 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:36.033869 19024 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:36.063732 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 231595us
I20260709 13:07:36.064395 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:36.066913 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:36.087708 15574 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:36.031621 18998 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:35.985486 19006 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.956831 15579 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:36.071973 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:35.731086 18992 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:07:36.073992 15648 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:36.074681 15727 rpcz_store.cc:269] 0709 13:07:33.868831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.969252 (+100421us) service_pool.cc:224] Handling call
0709 13:07:36.032208 (+2062956us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400106654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:36.032320 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448280448}
I20260709 13:07:36.057346 18577 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.047353 18716 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.076803 15571 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.057022 19036 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.072412 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 250883us
I20260709 13:07:36.135610 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.047820 19016 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:35.958894 18995 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:36.057114 18849 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:36.138361 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 468562us
I20260709 13:07:36.056717 19020 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:36.139351 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:36.139897 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:36.140601 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:36.087704 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:36.142349 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54732.4us
I20260709 13:07:36.143308 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:36.071115 19019 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.138598 15619 connection.cc:256] RPC call timeout handler was delayed by -1.015212326999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 13:07:36.091480 15577 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:36.148465 15725 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:36.142216 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:36.150312 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:36.159322 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.161552 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:36.087781 19018 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:07:36.086814 18642 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:36.095546 18940 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:36.096113 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.089087 18998 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:36.073405 18913 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:36.178509 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.104229 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:36.106470 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.089762 18911 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.060374 18916 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:36.121091 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 415601us
W20260709 13:07:36.083429 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.097685 19006 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:36.094193 16271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.021s	sys 0.038s
I20260709 13:07:36.170364 15571 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:36.171463 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:36.166254 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:36.174274 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:36.193575 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 89439.9us
W20260709 13:07:36.105875 18997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.024s
I20260709 13:07:36.084272 18955 raft_consensus.cc:2764] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:36.181020 15578 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:36.146421 18914 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.000s
I20260709 13:07:36.182809 18998 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.207267 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:36.184005 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.220369 15574 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:36.220844 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.185171 15652 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:36.134694 18577 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.159314 18825 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.170039 18797 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.107890 18918 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:07:36.194418 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:36.175822 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:36.196147 15725 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.146961 19036 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.203294 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:36.204094 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.205420 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:36.206231 16271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.022s	sys 0.038s
I20260709 13:07:36.128386 18425 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:36.181645 19037 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:36.169792 18995 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.223250 19039 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:07:36.227273 19029 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:07:36.169503 18634 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.169968 19019 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:36.198686 18997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.025s
I20260709 13:07:36.193800 18954 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:36.203758 18537 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:36.198846 18668 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:36.224086 19021 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.227330 18642 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:36.185834 18940 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.175282 19020 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.628681 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 640) took 3589 ms. Trace:
W20260709 13:07:36.330385 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.714898 15655 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.004s
W20260709 13:07:36.536193 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 301447us
I20260709 13:07:36.510905 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:36.717938 15729 rpcz_store.cc:276] 0709 13:07:33.039773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.601250 (+1561477us) service_pool.cc:224] Handling call
0709 13:07:35.444075 (+842825us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.669236 (+225161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.628303 (+959067us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54001900d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:36.628583 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937073536}
I20260709 13:07:36.609221 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.718622 15655 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:36.534731 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1106) took 1416 ms. Trace:
I20260709 13:07:36.719852 15574 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:36.720351 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1792) took 1071 ms. Trace:
I20260709 13:07:36.720749 15655 rpcz_store.cc:276] 0709 13:07:35.648778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.696617 (+ 47839us) service_pool.cc:224] Handling call
0709 13:07:36.720298 (+1023681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:36.720504 16269 rpcz_store.cc:276] 0709 13:07:35.118555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.146388 (+ 27833us) service_pool.cc:224] Handling call
0709 13:07:35.146699 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.678783 (+532084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.534485 (+855702us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54007701d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:36.534670 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794272640}
I20260709 13:07:36.198441 18951 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.719249 16273 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.559805 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1110) took 1273 ms. Trace:
I20260709 13:07:36.231103 15571 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:36.289274 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 68488.6us
I20260709 13:07:36.202808 18852 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:36.219165 18914 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:36.780882 15723 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:36.782681 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51553.5us
W20260709 13:07:36.610545 19031 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:07:36.766346 16278 rpcz_store.cc:276] 0709 13:07:35.286307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.286460 (+   153us) service_pool.cc:224] Handling call
0709 13:07:35.286749 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.087003 (+800254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.559484 (+472481us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400090454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:36.559725 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784807296}
W20260709 13:07:36.687369 19060 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.057s	user 0.005s	sys 0.008s
W20260709 13:07:36.621349 19035 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:07:36.768815 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 574435us
I20260709 13:07:36.769367 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:36.223896 19045 raft_consensus.cc:2764] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:36.773247 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:36.773917 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:36.226212 19032 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.809182 15579 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:36.532744 18785 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:36.719141 18425 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:36.232806 18797 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.443322 18917 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:36.532231 19012 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:36.798748 18916 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:36.798882 19048 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.799083 18963 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:36.800261 15654 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:36.770938 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:36.622094 18969 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:36.805755 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:36.532176 18907 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.806368 15545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.013s
W20260709 13:07:36.808590 15653 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.003s	sys 0.016s
W20260709 13:07:36.855135 15653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.003s	sys 0.016s
I20260709 13:07:36.811908 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:36.721114 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:36.767732 18913 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:36.795389 18954 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:36.817166 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.009s
W20260709 13:07:36.859344 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.020s	sys 0.009s
I20260709 13:07:36.859540 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2286) took 1723 ms. Trace:
I20260709 13:07:36.859884 15647 rpcz_store.cc:276] 0709 13:07:35.135766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.514631 (+378865us) service_pool.cc:224] Handling call
0709 13:07:35.514973 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.522684 (+  7711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.522721 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.540681 (+ 17960us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.073564 (+532883us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:36.073626 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.073731 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.859338 (+785607us) raft_consensus.cc:1685] finished
0709 13:07:36.859354 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.859487 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7243,"raft.queue_time_us":19289,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":66867,"thread_start_us":414934,"threads_started":1,"wal-append.queue_time_us":566168}
I20260709 13:07:36.816237 16273 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:36.822002 19032 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:36.793171 18537 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.805570 18852 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:07:36.802964 18912 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.808256 18634 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.830432 15652 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:36.796901 18951 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.816694 18797 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.821282 18668 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:36.814139 18425 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:36.847486 18963 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.849368 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 901) took 1480 ms. Trace:
W20260709 13:07:36.855044 15545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.013s
I20260709 13:07:36.558157 19030 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:36.730870 18642 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.484472 19016 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:36.610632 18689 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:36.831015 18924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.012s	sys 0.009s
I20260709 13:07:36.352288 18768 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.458s
I20260709 13:07:36.824035 18577 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:36.730404 19021 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.026557 15655 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:07:36.995260 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.849967 19006 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:36.863842 18907 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:36.869052 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:36.897380 18954 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:37.018882 18716 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.000s
W20260709 13:07:36.862805 18975 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.593s	user 0.011s	sys 0.001s
I20260709 13:07:37.045258 19073 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:37.027251 16271 rpcz_store.cc:276] 0709 13:07:35.368638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.380303 (+ 11665us) service_pool.cc:224] Handling call
0709 13:07:35.380618 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.500515 (+119897us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:35.500543 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.500941 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.721960 (+1221019us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:36.722047 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.722142 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.849041 (+126899us) raft_consensus.cc:1685] finished
0709 13:07:36.849071 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.849284 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143800,"raft.queue_time_us":233542,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":1294638,"threads_started":2,"wal-append.queue_time_us":642656}
W20260709 13:07:37.019296 19024 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.921s	user 0.010s	sys 0.000s
W20260709 13:07:37.031920 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 227280us
I20260709 13:07:37.084730 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:37.005088 18911 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.804s	user 0.005s	sys 0.005s
W20260709 13:07:37.074215 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.924386 19061 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:37.074986 15574 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.102275 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.087591 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:37.103041 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.114945 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.116376 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.090842 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.094455 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:37.117669 16277 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:37.118657 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:37.118897 19020 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.119181 16277 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.120575 19049 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.310s
W20260709 13:07:37.103189 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.096174 18954 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.099216 18907 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.042397 18963 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:37.051684 19030 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.125764 18963 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.126344 19030 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.126489 18940 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.126993 18963 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:37.127115 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 909) took 1707 ms (client timeout 1867 ms). Trace:
W20260709 13:07:37.127617 16275 rpcz_store.cc:269] 0709 13:07:35.419819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.510343 (+ 90524us) service_pool.cc:224] Handling call
0709 13:07:37.126943 (+1616600us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54004efcd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:37.127056 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486619008}
I20260709 13:07:37.128784 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:37.129335 16275 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.130575 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.130759 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1709) took 1298 ms. Trace:
I20260709 13:07:37.131165 16278 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:37.131199 15577 rpcz_store.cc:276] 0709 13:07:35.832062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.835597 (+  3535us) service_pool.cc:224] Handling call
0709 13:07:35.835984 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.147830 (+311846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.130536 (+982706us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540033a254. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:37.130703 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586638208}
I20260709 13:07:37.132207 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.132742 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.132974 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.116923 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:37.117803 16271 raft_consensus.cc:2376] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8. Re-sending same reply.
I20260709 13:07:37.074975 18433 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.141702 15652 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:37.103288 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.084434 18852 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.133934 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.110121 16269 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:07:37.152765 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 69754.3us
I20260709 13:07:37.157464 15574 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:37.141546 16277 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:37.050637 18912 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.110750 18577 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.166461 19068 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:37.078145 19012 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:37.047331 18537 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:37.167577 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 50770us
I20260709 13:07:37.222455 16278 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:37.181097 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:37.233894 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 461454us
I20260709 13:07:37.101402 19024 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9.
I20260709 13:07:37.226294 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.205967 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2322) took 2053 ms. Trace:
I20260709 13:07:37.228736 16275 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:07:37.229008 15725 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.002s
I20260709 13:07:37.096211 19063 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:37.223903 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.267871 15574 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:37.268359 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1753) took 1202 ms. Trace:
I20260709 13:07:37.168457 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:37.234671 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:37.268798 15575 rpcz_store.cc:276] 0709 13:07:36.065963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.066104 (+   141us) service_pool.cc:224] Handling call
0709 13:07:36.080476 (+ 14372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.087319 (+  6843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.087347 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.107695 (+ 20348us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.599698 (+492003us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.599752 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.599819 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.268154 (+668335us) raft_consensus.cc:1685] finished
0709 13:07:37.268172 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.268291 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6495,"raft.queue_time_us":7144,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10082,"thread_start_us":416443,"threads_started":1,"wal-append.queue_time_us":485767}
I20260709 13:07:37.263980 15725 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:37.272940 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1925) took 1107 ms. Trace:
I20260709 13:07:37.273260 15725 rpcz_store.cc:276] 0709 13:07:36.165728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.165903 (+   175us) service_pool.cc:224] Handling call
0709 13:07:37.272883 (+1106980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.274820 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:37.275291 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 49123.9us
I20260709 13:07:37.276325 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.235424 15579 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:37.263970 15723 rpcz_store.cc:276] 0709 13:07:35.152526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.539676 (+387150us) service_pool.cc:224] Handling call
0709 13:07:35.540071 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.781380 (+1241309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.205708 (+424328us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:37.205900 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853092096}
I20260709 13:07:37.200194 18642 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:37.281095 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:37.282316 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.283401 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.284278 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:37.284721 15577 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.285091 18912 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.167101 18543 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.207171 18797 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.286108 18955 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:37.267199 19012 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.167236 18852 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:37.288417 18797 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.288204 18852 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.288725 19012 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.289125 15652 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:37.289425 18852 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.289244 19063 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.126367 19032 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:37.112810 18911 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.281231 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:37.154093 18958 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:37.281841 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.202529 19074 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.262079 18577 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:37.360800 19057 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:37.361404 19057 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:37.363262 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.18745e+06us
I20260709 13:07:37.363404 18951 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.363655 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1779) took 2535 ms. Trace:
I20260709 13:07:37.364427 19057 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.364548 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.365069 19057 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.365540 19057 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:37.366832 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.366556 19057 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.368754 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.369477 15722 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:37.371042 15654 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:37.311321 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.344903 15575 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:37.372938 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.373409 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.373631 16269 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:37.320675 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.295782 15724 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:37.345381 15573 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:37.351085 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.374540 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.351423 15574 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:37.351585 18765 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:37.371773 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:37.379387 15729 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.353721 19006 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.383592 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.362493 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:37.349493 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.365741 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:37.376286 16277 raft_consensus.cc:2410] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:37.316704 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.306871 16273 raft_consensus.cc:2376] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9. Re-sending same reply.
I20260709 13:07:37.291512 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.364086 15650 rpcz_store.cc:276] 0709 13:07:34.827844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.827954 (+   110us) service_pool.cc:224] Handling call
0709 13:07:34.828281 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.044756 (+1216475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.363386 (+1318630us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400418f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:37.363577 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781550976}
W20260709 13:07:37.352639 19027 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:07:37.387321 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:37.387887 15647 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:37.388685 15577 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:37.201637 19021 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.391500 19030 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.392143 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:37.341374 19036 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.003s
I20260709 13:07:37.385351 15580 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:37.417963 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:37.418573 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1767) took 1065 ms. Trace:
I20260709 13:07:37.418969 15580 rpcz_store.cc:276] 0709 13:07:36.373022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.349207 (+976185us) service_pool.cc:224] Handling call
0709 13:07:37.418511 (+ 69304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.394356 16277 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:37.420590 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 103966us
I20260709 13:07:37.421311 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.290488 19049 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.303288 19056 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.417788 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.266337 18962 raft_consensus.cc:2764] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:07:37.304819 18998 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.069s	user 0.000s	sys 0.008s
I20260709 13:07:37.274570 18995 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.101686 18975 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.359840 18537 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.440176 15571 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:37.290593 18925 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.383625 18914 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.308017 19024 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.301715 19019 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.275373 19028 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:37.300382 19015 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:37.428066 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.428792 19012 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.435437 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.358151 18958 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:37.357443 19074 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:37.445756 19065 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
W20260709 13:07:37.445895 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.109689 19073 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.446111 18768 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:37.447717 18996 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.391s	user 0.012s	sys 0.000s
I20260709 13:07:37.447933 19063 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.419785 19045 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.395952 18577 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.459203 15577 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:37.484568 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2321) took 2337 ms. Trace:
I20260709 13:07:37.490875 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 628) took 1072 ms. Trace:
I20260709 13:07:37.491412 15577 rpcz_store.cc:276] 0709 13:07:36.418976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.421900 (+1002924us) service_pool.cc:224] Handling call
0709 13:07:37.458886 (+ 36986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.490553 (+ 31667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.490823 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.429092 18852 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:37.430085 18907 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.461138 16276 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:37.461195 18104 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:37.428704 18785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.017s
I20260709 13:07:37.357017 18425 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.466042 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:37.467198 16275 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.452133 18925 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:37.441463 18916 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:37.482863 15727 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.477172 18845 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.483831 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.480930 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 52930.3us
I20260709 13:07:37.484589 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.514887 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.491122 15721 rpcz_store.cc:276] 0709 13:07:35.140186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.374870 (+234684us) service_pool.cc:224] Handling call
0709 13:07:35.428989 (+ 54119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.429389 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.429430 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.494188 (+ 64758us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.545015 (+ 50827us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.618713 (+ 73698us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.618960 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.619048 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.533411 (+914363us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18001a4760. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:37.120141 (+586730us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18001a4760. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:37.351935 (+231794us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:37.477373 (+125438us) raft_consensus.cc:1685] finished
0709 13:07:37.477404 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.477607 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234749,"prepare.queue_time_us":74039,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":39243,"raft.run_cpu_time_us":3685,"raft.run_wall_time_us":28513,"spinlock_wait_cycles":57616896,"thread_start_us":46195,"threads_started":1,"wal-append.queue_time_us":171572}
I20260709 13:07:37.506913 15729 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
W20260709 13:07:37.508165 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 145761us
I20260709 13:07:37.516983 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:37.509107 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 143431us
I20260709 13:07:37.518877 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.518997 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.435597 18998 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.464883 19015 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:37.481921 19006 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.520232 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.431813 19036 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.527283 15647 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:37.466539 19028 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.496639 18852 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.534415 16271 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:37.498844 18940 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:37.537889 15576 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:37.554939 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.462042 19024 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.565608 15577 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:07:37.533727 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:37.536072 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.515806 18927 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:37.562206 18852 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:37.532056 18911 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.579861 19073 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.562743 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1760) took 1493 ms. Trace:
I20260709 13:07:37.581960 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.562597 19015 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.585296 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:37.585458 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 70687.1us
I20260709 13:07:37.586462 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:37.585911 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:37.572715 15647 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:37.511078 18785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.017s
I20260709 13:07:37.591859 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.581840 15578 rpcz_store.cc:276] 0709 13:07:36.069670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.206511 (+136841us) service_pool.cc:224] Handling call
0709 13:07:36.234428 (+ 27917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.793530 (+559102us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:37.032584 (+239054us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.078173 (+ 45589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.078247 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:37.078309 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.562531 (+484222us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54003facd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:37.562575 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.562691 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36722,"prepare.queue_time_us":247835,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":41027,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":1497340032,"thread_start_us":230803,"threads_started":2,"wal-append.queue_time_us":8531}
I20260709 13:07:37.433948 19056 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.517681 18956 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.578503 18954 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:37.518235 18916 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.497848 18996 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:37.590107 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58903.2us
I20260709 13:07:37.604787 15575 raft_consensus.cc:2410] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:37.499342 19045 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:37.540149 18451 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.596446 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.597373 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:37.606076 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.539547 18914 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:07:37.594617 19012 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.621009 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:37.598088 19073 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.603957 19015 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.530072 18845 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.596987 18956 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.581657 18940 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:37.606122 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 390311us
I20260709 13:07:37.604178 18927 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:37.624418 15649 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.659701 19074 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.624814 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:37.685619 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 60910.9us
I20260709 13:07:37.614205 18954 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:37.672112 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:37.664443 15653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.020s	sys 0.046s
I20260709 13:07:37.675493 19056 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.604784 18911 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:07:37.679653 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.621706 19054 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:37.688522 15653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.021s	sys 0.048s
I20260709 13:07:37.689462 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:37.736042 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 46684.9us
I20260709 13:07:37.660728 18956 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.736882 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:37.691431 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 415430us
W20260709 13:07:37.692780 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.622886 18451 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:37.625646 18962 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.694723 15650 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:37.625984 19073 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:37.729693 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 132399us
I20260709 13:07:37.739255 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:37.741089 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:37.688534 18928 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.573s	user 0.014s	sys 0.030s
I20260709 13:07:37.744117 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.746660 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:37.755873 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:37.683935 18733 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.760407 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:37.763643 18996 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.742257 19073 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.764282 19028 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:37.764504 19044 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 1.210s	user 0.006s	sys 0.015s
I20260709 13:07:37.765568 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.745591 19049 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:37.818596 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:37.767089 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.734651 18914 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.741566 18962 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.744830 18918 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.759711 19056 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:37.837692 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.771130 19057 raft_consensus.cc:2764] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:37.755223 18928 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.645s	user 0.014s	sys 0.030s
I20260709 13:07:37.799178 19012 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:37.825825 19068 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.806813 18785 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.763032 18912 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.948686 18912 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:37.949157 18912 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.950155 19056 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:37.951195 19056 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.833158 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:37.761610 18543 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:37.818251 19016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.017s
W20260709 13:07:37.802753 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61782.9us
I20260709 13:07:37.965688 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:37.863889 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.837836 18962 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:37.867158 19085 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:07:37.835440 18918 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.830752 18914 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:37.868391 19082 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:07:37.870335 18451 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.870505 18954 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.839785 18958 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.875236 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.831173 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:37.807082 18975 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:37.801014 18925 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:37.945308 18940 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:37.807760 18733 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.840790 18927 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:37.800784 19072 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.807241 18689 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:07:37.882725 18785 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.831032 19049 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:38.027853 19083 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:07:37.962312 19016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.000s	sys 0.018s
W20260709 13:07:38.269528 15692 connection.cc:256] RPC call timeout handler was delayed by -2.2603391970000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:07:38.251224 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 644) took 1433 ms. Trace:
W20260709 13:07:38.285169 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 319542us
I20260709 13:07:38.038656 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 908) took 2665 ms. Trace:
I20260709 13:07:38.285490 15577 rpcz_store.cc:276] 0709 13:07:36.818246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.596855 (+778609us) service_pool.cc:224] Handling call
0709 13:07:37.618004 (+ 21149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.618209 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.757946 (+139737us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.250651 (+492705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.250737 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.250845 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.250952 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.251139 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":216834,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":144,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":626246,"threads_started":2}
I20260709 13:07:38.208729 18916 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.230199 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.300573 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.301970 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.305090 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:37.967581 19012 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:38.347131 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:38.347608 15729 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.286893 16274 rpcz_store.cc:276] 0709 13:07:35.373733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.728753 (+355020us) service_pool.cc:224] Handling call
0709 13:07:35.836484 (+107731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.080131 (+243647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.080162 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.085607 (+  5445us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.168406 (+ 82799us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.599758 (+431352us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.601146 (+  1388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.601315 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.763799 (+1162484us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:38.026003 (+262204us) raft_consensus.cc:1685] finished
0709 13:07:38.038424 (+ 12421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.038590 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466305,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":103,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2223,"spinlock_wait_cycles":10897664,"thread_start_us":483668,"threads_started":2,"wal-append.queue_time_us":456474}
W20260709 13:07:38.349196 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1751) took 2286 ms (client timeout 2136 ms). Trace:
W20260709 13:07:38.349743 15573 rpcz_store.cc:269] 0709 13:07:36.063874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.064046 (+   172us) service_pool.cc:224] Handling call
0709 13:07:38.349019 (+2284973us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540026c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.349132 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736519936}
I20260709 13:07:38.368587 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:38.405228 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:38.406258 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.403026 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:38.406270 15721 raft_consensus.cc:2410] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:38.022974 18918 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:38.331051 19090 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:07:38.426532 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.406183 19024 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.427882 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.429020 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.429665 15722 raft_consensus.cc:2393] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:38.430368 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:38.430421 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.431233 15577 raft_consensus.cc:2410] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:38.431474 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.432019 15722 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:38.308954 18785 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.406419 18925 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.434316 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1928) took 2240 ms. Trace:
W20260709 13:07:38.443235 15692 connection.cc:256] RPC call timeout handler was delayed by -2.0275651839999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:07:38.443727 15692 connection.cc:256] RPC call timeout handler was delayed by -1.8988651839999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:07:38.444162 15692 connection.cc:256] RPC call timeout handler was delayed by -1.8025651840000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:07:38.443240 15726 rpcz_store.cc:276] 0709 13:07:36.194393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.203578 (+  9185us) service_pool.cc:224] Handling call
0709 13:07:36.230217 (+ 26639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.043259 (+813042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.043294 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.082298 (+ 39004us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.475949 (+393651us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.476009 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.476105 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.434079 (+957974us) raft_consensus.cc:1685] finished
0709 13:07:38.434102 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.434257 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":697757,"raft.queue_time_us":577967,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5014,"thread_start_us":672428,"threads_started":2,"wal-append.queue_time_us":509742}
I20260709 13:07:38.433667 15729 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:38.445453 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:38.309871 18995 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:38.438637 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.405763 18958 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.463109 15726 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:38.414968 15655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2297) took 1582 ms (client timeout 2071 ms). Trace:
I20260709 13:07:38.446694 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:38.467660 15655 rpcz_store.cc:269] 0709 13:07:36.772407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.775002 (+  2595us) service_pool.cc:224] Handling call
0709 13:07:38.355049 (+1580047us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002486d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.355218 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408619264}
I20260709 13:07:38.468482 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:38.450220 19016 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.025207 18914 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.332734 18845 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:38.491379 15574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 642) took 1697 ms (client timeout 2032 ms). Trace:
W20260709 13:07:38.491807 15574 rpcz_store.cc:269] 0709 13:07:36.793833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.281041 (+487208us) service_pool.cc:224] Handling call
0709 13:07:38.491194 (+1210153us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54002c6d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.491324 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100291968}
I20260709 13:07:38.493026 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.448616 15729 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.349395 19045 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:38.471973 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:38.498291 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:38.484501 19067 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:38.485023 18852 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.906s	user 0.005s	sys 0.006s
I20260709 13:07:38.485361 18872 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:38.489297 19026 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:38.489626 18577 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.976s	user 0.016s	sys 0.016s
I20260709 13:07:38.489687 19078 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.494308 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.498862 15574 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.511341 15722 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:38.514480 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:38.512415 18577 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:38.502889 19015 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.004s
W20260709 13:07:38.534911 19086 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
I20260709 13:07:38.537058 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 617) took 3288 ms. Trace:
I20260709 13:07:38.537508 15653 rpcz_store.cc:276] 0709 13:07:35.248428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.682072 (+433644us) service_pool.cc:224] Handling call
0709 13:07:35.682372 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.167789 (+485417us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.856954 (+689165us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.759241 (+902287us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.759779 (+   538us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.759908 (+   129us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.759940 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.760023 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.536810 (+776787us) raft_consensus.cc:1685] finished
0709 13:07:38.536834 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.536994 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25011,"prepare.queue_time_us":64612,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":184603,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12580,"spinlock_wait_cycles":10544000,"thread_start_us":1906229,"threads_started":3,"wal-append.queue_time_us":903074}
I20260709 13:07:38.541474 15650 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:38.490756 19016 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.509490 19067 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:38.550889 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.552183 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:38.548149 18425 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:38.553107 19089 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:07:38.555898 19079 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.752s	user 0.001s	sys 0.001s
I20260709 13:07:38.509276 18852 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:38.580008 15648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1793) took 2931 ms (client timeout 3265 ms). Trace:
I20260709 13:07:38.580905 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1770) took 1313 ms. Trace:
I20260709 13:07:38.598490 15729 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:38.598726 15575 rpcz_store.cc:276] 0709 13:07:37.267174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.417702 (+150528us) service_pool.cc:224] Handling call
0709 13:07:38.580711 (+1163009us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540026cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.580848 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427185920}
I20260709 13:07:38.581578 15580 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:38.565177 15574 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:38.599707 15580 pending_rounds.cc:85] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 6
I20260709 13:07:38.599989 15580 pending_rounds.cc:107] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:38.600270 15580 raft_consensus.cc:2889] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:38.582324 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2299) took 1809 ms. Trace:
I20260709 13:07:38.601099 15654 rpcz_store.cc:276] 0709 13:07:36.772913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.830974 (+ 58061us) service_pool.cc:224] Handling call
0709 13:07:36.831382 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.371414 (+540032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.582112 (+1210698us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:38.582272 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240587136}
I20260709 13:07:38.602596 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:38.603997 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:38.604624 15654 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:38.583058 15724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1911) took 3783 ms (client timeout 2229 ms). Trace:
W20260709 13:07:38.605180 15724 rpcz_store.cc:269] 0709 13:07:34.799418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.930517 (+131099us) service_pool.cc:224] Handling call
0709 13:07:38.582886 (+3652369us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540011b7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.582990 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4846651136}
I20260709 13:07:38.587585 15725 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:38.591229 19034 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.591938 19096 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:38.594411 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:38.598555 15648 rpcz_store.cc:269] 0709 13:07:35.649062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.682062 (+ 33000us) service_pool.cc:224] Handling call
0709 13:07:38.579747 (+2897685us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.579913 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899066880}
I20260709 13:07:38.588572 19067 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.626628 15648 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:38.627319 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 621) took 1524 ms. Trace:
I20260709 13:07:38.627650 15648 rpcz_store.cc:276] 0709 13:07:37.103273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.625897 (+1522624us) service_pool.cc:224] Handling call
0709 13:07:38.626269 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.627051 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.627259 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.628859 15648 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:38.629405 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 623) took 1516 ms. Trace:
I20260709 13:07:38.629699 15648 rpcz_store.cc:276] 0709 13:07:37.113452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.628399 (+1514947us) service_pool.cc:224] Handling call
0709 13:07:38.628701 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.629192 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.629356 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.587118 15655 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:38.635088 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1926) took 2455 ms. Trace:
I20260709 13:07:38.642584 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.654156 15654 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:38.655674 18733 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.672150 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1795) took 1279 ms. Trace:
I20260709 13:07:38.672780 15654 rpcz_store.cc:276] 0709 13:07:37.392966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.670977 (+1278011us) service_pool.cc:224] Handling call
0709 13:07:38.671455 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.671697 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.671738 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.671797 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.671844 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.671921 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.672071 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.676334 18912 consensus_meta.cc:287] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.000s
I20260709 13:07:38.677003 18912 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:38.665854 15577 raft_consensus.cc:2410] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:38.676257 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1796) took 1257 ms. Trace:
I20260709 13:07:38.503788 19012 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:38.680397 15654 rpcz_store.cc:276] 0709 13:07:37.419045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.675191 (+1256146us) service_pool.cc:224] Handling call
0709 13:07:38.675595 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.675825 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.675866 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.675926 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:38.675972 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.676050 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.676189 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.661258 15720 rpcz_store.cc:276] 0709 13:07:36.180112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.180259 (+   147us) service_pool.cc:224] Handling call
0709 13:07:36.180634 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.601762 (+421128us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:36.989584 (+387822us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.770238 (+780654us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.770384 (+   146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.799342 (+ 28958us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.799518 (+   176us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.799554 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.799643 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.634835 (+835192us) raft_consensus.cc:1685] finished
0709 13:07:38.634859 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.635019 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702045,"prepare.queue_time_us":480186,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":735880,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4201,"spinlock_wait_cycles":16501120,"thread_start_us":1212958,"threads_started":4,"wal-append.queue_time_us":596205}
I20260709 13:07:38.687161 15648 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:38.688009 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1794) took 1304 ms. Trace:
I20260709 13:07:38.688459 15648 rpcz_store.cc:276] 0709 13:07:37.383390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.679050 (+1295660us) service_pool.cc:224] Handling call
0709 13:07:38.686678 (+  7628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.687693 (+  1015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.687936 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.681108 18433 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.513s	user 0.015s	sys 0.006s
I20260709 13:07:38.694280 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 643) took 1887 ms. Trace:
I20260709 13:07:38.656965 19039 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:38.694836 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 628) took 1579 ms. Trace:
I20260709 13:07:38.696736 15576 rpcz_store.cc:276] 0709 13:07:36.806934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.562360 (+755426us) service_pool.cc:224] Handling call
0709 13:07:37.562791 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.564534 (+  1743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.564580 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.565168 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.746263 (+181095us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:37.746302 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.746373 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.694060 (+947687us) raft_consensus.cc:1685] finished
0709 13:07:38.694080 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.694215 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":440,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":14274,"thread_start_us":166400,"threads_started":1,"wal-append.queue_time_us":387696}
I20260709 13:07:38.702608 15579 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:38.704026 15726 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:38.638831 19034 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:38.717670 15723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.070s	sys 0.108s
W20260709 13:07:38.720273 15723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.071s	sys 0.108s
I20260709 13:07:38.706848 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:38.708209 19043 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 2.176s	user 0.006s	sys 0.021s
W20260709 13:07:38.725485 15572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.039s	sys 0.099s
I20260709 13:07:38.723258 19016 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.698462 15655 rpcz_store.cc:276] 0709 13:07:37.115074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.494816 (+1379742us) service_pool.cc:224] Handling call
0709 13:07:38.694755 (+199939us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.727521 15572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.039s	sys 0.099s
I20260709 13:07:38.727701 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.726334 18918 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.735251 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.699771 19039 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:38.738296 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.735882 15576 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:38.706621 18857 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.741047 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.743923 15720 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:38.746186 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:38.746873 15720 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:38.719725 18940 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:38.759168 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:38.759580 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:38.768453 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.768844 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:38.757750 18956 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.999s	user 0.007s	sys 0.003s
I20260709 13:07:38.769567 15726 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:38.773998 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1114) took 1427 ms. Trace:
I20260709 13:07:38.774487 16271 rpcz_store.cc:276] 0709 13:07:37.346410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.373360 (+ 26950us) service_pool.cc:224] Handling call
0709 13:07:37.373607 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.569534 (+195927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.773715 (+1204181us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540044c5d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:38.773934 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369263488}
W20260709 13:07:38.775274 15652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 627) took 1660 ms (client timeout 1908 ms). Trace:
W20260709 13:07:38.775818 15652 rpcz_store.cc:269] 0709 13:07:37.114781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.180760 (+ 65979us) service_pool.cc:224] Handling call
0709 13:07:38.775079 (+1594319us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54002e2f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.775207 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125872512}
I20260709 13:07:38.779359 18959 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:38.782148 19069 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 1.646s	user 0.010s	sys 0.018s
I20260709 13:07:38.777810 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1803) took 1242 ms. Trace:
I20260709 13:07:38.786792 15652 rpcz_store.cc:276] 0709 13:07:37.535533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.776819 (+1241286us) service_pool.cc:224] Handling call
0709 13:07:38.777193 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.777401 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.777439 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.777508 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.777553 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.777624 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.777745 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.788210 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1802) took 1253 ms. Trace:
I20260709 13:07:38.790809 15655 rpcz_store.cc:276] 0709 13:07:37.535206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.728139 (+1192933us) service_pool.cc:224] Handling call
0709 13:07:38.787513 (+ 59374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.787755 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.787796 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.787853 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.787902 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.787981 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.788138 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.795393 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:38.796387 15577 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:38.797595 18852 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.756458 18857 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.807787 15655 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:38.808739 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 910) took 3360 ms. Trace:
I20260709 13:07:38.822103 16272 rpcz_store.cc:276] 0709 13:07:35.468894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.825006 (+356112us) service_pool.cc:224] Handling call
0709 13:07:35.847672 (+ 22666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.042444 (+194772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.042499 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.043093 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.182266 (+139173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.661532 (+479266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.715353 (+ 53821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.715540 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.661282 (+1945742us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:38.805491 (+144209us) raft_consensus.cc:1685] finished
0709 13:07:38.808476 (+  2985us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.808661 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271218,"prepare.queue_time_us":452921,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":257463,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":70792,"spinlock_wait_cycles":10504960,"thread_start_us":538052,"threads_started":2,"wal-append.queue_time_us":231926}
I20260709 13:07:38.816414 15726 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:38.817572 19076 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.776s	user 0.004s	sys 0.014s
I20260709 13:07:38.818213 19071 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:38.818843 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.042s	sys 0.109s
I20260709 13:07:38.821169 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:38.826398 15577 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:38.812418 19068 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.002s
I20260709 13:07:38.827721 19068 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:38.820550 18962 consensus_meta.cc:287] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.795s	user 0.003s	sys 0.009s
I20260709 13:07:38.826458 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:38.827016 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.043s	sys 0.109s
I20260709 13:07:38.785184 18956 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:38.831521 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.07563e+06us
I20260709 13:07:38.789635 19039 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:38.833365 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:38.834685 15618 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.048s	sys 0.053s
W20260709 13:07:38.849478 15618 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.050s	sys 0.054s
I20260709 13:07:38.834431 19039 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.836201 16235 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:38.852018 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.02533e+06us
I20260709 13:07:38.829548 18912 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:38.856895 16235 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:38.862958 18872 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.852605 18425 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:38.865962 18956 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:38.850121 19068 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:38.848552 18845 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:38.835662 18962 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.849951 19048 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:38.831727 19071 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:38.873471 15571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 641) took 2112 ms (client timeout 1539 ms). Trace:
W20260709 13:07:38.876713 15571 rpcz_store.cc:269] 0709 13:07:36.760962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.793863 (+ 32901us) service_pool.cc:224] Handling call
0709 13:07:38.873222 (+2079359us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000d4dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.873378 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182914304}
I20260709 13:07:38.878690 15571 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:38.866493 18425 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.880208 19068 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:38.881820 19068 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:38.884114 19068 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:38.885634 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:38.887147 18998 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:38.887459 15578 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:38.875769 18537 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:38.888688 18537 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:38.888837 16276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 903) took 3519 ms (client timeout 1949 ms). Trace:
I20260709 13:07:38.889120 18537 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:38.889281 16276 rpcz_store.cc:269] 0709 13:07:35.369207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.379780 (+ 10573us) service_pool.cc:224] Handling call
0709 13:07:38.888624 (+3508844us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.888766 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117771648}
I20260709 13:07:38.889717 18998 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:38.890714 16269 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:38.893448 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.866328 19049 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:38.896782 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 671) took 1805 ms (client timeout 2040 ms). Trace:
W20260709 13:07:38.898808 16278 rpcz_store.cc:269] 0709 13:07:37.091738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.131973 (+ 40235us) service_pool.cc:224] Handling call
0709 13:07:38.896582 (+1764609us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54002d5d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.896715 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206170496}
I20260709 13:07:38.875423 19048 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:38.890581 19071 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.881829 18425 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:38.871654 19034 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.832352 19067 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.951812 18872 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:38.962859 16235 connection.cc:256] RPC call timeout handler was delayed by -1.3107688549999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:07:38.966987 19063 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:38.969197 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1800) took 1542 ms. Trace:
I20260709 13:07:38.976416 15650 rpcz_store.cc:276] 0709 13:07:37.427134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.766177 (+339043us) service_pool.cc:224] Handling call
0709 13:07:38.968992 (+1202815us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400369054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:38.969128 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330115328}
I20260709 13:07:38.973256 18857 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:38.965763 19073 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.131s	user 0.009s	sys 0.002s
I20260709 13:07:38.952373 18918 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:38.981073 16276 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:38.983273 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:38.985926 16274 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:38.986420 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:38.977130 19063 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:38.991266 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:38.998981 19063 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.000475 19063 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:39.000543 16272 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:39.002899 16278 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:07:38.993459 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.013345 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.014205 16274 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:38.977850 18872 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:39.012490 18785 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.002s
W20260709 13:07:39.042714 16238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.002s	sys 0.048s
W20260709 13:07:39.043116 16238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.002s	sys 0.048s
W20260709 13:07:39.044283 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.044478 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:38.988906 19073 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:38.988437 18914 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:39.057394 16235 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.539s (SENT)
I20260709 13:07:39.078680 15654 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:39.081471 15720 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:39.004360 19048 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.045033 18785 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:39.081673 19006 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.527s	user 0.012s	sys 0.012s
I20260709 13:07:39.099273 18857 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.101444 18857 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.104131 18857 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:39.091521 19046 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 2.591s	user 0.010s	sys 0.025s
W20260709 13:07:39.091521 18928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.027s	sys 0.028s
I20260709 13:07:39.098830 19006 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:39.114079 19032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.027s	sys 0.029s
W20260709 13:07:39.136456 18954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.020s
I20260709 13:07:39.099206 18962 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:39.145957 19039 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.154861 19039 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.114390 19048 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.120760 18928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.027s	sys 0.028s
W20260709 13:07:39.121119 18960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.007s	sys 0.043s
W20260709 13:07:39.147432 18954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.005s	sys 0.021s
W20260709 13:07:39.153039 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.024s	sys 0.022s
W20260709 13:07:39.161299 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.000s	sys 0.026s
I20260709 13:07:39.161298 15652 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:39.168946 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.025s	sys 0.022s
W20260709 13:07:39.169072 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.000s	sys 0.026s
W20260709 13:07:39.131387 15721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.018s
W20260709 13:07:39.169421 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 735441us
W20260709 13:07:39.169994 15721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.018s
W20260709 13:07:39.163816 18960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.007s	sys 0.043s
W20260709 13:07:39.145255 19032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.028s	sys 0.029s
W20260709 13:07:39.161656 19089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.022s
W20260709 13:07:39.169581 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 701122us
I20260709 13:07:39.164621 18451 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:39.176681 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2323) took 4013 ms. Trace:
I20260709 13:07:39.177273 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1771) took 1373 ms. Trace:
I20260709 13:07:39.192085 15722 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.183286 15728 rpcz_store.cc:276] 0709 13:07:35.163735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.676161 (+512426us) service_pool.cc:224] Handling call
0709 13:07:35.676557 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.710657 (+ 34100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.710701 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.711252 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.171432 (+460180us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:36.599390 (+427958us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.357804 (+758414us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b1800100420. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:07:37.357972 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.358066 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.984600 (+1626534us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:39.176482 (+191882us) raft_consensus.cc:1685] finished
0709 13:07:39.176503 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.176625 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264827,"prepare.queue_time_us":589579,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":794811,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":8145,"spinlock_wait_cycles":19299328,"thread_start_us":622775,"threads_started":2,"wal-append.queue_time_us":384805}
I20260709 13:07:39.195286 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:39.199502 18537 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.183415 15572 rpcz_store.cc:276] 0709 13:07:37.803472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.803628 (+   156us) service_pool.cc:224] Handling call
0709 13:07:37.803915 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.804123 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:38.727957 (+923834us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.176891 (+448934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.176954 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.177008 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.177084 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.177211 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67498,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":2424,"raft.run_wall_time_us":1901,"thread_start_us":1371518,"threads_started":2}
W20260709 13:07:39.179642 19089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.023s
W20260709 13:07:39.209930 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.210848 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:39.212534 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:39.202526 19101 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:39.201687 19067 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.201759 18537 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:39.233836 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:39.235571 15573 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:39.235561 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:39.238898 15692 leader_election.cc:336] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.975s (SENT)
I20260709 13:07:39.239351 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:39.239766 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:39.240322 15573 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.241266 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:39.241974 15650 raft_consensus.cc:606] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:39.206342 18451 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.245642 19064 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.245960 19052 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:39.246515 19052 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:39.247545 19052 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.249097 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:39.249820 15650 raft_consensus.cc:606] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:39.239245 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:39.250272 15650 raft_consensus.cc:614] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.250815 15578 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:39.251991 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:39.253563 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:39.254273 15650 raft_consensus.cc:606] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:39.254664 15650 raft_consensus.cc:614] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.257609 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c036f4b115e847feb37d916989af7159"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:39.259347 18451 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.260277 18965 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:39.260694 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.260663 18965 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:39.261772 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:39.210192 18928 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.213500 19073 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.231321 18914 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:39.225682 18872 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:39.264849 19046 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:39.287617 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:39.299309 15722 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:39.290863 19041 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 2.656s	user 0.013s	sys 0.036s
I20260709 13:07:39.261591 18965 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.296396 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1117) took 1949 ms. Trace:
W20260709 13:07:39.297423 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.302631 16269 rpcz_store.cc:276] 0709 13:07:37.347363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.375470 (+ 28107us) service_pool.cc:224] Handling call
0709 13:07:38.890506 (+1515036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.891220 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.296124 (+404904us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54005609d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:39.296313 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3483619584}
I20260709 13:07:39.226462 19071 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.288666 19032 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.304116 19040 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.313671 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 616) took 4074 ms. Trace:
I20260709 13:07:39.312455 15573 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:39.317818 15578 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:39.299953 19073 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.299361 19039 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.318099 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:39.320791 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:39.314091 15646 rpcz_store.cc:276] 0709 13:07:35.239663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.590329 (+350666us) service_pool.cc:224] Handling call
0709 13:07:35.590723 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.129741 (+539018us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:36.169422 (+ 39681us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.598932 (+429510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.598997 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.599043 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.313447 (+2714404us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54002698d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:39.313491 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.313612 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26984,"prepare.queue_time_us":39498,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":4231,"raft.queue_time_us":112,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1239072896,"thread_start_us":428788,"threads_started":1,"wal-append.queue_time_us":459711,"wal-append.run_cpu_time_us":19198,"wal-append.run_wall_time_us":1171270}
I20260709 13:07:39.304174 18845 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:39.320415 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1929) took 1952 ms. Trace:
I20260709 13:07:39.326753 15723 rpcz_store.cc:276] 0709 13:07:37.367682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.370090 (+  2408us) service_pool.cc:224] Handling call
0709 13:07:37.370446 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.693625 (+323179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.693671 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.694290 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.720611 (+1026321us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.720655 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.720728 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.320190 (+599462us) raft_consensus.cc:1685] finished
0709 13:07:39.320224 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.320360 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70888,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1348574,"threads_started":2,"wal-append.queue_time_us":1345418}
I20260709 13:07:39.328874 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:39.325023 15722 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:39.308409 18785 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:39.289999 18928 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.340161 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:39.340885 15722 raft_consensus.cc:2376] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9. Re-sending same reply.
W20260709 13:07:39.344960 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.348212 16276 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:39.362301 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1719) took 1026 ms. Trace:
I20260709 13:07:39.363082 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.363718 16271 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:39.362743 15571 rpcz_store.cc:276] 0709 13:07:38.335811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.879787 (+543976us) service_pool.cc:224] Handling call
0709 13:07:38.899832 (+ 20045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.900106 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.900145 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.903888 (+  3743us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.210422 (+306534us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:39.210457 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.210525 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.362096 (+151571us) raft_consensus.cc:1685] finished
0709 13:07:39.362116 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.362241 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":242679,"threads_started":1,"wal-append.queue_time_us":402586}
I20260709 13:07:39.365439 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.366075 16269 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:39.366542 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:39.366890 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:39.367635 16269 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:39.369315 15722 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:39.370080 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.371345 18433 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:39.371920 18433 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.374197 18433 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.375820 18852 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.376343 18852 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.378412 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.378661 18852 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.379096 16269 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:39.379228 18852 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.379735 18852 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.380095 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.319406 19040 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.382246 18852 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:39.352170 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:39.386535 18928 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:39.342164 19018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.905s	user 0.025s	sys 0.063s
I20260709 13:07:39.352728 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2295) took 2582 ms. Trace:
I20260709 13:07:39.325371 18965 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.387454 19018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.015s	user 0.025s	sys 0.063s
I20260709 13:07:39.387521 15649 rpcz_store.cc:276] 0709 13:07:36.770524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.771399 (+   875us) service_pool.cc:224] Handling call
0709 13:07:36.771668 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.682663 (+910995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.340110 (+1657447us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b540017c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:39.352660 (+ 12550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960726272}
I20260709 13:07:39.388160 18997 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:39.389755 18852 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.359055 18845 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.384140 18433 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.384244 16269 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:39.386904 16272 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.358047 15650 raft_consensus.cc:606] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:39.320812 19073 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:39.353274 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:39.400046 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 634) took 1966 ms. Trace:
W20260709 13:07:39.401186 19115 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:39.402413 18965 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:39.318995 19032 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.406136 19042 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.408553 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1115) took 2061 ms. Trace:
I20260709 13:07:39.430456 15648 rpcz_store.cc:276] 0709 13:07:37.434018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.699802 (+1265784us) service_pool.cc:224] Handling call
0709 13:07:38.700249 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.700819 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.700863 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.701979 (+  1116us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.179917 (+477938us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.179964 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.180035 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.399745 (+219710us) raft_consensus.cc:1685] finished
0709 13:07:39.399773 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.399966 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10852,"thread_start_us":437920,"threads_started":1,"wal-append.queue_time_us":610840}
I20260709 13:07:39.465368 16270 rpcz_store.cc:276] 0709 13:07:37.346777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.347145 (+   368us) service_pool.cc:224] Handling call
0709 13:07:37.347528 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.423077 (+ 75549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.423118 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.428208 (+  5090us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.744892 (+316684us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:37.744950 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.408028 (+1663078us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54006306d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:39.408112 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.408171 (+    59us) raft_consensus.cc:1685] finished
0709 13:07:39.408191 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.408464 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":699,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6084,"spinlock_wait_cycles":172717824,"thread_start_us":281599,"threads_started":1,"wal-append.queue_time_us":1110631}
I20260709 13:07:39.429113 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:39.469344 15722 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:39.472813 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44114.1us
I20260709 13:07:39.429651 19073 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.636412 19126 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.637665 19126 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:39.638813 15620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.018s	sys 0.034s
W20260709 13:07:39.639210 15620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.018s	sys 0.034s
I20260709 13:07:39.640805 15693 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:39.643515 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:39.644580 15646 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:39.683022 15722 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
W20260709 13:07:39.709309 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 68570.9us
W20260709 13:07:39.724036 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.641933 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.811046 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.811978 15648 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:39.638101 19126 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:39.637985 18825 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 13:07:39.814384 19126 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.815609 19126 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.815721 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:39.465080 18852 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.818359 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:39.819113 15655 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:39.819321 18852 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.819906 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.821285 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.471796 19042 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:39.821941 15655 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:39.826723 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 60943us
W20260709 13:07:39.829113 15577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.021s	sys 0.050s
W20260709 13:07:39.829674 15577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.050s
I20260709 13:07:39.830582 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1775) took 2020 ms. Trace:
I20260709 13:07:39.828748 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:39.836315 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.862238 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.862576 15646 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:39.465283 18433 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.835038 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.870311 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:39.831113 15577 rpcz_store.cc:276] 0709 13:07:37.809953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.828633 (+1018680us) service_pool.cc:224] Handling call
0709 13:07:38.834164 (+  5531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.834357 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:38.847733 (+ 13376us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.830139 (+982406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.830212 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.830281 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.830371 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.830517 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28370,"prepare.queue_time_us":163112,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":77720,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9727,"thread_start_us":953448,"threads_started":2,"wal-append.queue_time_us":515434}
W20260709 13:07:39.871240 15721 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.000s	sys 0.014s
W20260709 13:07:39.900383 15721 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.000s	sys 0.014s
I20260709 13:07:39.864686 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1940) took 1127 ms. Trace:
W20260709 13:07:39.872985 16273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 666) took 2786 ms (client timeout 1975 ms). Trace:
W20260709 13:07:39.902967 16273 rpcz_store.cc:269] 0709 13:07:37.086337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.087255 (+   918us) service_pool.cc:224] Handling call
0709 13:07:39.872800 (+2785545us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400639f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:39.872907 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445183360}
W20260709 13:07:39.905468 16235 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.031s	sys 0.061s
W20260709 13:07:39.906282 16235 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.031s	sys 0.061s
W20260709 13:07:39.906596 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 666571us
I20260709 13:07:39.835323 18927 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.826691 19006 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:39.919062 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2298) took 3146 ms. Trace:
I20260709 13:07:39.863967 19067 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:39.815496 18825 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:39.834978 19114 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:39.868546 18857 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.001s	sys 0.027s
I20260709 13:07:39.931830 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:39.932618 15726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.023s	sys 0.012s
W20260709 13:07:39.930401 15572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.031s	sys 0.024s
I20260709 13:07:40.046187 19036 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:39.920073 15651 rpcz_store.cc:276] 0709 13:07:36.772658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.808420 (+ 35762us) service_pool.cc:224] Handling call
0709 13:07:36.808744 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.166193 (+357449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.166230 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.166720 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.476391 (+309671us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:37.492826 (+ 16435us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.531166 (+ 38340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.911648 (+2380482us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540017cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:39.911696 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.911736 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:39.918801 (+  7065us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.918987 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73268,"prepare.queue_time_us":7963,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4839,"raft.queue_time_us":144980,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"spinlock_wait_cycles":668916480,"thread_start_us":297009,"threads_started":1,"wal-append.queue_time_us":452200,"wal-append.run_cpu_time_us":3812,"wal-append.run_wall_time_us":1880828}
I20260709 13:07:40.007299 19067 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:39.940995 19006 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:40.072412 18857 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.001s	sys 0.027s
I20260709 13:07:39.905331 19020 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:39.819931 18852 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:07:40.082858 19020 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:40.083087 18852 consensus_queue.cc:1243] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:40.009294 18928 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.083848 18928 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.083915 19020 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:39.985525 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.011s	sys 0.011s
W20260709 13:07:40.086416 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.012s	sys 0.011s
W20260709 13:07:40.087136 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 874631us
I20260709 13:07:40.088483 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:39.999884 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:39.875633 18785 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.089826 15655 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:40.091886 15655 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.093490 15655 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.037714 15722 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:07:39.992736 19063 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.005s
I20260709 13:07:39.917424 18995 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:40.056943 18104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.023s	sys 0.026s
I20260709 13:07:40.066531 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 631) took 3566 ms. Trace:
W20260709 13:07:40.027596 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.016s	sys 0.049s
W20260709 13:07:40.067652 15692 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.025s	sys 0.054s
W20260709 13:07:40.210256 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.019s	sys 0.053s
I20260709 13:07:40.210104 15580 rpcz_store.cc:276] 0709 13:07:36.500392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.432324 (+931932us) service_pool.cc:224] Handling call
0709 13:07:38.581236 (+1148912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.600784 (+ 19548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.066217 (+1465433us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540026cd50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.066447 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2616593152}
W20260709 13:07:40.211236 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 949473us
W20260709 13:07:40.211951 18104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.024s	sys 0.027s
I20260709 13:07:40.212152 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:40.069514 19052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.016s	sys 0.058s
W20260709 13:07:40.073053 15726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.023s	sys 0.012s
W20260709 13:07:40.073115 15572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.032s	sys 0.025s
I20260709 13:07:40.213994 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:40.218930 18765 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.219492 18765 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:40.219962 18765 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:40.220490 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.928s (SENT) [suppressed 13 similar messages]
I20260709 13:07:39.914211 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 671) took 1962 ms. Trace:
I20260709 13:07:40.222222 15721 rpcz_store.cc:276] 0709 13:07:37.952034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.455575 (+503541us) service_pool.cc:224] Handling call
0709 13:07:38.455907 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.456326 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.456367 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.472938 (+ 16571us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.171108 (+698170us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:39.910767 (+739659us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.913754 (+  2987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.913879 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.913938 (+    59us) raft_consensus.cc:1685] finished
0709 13:07:39.913957 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.914148 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193253,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":5746,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":15933,"thread_start_us":1385538,"threads_started":2,"wal-append.queue_time_us":705983}
I20260709 13:07:40.224054 18852 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:40.224946 18852 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:40.224983 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:40.225857 18852 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.226249 18852 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:40.076692 15651 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:40.226670 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:40.227013 18852 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.227536 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:40.228185 18852 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.228394 19145 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.228812 19145 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:40.078154 15653 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.080751 19067 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:39.918565 18927 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.062045 19032 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.101289 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.107985 18928 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.092391 15648 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:40.085850 19020 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.114946 19125 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.115592 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:40.120417 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 492974us
I20260709 13:07:40.113317 19124 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.190953 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.116214 18785 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:40.205816 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1116) took 2858 ms. Trace:
W20260709 13:07:40.210314 15692 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.025s	sys 0.054s
I20260709 13:07:40.216775 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1944) took 1367 ms. Trace:
I20260709 13:07:40.231158 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1724) took 1003 ms. Trace:
W20260709 13:07:40.232757 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.242949 19139 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.247252 19139 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.247707 19139 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.244818 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 998347us
W20260709 13:07:40.249197 19131 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.203s	user 0.001s	sys 0.002s
I20260709 13:07:40.249378 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:40.239940 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:40.250422 15653 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:40.251299 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.251561 18914 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.251878 15653 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:40.252085 18914 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.253016 19067 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.253676 19067 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:40.239741 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.254302 15655 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:40.254110 19067 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.254453 18900 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.255128 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.255029 18900 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.255698 15655 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:40.255769 18577 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.256249 19067 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.256531 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.257040 18900 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.258134 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:40.258406 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 142924us
I20260709 13:07:40.259255 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.259805 15575 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:40.260510 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:40.261554 15721 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:40.262214 18849 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.262571 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.262737 19047 consensus_queue.cc:1059] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:40.262876 18849 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:40.263676 19047 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:40.264040 19047 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:40.246855 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1804) took 2662 ms. Trace:
I20260709 13:07:40.264400 19047 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.244601 16275 rpcz_store.cc:276] 0709 13:07:37.347104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.375113 (+ 28009us) service_pool.cc:224] Handling call
0709 13:07:37.375421 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.499095 (+123674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.205510 (+2706415us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b5400346f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:40.205739 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210618624}
I20260709 13:07:40.264742 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 633) took 2831 ms. Trace:
I20260709 13:07:40.242945 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:40.264457 15652 rpcz_store.cc:276] 0709 13:07:37.584143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.789060 (+1204917us) service_pool.cc:224] Handling call
0709 13:07:38.789412 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.169288 (+379876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.246593 (+1077305us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400085054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:40.246790 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854654848}
I20260709 13:07:40.265892 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:40.266111 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.267174 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.267249 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:40.267782 15652 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:40.268083 15727 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:40.268944 15652 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:40.269035 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:40.269732 15727 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.270838 19030 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.271474 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.272102 15575 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:40.272665 19124 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.206173 18433 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.274628 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:40.275035 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.231837 19063 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.277062 19063 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:40.277506 19063 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.252701 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:40.278636 19071 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.278712 15653 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.281383 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.281629 18785 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.257073 15655 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:40.283536 18959 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:40.283947 15655 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:07:40.285213 15579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 645) took 3017 ms (client timeout 1939 ms). Trace:
W20260709 13:07:40.285624 15579 rpcz_store.cc:269] 0709 13:07:37.268147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.294896 (+ 26749us) service_pool.cc:224] Handling call
0709 13:07:40.285056 (+2990160us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540038ead4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.285150 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054599424}
W20260709 13:07:40.216167 19052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.016s	sys 0.058s
I20260709 13:07:40.216055 18995 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.233678 18998 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.244920 15726 rpcz_store.cc:276] 0709 13:07:38.849547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.850770 (+  1223us) service_pool.cc:224] Handling call
0709 13:07:38.864250 (+ 13480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.864488 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:39.303044 (+438556us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.216409 (+913365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.216459 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:40.216518 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.216600 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.216722 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499647,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":532,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":1342118,"threads_started":2,"wal-append.queue_time_us":816826}
I20260709 13:07:40.290616 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:40.297039 15652 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:40.265272 15654 rpcz_store.cc:276] 0709 13:07:37.433756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.685033 (+1251277us) service_pool.cc:224] Handling call
0709 13:07:38.685482 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.079328 (+393846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.264515 (+1185187us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400247cd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:40.264685 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903480576}
I20260709 13:07:40.298161 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:40.299664 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.232899 16236 connection.cc:256] RPC call timeout handler was delayed by -1.7481950869998855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:07:40.263273 15721 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:40.302237 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.264658 18849 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:40.309664 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:40.229612 19145 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.289759 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:40.312628 16275 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:40.289390 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:40.245013 15572 rpcz_store.cc:276] 0709 13:07:39.227825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.227972 (+   147us) service_pool.cc:224] Handling call
0709 13:07:39.228299 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.230961 (+  2662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.230994 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:39.236472 (+  5478us) log.cc:844] Serialized 52 byte log entry
0709 13:07:40.217951 (+981479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:40.218008 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.230949 (+ 12941us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.230993 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:40.231005 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.231109 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2283,"raft.queue_time_us":6106,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":29804,"thread_start_us":906662,"threads_started":1,"wal-append.queue_time_us":897270}
I20260709 13:07:40.236589 18927 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.234455 18951 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:40.229984 18965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.064s	sys 0.075s
W20260709 13:07:40.305119 16236 connection.cc:256] RPC call timeout handler was delayed by -1.6518950869999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:07:40.240185 19146 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.243085 19032 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:40.362874 19032 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.365557 19032 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.369391 18862 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:40.370954 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1943) took 1612 ms. Trace:
I20260709 13:07:40.371347 15720 rpcz_store.cc:276] 0709 13:07:38.758711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.758887 (+   176us) service_pool.cc:224] Handling call
0709 13:07:40.370792 (+1611905us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001a4fd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.370898 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729866496}
I20260709 13:07:40.377167 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.377792 15726 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:40.378639 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.379684 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.380223 15726 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:40.380467 19040 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.380965 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.381647 15726 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:40.382051 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38248 (request call id 16) took 1124 ms. Trace:
I20260709 13:07:40.382426 15650 rpcz_store.cc:276] 0709 13:07:39.257284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.257421 (+   137us) service_pool.cc:224] Handling call
0709 13:07:40.381888 (+1124467us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0d853 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691 00007f2d93f6160c 00007f2d93f608c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.381954 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229412096}
I20260709 13:07:40.384943 18857 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.385334 18857 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:40.389279 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1930) took 3021 ms. Trace:
I20260709 13:07:40.389627 15725 rpcz_store.cc:276] 0709 13:07:37.368012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.370923 (+  2911us) service_pool.cc:224] Handling call
0709 13:07:38.583389 (+1212466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.607131 (+ 23742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.389081 (+1781950us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540011b7d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.389213 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787683712}
I20260709 13:07:40.390708 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.391708 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.392691 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.393209 15725 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:40.395097 19047 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.395532 19049 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:40.319576 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:40.283984 18959 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.310743 16277 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:40.282677 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:40.310055 18849 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:40.316004 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1017540049999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:07:40.414319 15618 connection.cc:256] RPC call timeout handler was delayed by -1.0918540049999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:07:40.316318 19052 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.327385 18965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.065s	sys 0.075s
W20260709 13:07:40.318883 16236 connection.cc:256] RPC call timeout handler was delayed by -1.5099865219999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:07:40.329671 19138 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:40.332340 19006 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.333069 19145 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.336788 19073 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.711s	user 0.002s	sys 0.006s
I20260709 13:07:40.340173 18951 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:39.901643 15724 rpcz_store.cc:276] 0709 13:07:38.737760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.738076 (+   316us) service_pool.cc:224] Handling call
0709 13:07:38.738319 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.738528 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:39.177714 (+439186us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.860629 (+682915us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.864286 (+  3657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:39.864334 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:39.864390 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.864505 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.864628 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3362,"prepare.queue_time_us":618762,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":161008,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":8236,"thread_start_us":714834,"threads_started":2}
I20260709 13:07:40.300714 18914 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:40.353184 19126 consensus_meta.cc:287] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 13:07:40.467797 15727 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:40.355106 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:40.402323 15653 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:40.398394 15655 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:40.408614 18765 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.296759 19077 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:40.410549 15720 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:40.416145 15728 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:40.425673 19138 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.419938 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:40.509585 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89797.1us
I20260709 13:07:40.369861 18862 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:40.422732 15650 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:40.423631 16236 connection.cc:256] RPC call timeout handler was delayed by -1.5045865219999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:07:40.510354 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4793865220000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:07:40.510661 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4763950869999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:07:40.510955 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3971950869998864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:07:40.511224 16236 connection.cc:256] RPC call timeout handler was delayed by -1.379195086999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:07:40.511487 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3692950869999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:07:40.511747 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3588391309999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:07:40.512027 16236 connection.cc:256] RPC call timeout handler was delayed by -1.0565592589999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:07:40.302605 18998 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.316241 19147 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.471155 15725 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:40.474434 16270 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:40.515940 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:40.416800 19063 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:40.418620 15723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.061s	sys 0.118s
I20260709 13:07:40.522630 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da1e42035c3d46ac90631305fec02672"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:40.523065 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1948) took 1209 ms. Trace:
I20260709 13:07:40.523401 15723 rpcz_store.cc:276] 0709 13:07:39.313237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.631006 (+317769us) service_pool.cc:224] Handling call
0709 13:07:39.631445 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.631690 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:39.915684 (+283994us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.522756 (+607072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.522804 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:40.522856 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.522914 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.523015 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212795,"prepare.queue_time_us":300076,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"thread_start_us":606696,"threads_started":1}
I20260709 13:07:40.479813 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 672) took 2527 ms. Trace:
I20260709 13:07:40.480768 18960 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:40.524869 15729 rpcz_store.cc:276] 0709 13:07:37.952283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.495255 (+542972us) service_pool.cc:224] Handling call
0709 13:07:38.513716 (+ 18461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.598973 (+ 85257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.479535 (+1880562us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b5400002154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:40.479739 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194161408}
I20260709 13:07:40.525341 18960 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.482064 19149 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:40.528553 19149 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.531447 19149 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.434540 19125 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.513887 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:40.516078 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:40.535837 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:40.410211 18857 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.538750 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:40.540019 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:40.426075 19052 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.514878 19138 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.520287 19126 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.524336 19147 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.533329 19125 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:40.560853 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.520242 19091 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.447237 19073 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.572978 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:40.520097 18733 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:07:40.576903 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.577616 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.524471 18716 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:07:40.578950 18951 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:40.522153 18849 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.579499 18951 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:40.579861 18849 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.579952 18951 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:40.580893 18951 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.573845 19091 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.583000 18765 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.583155 19042 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.584322 19042 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.571695 18988 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:40.570187 19147 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.583194 19063 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.560351 19017 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:40.588573 18862 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.589751 18862 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.542279 18940 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.597052 15693 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:40.602324 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.604558 15572 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:40.561846 18857 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.601969 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.563890 19047 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.597692 15654 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.559634 19112 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.594281 19052 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.620911 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1140) took 1251 ms. Trace:
I20260709 13:07:40.621363 16269 rpcz_store.cc:276] 0709 13:07:39.369100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.379855 (+ 10755us) service_pool.cc:224] Handling call
0709 13:07:40.620654 (+1240799us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5400816d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.620835 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8094592}
I20260709 13:07:40.600875 15649 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:40.607630 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:40.608006 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.635778 15572 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:40.636014 15579 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:40.637449 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.609783 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:40.638702 15573 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:40.639794 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:40.610646 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:40.640965 15578 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:40.578162 18900 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.611260 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:40.641976 18900 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:40.611586 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:40.642454 15577 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:40.642735 15571 raft_consensus.cc:2376] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9. Re-sending same reply.
I20260709 13:07:40.612428 19125 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.642488 18900 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.647720 16273 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:07:40.612751 19127 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.614s	user 0.000s	sys 0.007s
I20260709 13:07:40.521926 18577 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:40.541712 18691 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.563247 18998 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:40.520289 19077 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.669902 19077 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:40.670185 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.596451 19073 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:40.613122 18716 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:07:40.659185 19112 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.671671 19112 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.672196 19112 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.628750 18959 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.522138 18928 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:07:40.664980 18900 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:40.617148 18927 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.603668 18988 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:40.592900 19138 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:40.605265 18940 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.704273 18940 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.828778 19017 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:40.926070 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.004s	sys 0.015s
W20260709 13:07:40.927034 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.004s	sys 0.016s
W20260709 13:07:40.927723 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 653067us
W20260709 13:07:40.605443 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.934486 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 399745us
I20260709 13:07:40.613852 15574 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:40.670855 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.084170 18729 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.084875 18729 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:40.937664 15646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.019s	sys 0.010s
I20260709 13:07:41.086269 19048 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:41.087400 19048 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.088544 18959 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:40.939540 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 341522us
W20260709 13:07:40.933797 15580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.019s
W20260709 13:07:41.090399 15580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.010s	sys 0.022s
I20260709 13:07:40.959695 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2304) took 1310 ms. Trace:
I20260709 13:07:41.092978 15648 rpcz_store.cc:276] 0709 13:07:39.649408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.834697 (+185289us) service_pool.cc:224] Handling call
0709 13:07:40.959082 (+1124385us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400085a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:40.959389 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513371008}
W20260709 13:07:41.086336 15646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.019s	sys 0.010s
I20260709 13:07:40.979444 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:41.096276 15653 raft_consensus.cc:606] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:41.096818 15653 raft_consensus.cc:614] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:40.932904 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.015s
W20260709 13:07:41.098325 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.009s	sys 0.016s
W20260709 13:07:41.098856 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 859502us
I20260709 13:07:41.100024 19091 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:41.102706 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:40.994870 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.998798 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 480595us
I20260709 13:07:41.108038 18927 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.111848 19048 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:41.119807 15649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1809) took 1477 ms (client timeout 1894 ms). Trace:
W20260709 13:07:41.120498 15649 rpcz_store.cc:269] 0709 13:07:39.642751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.815442 (+172691us) service_pool.cc:224] Handling call
0709 13:07:41.119321 (+1303879us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002481d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:41.119573 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514024192}
I20260709 13:07:41.121322 18900 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:41.128167 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:41.131974 19073 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.132967 19073 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.138674 18988 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.140344 19073 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.142081 18716 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.143103 18716 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.147195 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:41.150604 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:41.151943 15728 raft_consensus.cc:2393] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:41.152247 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:41.158170 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1815) took 1334 ms. Trace:
W20260709 13:07:41.069084 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.002s
I20260709 13:07:41.076159 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:41.078805 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.003s	sys 0.018s
I20260709 13:07:40.976903 15721 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.150733 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:40.999895 16272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.027s
W20260709 13:07:41.184232 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 200915us
I20260709 13:07:41.218277 15580 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:41.219797 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.221200 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.211879 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.003s	sys 0.019s
I20260709 13:07:41.093073 19017 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.221771 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.246413 15578 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:41.254182 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.241367 15728 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:41.221813 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:41.238560 15572 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.004s
W20260709 13:07:41.225900 16272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.001s	sys 0.036s
I20260709 13:07:41.242638 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:41.220003 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:41.196604 18716 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:41.245663 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:41.334578 18577 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.336148 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:41.339366 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 823403us
I20260709 13:07:41.341666 18729 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.342639 15575 raft_consensus.cc:2376] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7. Re-sending same reply.
I20260709 13:07:41.342509 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:41.158638 15647 rpcz_store.cc:276] 0709 13:07:39.823735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.272693 (+448958us) service_pool.cc:224] Handling call
0709 13:07:40.272941 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.273139 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.273162 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.273551 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.686016 (+412465us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:40.686094 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.686197 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.157734 (+471537us) raft_consensus.cc:1685] finished
0709 13:07:41.157775 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.157984 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":411681,"threads_started":1,"wal-append.queue_time_us":881593}
I20260709 13:07:41.337652 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1955) took 1242 ms. Trace:
I20260709 13:07:41.252041 15723 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:07:41.351272 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.248005 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:41.247891 19147 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.661s	user 0.018s	sys 0.032s
W20260709 13:07:41.362859 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 293800us
I20260709 13:07:41.352072 15722 rpcz_store.cc:276] 0709 13:07:40.095368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.114660 (+ 19292us) service_pool.cc:224] Handling call
0709 13:07:40.116655 (+  1995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.116872 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.116896 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.180795 (+ 63899us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.523665 (+342870us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.523701 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.523775 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.314487 (+790712us) raft_consensus.cc:1685] finished
0709 13:07:41.328479 (+ 13992us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.337430 (+  8951us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":342419,"threads_started":1,"wal-append.queue_time_us":522132}
I20260709 13:07:41.226094 19149 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.236449 19049 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.227521 19138 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:41.362528 15693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.064s	sys 0.091s
I20260709 13:07:41.380195 15653 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:41.225426 18960 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:41.393705 15693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.065s	sys 0.092s
W20260709 13:07:41.396796 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 60910.8us
I20260709 13:07:41.222442 19034 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:41.401889 15572 raft_consensus.cc:2410] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:41.400828 18716 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.379595 19049 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:41.456048 15580 raft_consensus.cc:2368] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
W20260709 13:07:41.460575 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57849.1us
I20260709 13:07:41.466362 19149 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.467682 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 870616us
I20260709 13:07:41.467767 18577 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.471381 18433 raft_consensus.cc:2764] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:41.471256 18900 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.472436 19169 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:41.472863 19169 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:41.472945 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54071.1us
I20260709 13:07:41.474341 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:41.474174 19169 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.474629 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:41.475682 18900 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.476626 18900 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:41.477049 19169 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.477803 18900 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.486982 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:41.488765 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:41.490418 18825 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:41.490906 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:41.491590 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.491712 18914 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.492269 18914 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:41.492120 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:41.493448 18914 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.498165 15653 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:41.498502 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.499895 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:41.501507 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:41.488781 19162 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.502583 19162 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:41.502988 19162 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:41.510915 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57251.5us
I20260709 13:07:41.513564 18716 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.515529 19166 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:41.516567 18716 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:41.516284 19166 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.465699 19126 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.894s	user 0.014s	sys 0.004s
I20260709 13:07:41.524212 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:41.532531 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:41.543572 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:41.544562 15580 raft_consensus.cc:2368] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
W20260709 13:07:41.543007 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 296028us
I20260709 13:07:41.549021 15653 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:41.546900 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:41.542732 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:41.553510 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.555397 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:41.557292 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.553884 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:41.550642 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:41.559633 15577 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:41.458566 19147 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.586687 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.588778 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75522us
I20260709 13:07:41.540810 19126 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.603929 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:41.602696 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:41.608587 15576 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:41.533221 19034 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.611037 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 149051us
I20260709 13:07:41.615224 15580 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:41.619010 15651 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.619661 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:41.628592 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.632829 15572 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:41.627745 18729 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.640612 15580 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:07:41.643424 19052 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.643888 19052 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.644260 19052 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.644902 18914 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.648665 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:41.657713 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 183200us
W20260709 13:07:41.664762 19112 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.017s
I20260709 13:07:41.665303 19112 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.664805 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:41.667686 19112 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:41.668820 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:41.674116 15729 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:41.661928 19154 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:41.661500 19139 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.352s	user 0.023s	sys 0.007s
W20260709 13:07:41.682832 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 50480.6us
I20260709 13:07:41.657778 19126 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:07:41.688352 19020 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.688860 19020 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.689260 19020 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.690449 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 933) took 1366 ms. Trace:
I20260709 13:07:41.683956 19138 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.691447 19138 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:41.690871 16276 rpcz_store.cc:276] 0709 13:07:40.316719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.316841 (+   122us) service_pool.cc:224] Handling call
0709 13:07:40.317223 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:40.317756 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.317795 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:40.357706 (+ 39911us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b48000cc6d8. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:40.363128 (+  5422us) log.cc:844] Serialized 52 byte log entry
0709 13:07:41.470172 (+1107044us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:41.470769 (+   597us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.471082 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.471162 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.504810 (+ 33648us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b18004408c0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:41.672790 (+167980us) raft_consensus.cc:1685] finished
0709 13:07:41.672819 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.683490 (+ 10671us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1674,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1737,"raft.run_cpu_time_us":2792,"raft.run_wall_time_us":30739,"spinlock_wait_cycles":151465600,"thread_start_us":931310,"threads_started":1,"wal-append.queue_time_us":981780}
I20260709 13:07:41.693694 19138 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:41.698137 19042 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.066s	user 0.012s	sys 0.011s
I20260709 13:07:41.672326 19169 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.700505 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.702004 19139 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.703199 18995 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.401s	user 0.009s	sys 0.017s
I20260709 13:07:41.704829 19034 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.707749 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:41.680292 19166 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.653182 18960 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:07:41.740461 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 230754us
I20260709 13:07:41.709472 19020 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:41.737005 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46054.8us
I20260709 13:07:41.748729 15651 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:41.748946 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:41.750501 16235 leader_election.cc:336] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.857s (SENT)
I20260709 13:07:41.652041 19049 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.757393 19171 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:41.746227 18900 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.777778 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1814) took 1949 ms. Trace:
I20260709 13:07:41.806077 19012 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.806550 19020 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:41.806663 19015 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:41.807696 19015 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.808073 19015 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:41.808802 19168 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
W20260709 13:07:41.810087 18857 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.096s	user 0.005s	sys 0.015s
I20260709 13:07:41.810881 18797 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.811478 18797 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.812109 18691 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:41.814177 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.814576 15573 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:41.806124 15576 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:41.810161 18862 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.164s	user 0.009s	sys 0.013s
I20260709 13:07:41.742803 18995 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.817555 19042 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:41.818612 15580 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:41.809212 19015 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:41.819810 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 171530us
W20260709 13:07:41.821746 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.756026 19169 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.772557 18900 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:41.826431 18928 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:41.826982 18928 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.827881 18995 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.828987 18928 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:41.828837 19042 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.825214 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 650) took 1207 ms. Trace:
I20260709 13:07:41.830376 15573 rpcz_store.cc:276] 0709 13:07:40.610182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.639484 (+ 29302us) service_pool.cc:224] Handling call
0709 13:07:41.817829 (+1178345us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000d66d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:41.818005 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699287808}
I20260709 13:07:41.831756 19042 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.836886 15575 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.815490 19034 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.889245 15654 raft_consensus.cc:2410] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:41.776707 19147 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:41.900368 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 63981.9us
I20260709 13:07:41.806573 19012 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.901362 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 930) took 1591 ms. Trace:
I20260709 13:07:41.801191 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:41.798897 15646 rpcz_store.cc:276] 0709 13:07:39.823416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.272036 (+448620us) service_pool.cc:224] Handling call
0709 13:07:40.291963 (+ 19927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.294418 (+  2455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.294461 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.294984 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.095378 (+800394us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.095481 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.095657 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.486002 (+390345us) raft_consensus.cc:1685] finished
0709 13:07:41.520583 (+ 34581us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.760447 (+239864us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5400419950. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:41.772922 (+ 12475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2063,"raft.queue_time_us":4702,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12812,"spinlock_wait_cycles":45152640,"thread_start_us":767892,"threads_started":1,"wal-append.queue_time_us":1175445}
I20260709 13:07:41.902995 18691 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.914906 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:41.803850 19161 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:07:41.913353 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:41.908619 19012 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.921295 15693 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:41.907655 19034 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:41.930749 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 169983us
I20260709 13:07:41.929682 18691 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:41.938171 15725 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:41.936396 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 198783us
I20260709 13:07:41.938946 18691 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:41.939524 18825 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.917963 18577 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:41.906579 16272 rpcz_store.cc:276] 0709 13:07:40.299379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.308781 (+  9402us) service_pool.cc:224] Handling call
0709 13:07:40.345315 (+ 36534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.345547 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:41.377793 (+1032246us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.760871 (+383078us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.773159 (+ 12288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.777557 (+  4398us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:41.802850 (+ 25293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.822505 (+ 19655us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.890794 (+ 68289us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":877511,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":5397,"raft.queue_time_us":6299,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":43645,"thread_start_us":1262360,"threads_started":2,"wal-append.queue_time_us":353033}
I20260709 13:07:41.945662 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:41.949754 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.944502 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:41.946209 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:41.910436 19166 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:42.000108 19052 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:42.000819 15692 leader_election.cc:336] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.519s (SENT)
I20260709 13:07:42.001389 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.002866 18995 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.003382 18995 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:42.003753 18995 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:42.004570 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 59055.2us
I20260709 13:07:42.005038 19052 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:42.006299 15579 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:41.990701 16273 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:41.930374 19034 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.944185 15720 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.018613 19015 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.018769 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:42.020136 16270 raft_consensus.cc:2410] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:42.022260 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.022682 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.024011 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.024236 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:42.025333 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.005892 19138 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:42.026780 15648 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.031677 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:42.032603 15646 raft_consensus.cc:2410] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:42.037199 15577 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:41.951488 19049 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.028353 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.041133 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:42.040162 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:41.940865 19149 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:42.026575 19138 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.051079 15722 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:42.059077 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:42.055799 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:41.929919 19017 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:07:42.059546 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.056421 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.055647 19191 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.065876 16235 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 2.176s (SENT)
I20260709 13:07:42.060058 15728 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:42.059821 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:42.070142 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 59937.7us
I20260709 13:07:42.061920 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:42.069192 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 130091us
I20260709 13:07:42.008213 19161 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:42.077886 16273 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:42.060858 18577 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.083665 16276 raft_consensus.cc:2410] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 8 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:42.086592 19149 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.087241 18797 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.088150 15647 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.094384 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.095110 15578 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.944938 18900 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.101802 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.068957 19139 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.099536 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.104764 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:42.108246 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75308us
I20260709 13:07:42.083407 19112 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:42.125432 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 62410.3us
I20260709 13:07:42.125952 15572 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.118597 18940 consensus_meta.cc:287] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.304s	user 0.008s	sys 0.010s
W20260709 13:07:42.118665 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 117896us
I20260709 13:07:42.120045 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:42.122718 19186 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:42.116081 18716 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:07:42.132131 16273 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:42.123710 19162 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.001s
I20260709 13:07:42.124181 15578 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
W20260709 13:07:42.124714 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71615.1us
I20260709 13:07:42.127046 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:42.132870 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.134773 15577 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:07:42.162765 15647 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:42.126638 18857 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.176469 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:42.179175 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.181779 15693 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:42.178000 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.130667 19052 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:42.137971 18825 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:42.186105 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 180290us
I20260709 13:07:42.162209 19015 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.140677 19169 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.196264 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 651) took 1269 ms. Trace:
I20260709 13:07:42.197865 15571 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:42.176368 18857 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.194871 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:42.196676 15579 rpcz_store.cc:276] 0709 13:07:40.927390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.127545 (+200155us) service_pool.cc:224] Handling call
0709 13:07:42.196124 (+1068579us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400055854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:42.196214 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888478592}
I20260709 13:07:42.204670 15577 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:42.126900 19191 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.138293 18940 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.209508 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:42.207248 19071 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:42.211624 19194 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:07:42.212078 18825 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.205631 18857 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.203900 18988 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:42.226146 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:42.226498 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 116633us
I20260709 13:07:42.227890 19156 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.228012 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:42.228946 19138 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:42.234474 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.235572 19126 raft_consensus.cc:993] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:07:42.236280 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.237639 18862 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.237851 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.238440 19199 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:42.240343 19183 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:07:42.240880 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:42.242908 19192 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:42.244269 19034 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:42.246994 19195 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:07:42.247750 19193 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:42.311187 16272 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.311496 15577 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:42.248378 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.188078 18716 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:42.138298 19162 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.316710 19034 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.317353 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.317643 19162 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:42.260217 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 660) took 1015 ms. Trace:
I20260709 13:07:42.318238 18716 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:42.318768 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.318949 16276 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.261018 19165 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.319684 19165 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:42.318560 15575 rpcz_store.cc:276] 0709 13:07:41.244905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.372057 (+127152us) service_pool.cc:224] Handling call
0709 13:07:41.420485 (+ 48428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.890249 (+469764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.259943 (+369694us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400054e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:42.260137 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957105408}
I20260709 13:07:42.320538 18716 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.320659 19165 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.321198 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.321980 19165 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.318150 19042 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.322163 19126 raft_consensus.cc:1081] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:07:42.322713 19042 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.323217 19126 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:42.324783 19042 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:42.267040 15572 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:42.326225 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.326947 15572 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:42.327764 15573 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:42.328411 15572 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 4
I20260709 13:07:42.328794 15572 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:42.329118 15572 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.329169 15573 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:42.270713 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.185142 19196 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:07:42.330534 15579 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 6: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:42.321990 15575 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:42.198622 19015 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.265789 19071 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.295120 18900 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.291047 16274 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:42.302948 19020 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:42.254739 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:42.296931 19199 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:42.317466 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.265022 16273 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:42.318799 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.294425 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:42.346804 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61494.6us
W20260709 13:07:42.349857 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68469.9us
I20260709 13:07:42.293836 18862 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:42.282802 19156 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:42.296787 18988 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:42.366935 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 139082us
I20260709 13:07:42.378899 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.358626 15576 raft_consensus.cc:2376] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6. Re-sending same reply.
I20260709 13:07:42.379489 16270 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:42.312711 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.380326 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.325877 18729 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.355479 19071 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.370312 15573 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:42.322081 18940 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.318359 19162 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.390220 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:42.386001 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 65226.5us
I20260709 13:07:42.359699 19015 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:42.358302 19020 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:42.390887 15723 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:42.377532 19156 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.389082 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:42.402273 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:42.383071 18928 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:42.403800 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 85116us
I20260709 13:07:42.409757 15653 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:42.410717 19020 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.412115 19020 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.404100 15646 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:42.405031 18995 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.383715 18729 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:42.406749 19191 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.407339 15654 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:42.407779 18918 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.408221 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:07:42.422144 15729 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.422634 15729 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.410758 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:42.404116 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 86743.3us
W20260709 13:07:42.420915 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.425945 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:42.476430 15573 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:42.476506 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57604.3us
I20260709 13:07:42.419152 18729 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.477325 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53173.7us
I20260709 13:07:42.476177 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:42.478416 19189 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.476186 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58736.6us
I20260709 13:07:42.480271 18995 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.480996 16235 leader_election.cc:400] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:42.489234 16235 leader_election.cc:403] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:07:42.486578 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100538us
I20260709 13:07:42.487084 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.490146 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:42.490999 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:42.492064 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 81426.5us
I20260709 13:07:42.492848 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.492781 19071 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.493827 18960 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.494011 19139 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.494521 19139 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:42.493839 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:42.494971 19139 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.424808 19213 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.498517 19213 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:42.499321 19012 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
I20260709 13:07:42.499748 19012 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.500731 19213 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:42.501281 19213 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:42.508244 16270 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:42.510519 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:42.470449 19191 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.502892 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.515841 16272 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:42.514992 18918 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.514251 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:42.501748 19213 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:42.487466 19162 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.501804 19012 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.517731 18918 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.516551 18691 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.537556 18691 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.538012 18691 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.416756 19199 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.542434 19199 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.475978 18928 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:42.521080 18960 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.521687 19209 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:42.513903 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 88030.1us
I20260709 13:07:42.557602 15723 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.527962 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:42.558911 19071 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.561929 19067 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.562544 19067 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.562983 19067 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:42.563794 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.526618 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.531898 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:42.532912 15649 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:42.533407 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:42.568097 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 51024.1us
I20260709 13:07:42.568841 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.569607 18928 raft_consensus.cc:2764] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:42.570333 18928 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.571827 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.537155 18918 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.576705 15573 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:42.578608 18928 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.503381 18988 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.531484 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:42.546785 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.582585 19213 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:42.585523 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 82785.4us
I20260709 13:07:42.586149 18918 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.588608 18918 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:42.589390 18733 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:42.590226 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:42.591403 18862 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.592550 18862 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.594211 19209 raft_consensus.cc:2764] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:42.518585 19189 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.548448 19156 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.513584 19034 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:07:42.546707 19194 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.536172 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:42.553867 19139 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.546895 19147 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.616813 15729 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.605441 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:42.654224 15723 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.595849 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:42.596793 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.598737 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 80623.7us
W20260709 13:07:42.599074 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68018.2us
W20260709 13:07:42.665719 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.608278 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 72193.6us
I20260709 13:07:42.656391 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:42.602150 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 91751.5us
I20260709 13:07:42.667521 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.669305 15729 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.671335 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:42.606940 19217 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:42.673760 15653 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:42.601758 19190 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.678717 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.603197 19034 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.602694 19189 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:42.598893 19191 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:42.599210 19154 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:42.608443 19165 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.606962 19156 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:42.682140 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:42.653373 19147 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:42.687709 15651 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.688064 15651 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:42.688380 19147 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.688819 15651 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.609177 18960 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:42.608098 19020 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:42.603507 19194 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.676076 18918 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.600337 18857 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.701481 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:42.684290 19112 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:42.694213 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:42.681658 19219 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.695626 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:42.680701 19034 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:42.569697 18729 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.683346 19210 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:42.609390 18691 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.710811 18918 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.692946 18914 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:42.714900 19214 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.686159 19166 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.720465 19112 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.696022 19154 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:42.740329 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48752.7us
W20260709 13:07:42.734139 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 138409us
I20260709 13:07:42.727653 19165 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:42.820403 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.843952 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 151015us
I20260709 13:07:42.745654 18940 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.850853 18918 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.851756 18995 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.788305 18928 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:42.852312 18995 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.743299 18960 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:07:42.740818 19219 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.779256 19112 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.778760 19189 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.745113 18914 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:42.872836 19165 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.879666 18729 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.883181 19112 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:42.883397 19034 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.885210 19139 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.886704 19219 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.881938 19194 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:42.777971 19210 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:43.851123 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.925462 16235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.025s	sys 0.045s
I20260709 13:07:44.134147 19149 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.134681 19149 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:42.918921 19154 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.136847 19149 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:44.137429 19149 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:44.137889 19149 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:43.897531 15723 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.225s	user 0.010s	sys 0.008s
I20260709 13:07:44.138991 15723 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:44.139479 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 1980) took 1534 ms. Trace:
I20260709 13:07:44.139743 15723 rpcz_store.cc:276] 0709 13:07:42.605056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.605202 (+   146us) service_pool.cc:224] Handling call
0709 13:07:44.139388 (+1534186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.140087 19149 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:43.897943 19034 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.913311 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1848) took 1300 ms. Trace:
I20260709 13:07:44.144454 15649 rpcz_store.cc:276] 0709 13:07:42.613109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.613218 (+   109us) service_pool.cc:224] Handling call
0709 13:07:42.653925 (+ 40707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.670280 (+ 16355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.670309 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.681373 (+ 11064us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.855196 (+173823us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.855232 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.855303 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.913026 (+1057723us) raft_consensus.cc:1685] finished
0709 13:07:43.913049 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:43.913225 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4036,"raft.queue_time_us":15388,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5046,"thread_start_us":147116,"threads_started":1,"wal-append.queue_time_us":239510,"wal-append.run_cpu_time_us":1691,"wal-append.run_wall_time_us":1007252}
I20260709 13:07:43.350750 19112 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:43.985015 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.016523 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.147333 16274 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:44.024487 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800272500 after lost signal to thread 14477
I20260709 13:07:44.148368 19219 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.148864 19219 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.149662 19147 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.150175 19147 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.151054 19219 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.151600 19219 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.152732 19147 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.154850 15651 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.160233 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.160887 16278 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
W20260709 13:07:44.025828 19042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.005s	sys 0.021s
W20260709 13:07:44.162977 19042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.385s	user 0.005s	sys 0.022s
I20260709 13:07:44.167479 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:44.033704 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 1.35038e+06us
I20260709 13:07:44.171813 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:44.173063 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:44.173758 19156 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:44.174172 19156 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:44.174535 19156 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:42.900372 19067 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.177380 19067 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:44.134645 16235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.027s	sys 0.047s
W20260709 13:07:44.178409 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.45799e+06us
W20260709 13:07:44.178714 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.443s	user 0.013s	sys 0.021s
W20260709 13:07:44.179190 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.013s	sys 0.021s
W20260709 13:07:44.179750 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 1.49911e+06us
I20260709 13:07:44.180474 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:44.181838 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.182876 15651 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:44.083925 18995 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.186376 18995 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.096038 18729 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.187486 18691 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.187299 18729 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.188076 18691 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:44.188583 18691 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.189319 18729 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.097078 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.189819 19237 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:44.097767 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.190403 19237 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.099119 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.097113 19138 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.098467 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.192065 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1851) took 1517 ms. Trace:
I20260709 13:07:44.191829 19138 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.192229 16270 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:44.071473 18914 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.190837 16272 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.181915 19156 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.273005 19234 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:44.275017 19156 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.256294 19138 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.258174 19237 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.258503 19210 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:44.277753 14479 debug-util.cc:398] Leaking SignalData structure 0x7b0800212640 after lost signal to thread 15692
I20260709 13:07:44.277841 18857 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:44.278352 14479 kernel_stack_watchdog.cc:198] Thread 15692 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 435ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:07:44.280176 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.285746 19235 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.286762 19235 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.289013 19235 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.259081 18691 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:44.254976 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73198.5us
I20260709 13:07:44.301126 18857 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.301549 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:44.301656 18857 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.303097 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:44.304232 18857 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.304800 18857 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:44.305388 18857 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:44.255386 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58384us
I20260709 13:07:44.306367 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 1978) took 1924 ms. Trace:
I20260709 13:07:44.306881 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:44.307437 18857 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.307744 19156 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.308185 19156 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.308558 19156 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.309770 16270 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:07:44.307778 18960 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.311528 18960 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.306716 15728 rpcz_store.cc:276] 0709 13:07:42.381900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.382071 (+   171us) service_pool.cc:224] Handling call
0709 13:07:42.389975 (+  7904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.472713 (+ 82738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.472744 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.473258 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.676833 (+203575us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:42.676867 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.305938 (+1629071us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b5400106b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:44.305985 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.306061 (+    76us) raft_consensus.cc:1685] finished
0709 13:07:44.306072 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.306288 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1170,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13987,"spinlock_wait_cycles":189346688,"thread_start_us":203164,"threads_started":1,"wal-append.queue_time_us":219473,"wal-append.run_cpu_time_us":13349,"wal-append.run_wall_time_us":1393553}
I20260709 13:07:44.312009 18960 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:44.313073 18960 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.322826 19034 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:44.323411 19034 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.325488 19034 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.198491 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.270814 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:44.271483 19194 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.330747 19194 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:44.331158 19194 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.331533 19156 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.333565 19156 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.272773 19015 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:44.334201 19138 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.334326 19015 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.334754 19138 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.336419 19015 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.336697 19138 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.337247 19138 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:44.338307 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67603.3us
I20260709 13:07:42.907428 19162 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:44.290572 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 110601us
I20260709 13:07:44.339802 19162 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.259009 19165 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:44.292419 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.4359e+06us
I20260709 13:07:42.896623 19189 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.314134 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.348465 16273 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:44.192420 15651 rpcz_store.cc:276] 0709 13:07:42.674586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.675068 (+   482us) service_pool.cc:224] Handling call
0709 13:07:44.154441 (+1479373us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b580081c2d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9596f0aa 00007f2d959f1447 00007f2d95a09fe7 00007f2d95a0b7de 00007f2d95a1727c 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c
0709 13:07:44.192009 (+ 37568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52743424}
I20260709 13:07:44.316283 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.318015 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.319070 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.348407 15474 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 6, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:44.349443 19189 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.351446 16277 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:44.322465 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.352341 16270 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:44.338342 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 1.49679e+06us
I20260709 13:07:44.345718 19237 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.353778 19237 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:44.355082 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08002723e0 after lost signal to thread 15512
I20260709 13:07:44.356194 19237 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:44.357929 16278 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:44.346498 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.346832 19052 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.346982 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:44.364297 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57465.1us
I20260709 13:07:44.299595 19234 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.373441 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.377036 16272 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:44.341662 19165 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:44.379995 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.381608 15543 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:44.532968 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 151434us
I20260709 13:07:44.393932 18691 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.369446 19015 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.534173 19015 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.536161 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:44.536441 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.536485 19015 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:44.397792 15509 debug-util.cc:398] Leaking SignalData structure 0x7b080003cbc0 after lost signal to thread 15604
W20260709 13:07:44.537294 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800035e60 after lost signal to thread 15605
I20260709 13:07:44.395788 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.539172 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.540413 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.541128 16270 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:44.393767 16271 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.401371 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.543339 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.543586 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.401206 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.402009 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.402391 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.545377 16273 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:44.545466 16277 raft_consensus.cc:2410] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:07:44.404367 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 64217.1us
I20260709 13:07:44.547125 16235 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.548255 16235 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.417793 18988 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:44.555758 18988 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.557291 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.422853 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.557874 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.558681 16275 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:44.559492 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:44.559791 19126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.843s	user 0.021s	sys 0.003s
W20260709 13:07:44.560166 19126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.843s	user 0.021s	sys 0.003s
I20260709 13:07:44.424635 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:44.437040 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.562916 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.439702 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.446273 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.567250 15728 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:44.448966 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:44.570426 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 121590us
I20260709 13:07:44.572502 19196 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:44.573431 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.449828 19201 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:44.450541 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 97071.9us
I20260709 13:07:44.579602 19201 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.452407 15474 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.379386 19165 consensus_queue.cc:1243] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:44.454423 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 81057.5us
I20260709 13:07:44.584053 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:44.455991 19042 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:44.585508 19042 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.587812 19042 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:44.471874 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 124973us
I20260709 13:07:44.587023 15474 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 5, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 5 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:44.473819 15476 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 369) took 20109 ms (client timeout 15000 ms). Trace:
I20260709 13:07:44.380887 19052 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.549817 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.496181 19194 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.504110 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.504089 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:44.504961 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.505404 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.507067 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.507426 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.512741 15652 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:44.524593 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.454497 19156 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.530012 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.532013 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.533061 19034 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.536762 15647 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.401808 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:44.418326 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.550668 19242 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:44.551218 19236 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:44.550252 19149 consensus_queue.cc:1059] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:44.552125 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08002729c0 after lost signal to thread 15679
I20260709 13:07:44.554893 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:44.661711 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.589277 15474 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 5, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 5 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.700752 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.701592 15651 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:44.702219 15650 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:44.701800 15474 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 4, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.690912 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.741487 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.703243 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:44.598829 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.743024 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.744081 16277 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:44.745239 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.748741 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.749552 16270 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:44.750553 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.704209 19165 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.705281 15648 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:44.588961 15476 rpcz_store.cc:269] 0709 13:07:24.364767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.384374 (+ 19607us) service_pool.cc:224] Handling call
0709 13:07:44.473560 (+20089186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:36.968416 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:37.122539 (+154123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:37.122595 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:37.122616 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:37.124324 (+  1708us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:37.124410 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:37.124445 (+    35us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:07:37.198157 (+ 73712us) tablet.cc:701] Row locks acquired
0709 13:07:37.262351 (+ 64194us) write_op.cc:260] PREPARE: finished
0709 13:07:37.286224 (+ 23873us) write_op.cc:270] Start()
0709 13:07:37.286380 (+   156us) write_op.cc:276] Timestamp: P: 1783602457286153 usec, L: 0
0709 13:07:37.286399 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:07:37.287088 (+   689us) log.cc:844] Serialized 7480 byte log entry
0709 13:07:39.294471 (+2007383us) op_driver.cc:464] REPLICATION: finished
0709 13:07:40.090675 (+796204us) write_op.cc:301] APPLY: starting
0709 13:07:40.090799 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:40.091324 (+   525us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:40.091471 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:40.098193 (+  6722us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:40.098620 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:07:40.098689 (+    69us) write_op.cc:312] APPLY: finished
0709 13:07:40.099189 (+   500us) log.cc:844] Serialized 125 byte log entry
0709 13:07:40.174903 (+ 75714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:40.232627 (+ 57724us) write_op.cc:454] Released schema lock
0709 13:07:40.239267 (+  6640us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:40.247608 (+  8341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:40.247638 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3689957,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":778083,"apply.run_cpu_time_us":5511,"apply.run_wall_time_us":156957,"num_ops":18,"prepare.queue_time_us":321375,"prepare.run_cpu_time_us":54538,"prepare.run_wall_time_us":848438,"raft.queue_time_us":652740,"raft.run_cpu_time_us":12558,"raft.run_wall_time_us":330612,"replication_time_us":2007894,"thread_start_us":1439181,"threads_started":4,"wal-append.queue_time_us":709317,"wal-append.run_cpu_time_us":33553,"wal-append.run_wall_time_us":3075841}]]}
I20260709 13:07:44.706416 15649 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.706805 19194 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.708359 19156 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.801973 19156 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.595517 19233 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.805619 19233 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:44.806800 19233 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.709470 19034 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:44.810190 19034 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.601015 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.613551 19067 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:07:44.663853 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.710554 19042 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.710902 16272 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:44.817734 16269 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.817862 19042 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.701062 15653 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:44.712467 16276 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.821026 19042 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.612210 19201 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.715435 16275 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 3.
W20260709 13:07:44.822449 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 221518us
I20260709 13:07:44.823632 16269 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:44.823778 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.824533 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.824918 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.825086 16269 raft_consensus.cc:2376] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8. Re-sending same reply.
I20260709 13:07:44.825624 16275 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:44.715327 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:44.826448 15652 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:44.603154 18900 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:07:44.827529 18900 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.827848 18900 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:44.828564 18900 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:44.718762 15647 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:07:44.830365 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.719116 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4940 after lost signal to thread 15753
I20260709 13:07:44.831009 19156 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.831735 19262 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:44.831997 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800391120 after lost signal to thread 16302
W20260709 13:07:44.832374 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd9c0 after lost signal to thread 18797
W20260709 13:07:44.833051 15509 debug-util.cc:398] Leaking SignalData structure 0x7b080033bd40 after lost signal to thread 19168
W20260709 13:07:44.833284 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800397e20 after lost signal to thread 19169
W20260709 13:07:44.833559 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08003caf00 after lost signal to thread 19181
W20260709 13:07:44.833765 15509 debug-util.cc:398] Leaking SignalData structure 0x7b080014c860 after lost signal to thread 19182
W20260709 13:07:44.834004 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa5e0 after lost signal to thread 19185
W20260709 13:07:44.834419 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae340 after lost signal to thread 19198
I20260709 13:07:44.829905 18900 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.598465 18988 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:44.722618 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 172860us
I20260709 13:07:44.837275 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.837718 16276 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:44.725315 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:44.714952 16274 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:44.838335 15654 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.838847 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:44.724427 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:44.839967 19156 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.840626 19156 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:44.841521 16275 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:44.727392 19244 raft_consensus.cc:3055] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:44.733815 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 121287us
I20260709 13:07:44.842218 19244 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:44.842890 16275 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:44.731886 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.624542 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.843278 16275 pending_rounds.cc:85] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 6
I20260709 13:07:44.843590 16275 pending_rounds.cc:107] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:44.843689 15721 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:44.743024 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.751209 19138 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.845245 19138 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.751843 16277 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:44.845976 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 121660us
I20260709 13:07:44.846710 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.847774 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.848582 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.849064 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:44.849653 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.592597 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.852599 19242 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.853021 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.853305 19242 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.853559 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.852417 19149 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.854195 16273 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:44.854373 15571 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:44.854938 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:44.855104 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.855594 15575 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:44.855743 19194 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.856117 19194 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.856168 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.856528 19194 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.856933 16273 raft_consensus.cc:2393] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:44.857504 15579 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.758499 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:44.858551 16270 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:44.850292 18960 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.859817 16270 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:44.703631 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.861948 15575 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:44.862466 15650 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:44.759007 16278 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:44.599215 15544 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:44.760205 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:44.863358 19234 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.864037 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:44.864492 15579 raft_consensus.cc:1217] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-9.9]   Dedup: 6.7->[7.8-9.9]
I20260709 13:07:44.865105 15579 pending_rounds.cc:85] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 7
I20260709 13:07:44.864622 19194 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.865367 15579 pending_rounds.cc:107] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:44.865633 15579 raft_consensus.cc:2889] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.865813 19149 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:44.867144 19234 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:44.771883 19052 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.781239 19257 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.867750 19194 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.868467 16270 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:44.818380 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:44.681035 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.836210 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.867494 19234 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:44.869081 16272 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:44.602078 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.869733 19234 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.870452 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.871341 19138 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:44.871549 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.872676 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:44.724404 15693 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:44.837869 15576 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
W20260709 13:07:44.873684 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 149367us
I20260709 13:07:44.874612 15574 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:44.874836 15693 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:44.875162 19234 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.875582 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.876179 15574 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:44.843847 16275 raft_consensus.cc:2889] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.876652 19017 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.876792 15654 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:44.850203 19165 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.877069 19017 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.754525 19196 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:44.877516 19017 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.757005 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:44.878306 15648 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:44.878352 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.843051 19244 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.879037 15576 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:44.873351 15571 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:44.879572 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 280410us
I20260709 13:07:44.880726 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:44.852406 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:44.851879 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.769168 15646 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:44.867499 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:44.884253 15729 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.868129 19257 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:44.798228 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.886139 15577 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:44.839015 16274 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:44.752928 15474 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.877719 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.879878 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:44.859784 18960 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:44.882632 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.891124 15574 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:44.906283 15575 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:44.908730 19034 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:44.909427 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53225.2us
I20260709 13:07:44.914518 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:44.915688 19274 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:44.916934 19138 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:44.919380 19138 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.919847 19138 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.920269 19138 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.921854 19210 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:44.923273 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61866.6us
I20260709 13:07:44.910352 18857 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:44.923938 15692 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.040s (SENT)
I20260709 13:07:44.924029 18857 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.924907 18857 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:44.932952 15692 connection.cc:256] RPC call timeout handler was delayed by -2.1240376549999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:07:44.933450 15692 connection.cc:256] RPC call timeout handler was delayed by -2.0106376549999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:07:44.933743 15692 connection.cc:256] RPC call timeout handler was delayed by -2.0009053689999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:07:44.934053 15692 connection.cc:256] RPC call timeout handler was delayed by -1.932505368999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 13:07:44.935434 19278 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:44.940629 19278 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:44.992933 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:44.943356 19277 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:44.882655 19201 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:44.947743 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54917.7us
I20260709 13:07:45.001145 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:44.952224 15692 connection.cc:256] RPC call timeout handler was delayed by -1.8290053689999013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:07:44.953225 15573 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:45.003337 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.003973 15573 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:45.005187 15573 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:45.006157 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.952251 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:45.007216 15654 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:44.958094 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.958856 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:44.962646 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.008577 16273 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:44.962815 18940 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.009303 18940 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.964813 15474 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.962697 19272 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:44.969805 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.015522 15576 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.971099 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:44.841627 19156 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:44.969053 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:44.944896 19276 raft_consensus.cc:3055] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:44.998359 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:44.980067 19274 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.967757 15580 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:45.016327 15574 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:45.016953 15692 connection.cc:256] RPC call timeout handler was delayed by -1.7786053689999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:07:45.047487 15692 connection.cc:256] RPC call timeout handler was delayed by -1.5420864539999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 13:07:45.047947 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3479467799999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:07:45.048302 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1729988549999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:07:45.048660 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1715467799999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:07:45.049002 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1580467799999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:07:45.049343 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0716467799999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:07:45.049696 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0194155319999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:07:44.976361 15575 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.906941 18960 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:44.999179 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 118566us
W20260709 13:07:45.054697 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 138992us
W20260709 13:07:45.069875 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73693.9us
I20260709 13:07:44.999691 19277 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:45.012667 15474 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 5 to 2, term changed from 5 to 4, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 4 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:45.076319 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.024052 19067 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.082604 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.083128 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.015216 19272 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:45.079838 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.020884 18918 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.090898 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.083313 16277 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:45.095467 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:45.097826 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.099027 15580 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:45.035871 19276 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:45.036053 19201 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:45.052987 19244 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.105549 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:45.112258 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:45.118598 16277 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:45.082701 19067 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.132352 15576 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:45.133340 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.134876 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.133416 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.135866 15577 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:44.994096 19196 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.136045 16277 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:45.136475 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.089258 19126 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.075534 19199 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:45.145259 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.146229 19126 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:45.147181 19126 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.148401 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.149047 15575 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:45.108350 18918 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:45.150192 19257 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:45.150251 19276 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.151587 19276 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.152321 18918 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:45.152570 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:45.152967 18918 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.153693 18918 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:45.154121 18918 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:45.154546 18918 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.154795 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.156139 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.156946 19042 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:45.158005 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.158754 15578 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:45.159572 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.160735 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.164422 19034 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:45.164911 19034 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.165297 19034 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.165462 19262 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.161800 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.166409 15578 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.166086 19262 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.166877 18691 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:45.167459 18691 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.138976 15576 raft_consensus.cc:2376] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10. Re-sending same reply.
I20260709 13:07:45.168864 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:45.168882 19262 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:45.169642 18691 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:45.068262 19274 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.169708 15576 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:45.150012 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.145313 15474 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 6, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.184100 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.184937 15576 raft_consensus.cc:2410] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:45.169757 19262 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:45.191478 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:45.139392 19067 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.193912 15575 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:45.204141 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 201902us
I20260709 13:07:45.212695 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:45.214553 15576 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.216764 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:45.159205 19138 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:45.227595 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 122153us
I20260709 13:07:45.225698 15578 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:45.179904 18940 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:45.232079 16270 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:45.262073 15725 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:07:45.187573 18988 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:45.187418 19242 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:45.264813 15725 pending_rounds.cc:85] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 5
I20260709 13:07:45.269853 15725 pending_rounds.cc:107] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:07:45.231513 15720 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:45.269523 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.228865 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:45.270006 15580 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:45.270160 15725 raft_consensus.cc:2889] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.186589 18857 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:45.279078 14479 debug-util.cc:398] Leaking SignalData structure 0x7b080013fc40 after lost signal to thread 15692
W20260709 13:07:45.282855 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 137883us
I20260709 13:07:45.269393 19242 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.289794 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 108431us
I20260709 13:07:45.217537 19262 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:45.306174 16272 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:07:45.307159 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.286573 18940 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.313946 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:45.289068 18988 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:45.177551 19277 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.182771 19272 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.298516 19242 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.332079 15571 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:45.335346 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:45.344775 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:45.266554 19201 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.278247 19279 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:07:45.348701 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.349644 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:45.370208 15580 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:45.370486 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 155957us
W20260709 13:07:45.373473 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.399614 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.350991 19289 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.400593 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:45.371915 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 215855us
I20260709 13:07:45.391142 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:45.391776 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56525.3us
I20260709 13:07:45.402892 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:45.403147 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.329216 19233 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.343115 18988 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:45.404901 16270 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:45.332885 19237 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:45.377636 19272 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.391433 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:45.425951 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 80313.7us
I20260709 13:07:45.371354 19300 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.422821 18691 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:45.446491 19281 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:07:45.453868 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50817.2us
I20260709 13:07:45.536417 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.436883 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:45.447034 19267 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:07:45.449815 18940 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:45.483870 19149 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:45.487526 19284 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.489293 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.491494 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:45.476922 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.497603 19277 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.407737 19233 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.446887 19286 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:07:45.453094 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51170.3us
I20260709 13:07:45.579689 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:45.580211 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.539322 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:45.449576 19297 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.586503 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:45.587616 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.480942 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.547094 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.568517 15652 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:45.562891 15574 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:07:45.580366 15655 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:45.449255 18918 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.476025 19300 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:45.524163 19270 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:45.548207 19289 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:45.541216 19257 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:45.583381 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 44176.8us
I20260709 13:07:45.652299 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:45.653071 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:45.549366 19210 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:45.591751 16277 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:07:45.623495 19283 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:45.608294 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:45.624526 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44442.3us
I20260709 13:07:45.625227 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:45.626168 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.628137 18857 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:45.564651 19284 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:45.635385 19296 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 13:07:45.636063 19282 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:07:45.733703 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:45.566392 19138 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:45.638447 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:45.654707 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 262684us
I20260709 13:07:45.735049 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:45.735239 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:45.655157 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:45.600805 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 119930us
W20260709 13:07:45.736157 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 81541.2us
I20260709 13:07:45.548985 18988 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:45.648077 19300 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.709712 15729 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:45.711108 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.665993 16270 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.555408 19034 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.707356 19194 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.760788 15652 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:45.724936 19271 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:45.648439 19015 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.636982 19234 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.609239 19274 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:45.724664 16273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.013s
W20260709 13:07:45.793737 16273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.001s	sys 0.013s
I20260709 13:07:45.726118 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:45.794150 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 59182.5us
I20260709 13:07:45.660247 18900 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:07:45.729584 19294 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:07:45.729027 19284 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.654914 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:45.659598 18940 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:45.591084 19233 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.740970 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:45.715337 15654 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:07:45.716871 16272 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:45.709311 19262 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:45.787920 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:45.739283 19244 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
W20260709 13:07:45.726902 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.899928 16276 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:45.900964 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 190701us
I20260709 13:07:45.896412 16270 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:45.898201 19289 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.786828 19194 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:45.789523 18857 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.793730 19015 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.959131 15575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.032s	sys 0.043s
I20260709 13:07:45.799227 19293 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.660456 19270 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:45.795323 19042 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:45.924171 15648 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:45.991110 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.926898 16274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.020s	sys 0.038s
W20260709 13:07:46.037604 16274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.021s	sys 0.038s
I20260709 13:07:45.603591 19297 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:45.919661 18960 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.836s	user 0.016s	sys 0.006s
W20260709 13:07:46.014459 15579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.047s	sys 0.078s
I20260709 13:07:46.014984 16272 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:46.015195 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 685) took 1133 ms. Trace:
W20260709 13:07:45.992142 15575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.032s	sys 0.043s
I20260709 13:07:45.956859 16276 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:45.990764 15650 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:45.924058 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 269192us
I20260709 13:07:45.959120 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:45.902909 19199 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.057756 19034 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.014930 19015 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.016091 19280 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:07:45.991874 19313 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.880614 19276 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:07:46.029567 19310 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:46.082134 19017 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.204s	user 0.013s	sys 0.000s
I20260709 13:07:46.082351 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1183) took 1014 ms. Trace:
I20260709 13:07:46.015363 19274 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:46.088927 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 682) took 1771 ms. Trace:
I20260709 13:07:45.983912 19194 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.044166 19293 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:46.096455 15579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.049s	sys 0.080s
W20260709 13:07:46.114954 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.312578 16270 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:46.211738 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.313766 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.271330 15725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.020s
W20260709 13:07:46.315649 15725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.013s	sys 0.021s
I20260709 13:07:46.307898 16269 rpcz_store.cc:276] 0709 13:07:44.317667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.825697 (+508030us) service_pool.cc:224] Handling call
0709 13:07:44.826003 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.868527 (+ 42524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.868545 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.883167 (+ 14622us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.277060 (+393893us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:45.373601 (+ 96541us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.455291 (+ 81690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.455391 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.088737 (+633346us) raft_consensus.cc:1685] finished
0709 13:07:46.088755 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.088872 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28958,"prepare.queue_time_us":39723,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":117923,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"thread_start_us":440879,"threads_started":3,"wal-append.queue_time_us":467664}
W20260709 13:07:46.319542 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.320978 16272 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:45.992208 19284 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:46.176518 15655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.013s	sys 0.023s
I20260709 13:07:46.045997 19042 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.338057 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:46.214111 15720 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:46.365533 15576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.020s	sys 0.019s
W20260709 13:07:46.369927 15576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.021s	sys 0.020s
W20260709 13:07:46.397300 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.414785 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.306840 16271 rpcz_store.cc:276] 0709 13:07:45.068083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.107682 (+ 39599us) service_pool.cc:224] Handling call
0709 13:07:45.137515 (+ 29833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.138841 (+  1326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.138877 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.177973 (+ 39096us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.312678 (+134705us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800418a80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:07:45.483009 (+170331us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b1800418a80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926557 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:45.496819 (+ 13810us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.496906 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.497032 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.082130 (+585098us) raft_consensus.cc:1685] finished
0709 13:07:46.082157 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.082291 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384,"raft.queue_time_us":74758,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8376,"spinlock_wait_cycles":77776000,"thread_start_us":182794,"threads_started":1,"wal-append.queue_time_us":877296}
I20260709 13:07:46.419625 15721 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:07:46.334959 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.505s (SENT) [suppressed 27 similar messages]
I20260709 13:07:46.418287 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.423965 15729 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:46.347410 19277 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
I20260709 13:07:46.287249 18918 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.429082 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.318923 19052 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:46.339183 19234 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.368549 19042 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:46.428988 19314 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:07:46.415822 19126 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.319216 19017 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:46.319090 19274 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.444895 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.448889 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:46.443950 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.490517 15721 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.104918 18960 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:46.448052 19289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.015s	sys 0.026s
I20260709 13:07:46.433422 19319 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.499734 15729 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:07:46.487046 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 66469us
W20260709 13:07:46.458150 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 556135us
W20260709 13:07:46.338796 15651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.025s
W20260709 13:07:46.500239 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.008s	sys 0.039s
W20260709 13:07:46.502420 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.039s
I20260709 13:07:46.502453 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:46.505137 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.511585 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.514355 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:46.515759 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:46.497560 19289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.027s
I20260709 13:07:46.517251 16278 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:46.459873 19234 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.449908 19052 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.525559 15723 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:46.526597 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:46.096055 15572 rpcz_store.cc:276] 0709 13:07:44.850898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.851077 (+   179us) service_pool.cc:224] Handling call
0709 13:07:44.851362 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.878796 (+ 27434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.878822 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.883643 (+  4821us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.203737 (+320094us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:45.203799 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.203928 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.983558 (+779630us) raft_consensus.cc:1685] finished
0709 13:07:45.983593 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.983794 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27081,"raft.queue_time_us":56702,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":213465,"threads_started":1,"wal-append.queue_time_us":426662}
I20260709 13:07:46.541114 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.543814 15724 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.545696 19311 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.548142 15729 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:46.549363 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.529157 19126 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:46.553123 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50774.1us
I20260709 13:07:46.536417 19196 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:46.512960 19319 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:46.348392 19313 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.602098 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 690) took 1742 ms. Trace:
W20260709 13:07:46.679205 19295 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:46.626559 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1866) took 1061 ms. Trace:
I20260709 13:07:46.631397 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.633831 18900 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.683672 18900 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.684167 18900 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.564186 15725 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:46.576368 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.600134 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1869) took 1034 ms. Trace:
I20260709 13:07:46.630395 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:46.688673 15576 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:46.687731 15651 rpcz_store.cc:276] 0709 13:07:45.566337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.567078 (+   741us) service_pool.cc:224] Handling call
0709 13:07:45.593215 (+ 26137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.662382 (+ 69167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.662425 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.714250 (+ 51825us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.502470 (+788220us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.502509 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.502569 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.599813 (+ 97244us) raft_consensus.cc:1685] finished
0709 13:07:46.599842 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.600030 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34555,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":758783,"threads_started":2,"wal-append.queue_time_us":774584}
I20260709 13:07:46.561932 15721 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:46.658239 15579 rpcz_store.cc:276] 0709 13:07:44.859685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.863898 (+  4213us) service_pool.cc:224] Handling call
0709 13:07:44.864253 (+   355us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:07:45.087671 (+223418us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:45.123633 (+ 35962us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.530104 (+1406471us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.530479 (+   375us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:46.531064 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.535764 (+  4700us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.535809 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.536758 (+   949us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.601839 (+ 65081us) raft_consensus.cc:1685] finished
0709 13:07:46.601859 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.602012 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34465,"prepare.queue_time_us":34976,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2705,"raft.queue_time_us":175018,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":6435,"thread_start_us":1577581,"threads_started":4,"wal-append.queue_time_us":385229}
I20260709 13:07:46.652338 15572 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:46.568305 15618 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:46.691491 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 123303us
W20260709 13:07:46.622269 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96256.4us
I20260709 13:07:46.687013 15727 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:46.695070 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.696004 15725 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:46.680306 15646 rpcz_store.cc:276] 0709 13:07:45.565298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.581478 (+ 16180us) service_pool.cc:224] Handling call
0709 13:07:45.608754 (+ 27276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.719278 (+110524us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:46.033127 (+313849us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.534487 (+501360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.534555 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.534615 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.626204 (+ 91589us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002481d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:46.626270 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.626471 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28573,"prepare.queue_time_us":798405,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":56807,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":12201,"spinlock_wait_cycles":253623552,"thread_start_us":762211,"threads_started":2,"wal-append.queue_time_us":622052}
I20260709 13:07:46.695015 15720 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:07:46.699501 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 364564us
I20260709 13:07:46.701792 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:46.649338 19242 consensus_meta.cc:287] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.299s	user 0.005s	sys 0.006s
W20260709 13:07:46.728421 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.594882 18857 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.578387 19297 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:46.591672 19324 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.651937 19289 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.742602 19329 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:07:46.743546 19332 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:46.743865 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.744095 19302 raft_consensus.cc:2764] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:46.745002 15727 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:46.745051 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.645735 19292 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:46.588814 19280 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:46.748972 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.745851 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.755162 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:46.747125 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53097.7us
I20260709 13:07:46.763582 15723 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:46.764066 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:46.764483 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.746352 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:46.746212 19315 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.676s	user 0.013s	sys 0.010s
I20260709 13:07:46.760565 15720 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.735098 19017 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:46.769284 19331 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:46.741545 18857 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:46.771642 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 223617us
I20260709 13:07:46.754792 19196 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:46.753316 19324 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.776036 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.769692 19210 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:46.783417 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 91455us
I20260709 13:07:46.773422 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1806) took 1716 ms. Trace:
I20260709 13:07:46.734683 19242 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.774663 19297 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:46.758504 19289 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:46.784277 19233 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.000s
I20260709 13:07:46.771987 19274 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:46.776057 19293 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:46.790220 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.812847 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:46.815068 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.818544 16275 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:46.775965 15646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:46.819674 15646 raft_consensus.cc:606] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.820097 15646 raft_consensus.cc:614] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:46.785372 19052 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.770208 19280 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.808271 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 940) took 1959 ms. Trace:
W20260709 13:07:46.809592 19330 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:46.772979 19292 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:46.795627 19196 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:46.565703 19311 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.853533 15720 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:46.822780 16278 rpcz_store.cc:276] 0709 13:07:44.849104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.863361 (+ 14257us) service_pool.cc:224] Handling call
0709 13:07:44.863626 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.517825 (+1654199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.808036 (+290211us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400496454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:46.808214 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3802412800}
I20260709 13:07:46.791262 19324 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.792961 15575 rpcz_store.cc:276] 0709 13:07:45.057057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.209767 (+152710us) service_pool.cc:224] Handling call
0709 13:07:45.217415 (+  7648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.217632 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.217663 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.229913 (+ 12250us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.337268 (+1107355us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.771007 (+433739us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.773136 (+  2129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.773207 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.773244 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:46.773255 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.773369 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":405087,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":1096,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5080,"thread_start_us":1399250,"threads_started":2,"wal-append.queue_time_us":808099}
I20260709 13:07:46.832626 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.833283 19339 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.834098 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.834697 19305 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:46.837046 19342 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.838321 19149 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.787631 19341 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:46.841405 19333 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:46.843446 19308 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.890913 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:46.849162 19067 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.622s	user 0.008s	sys 0.004s
I20260709 13:07:46.804359 19017 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:46.854923 15721 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.855660 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:46.895169 16277 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.857570 19292 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:46.864216 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71211.9us
I20260709 13:07:46.900933 16273 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:46.903769 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.905433 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.906708 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.907374 15649 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:46.908035 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.859635 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 663) took 1230 ms. Trace:
I20260709 13:07:46.822443 19279 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.909021 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.909742 15649 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:46.872133 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.851733 19301 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:46.846078 18691 consensus_meta.cc:287] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.306s	user 0.006s	sys 0.006s
I20260709 13:07:46.892661 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.893529 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.895356 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.802361 19210 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:46.875263 19321 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.378s	user 0.006s	sys 0.000s
I20260709 13:07:46.865067 19339 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.858430 19270 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:46.860299 19034 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:46.910729 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.939513 15651 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:46.910495 15648 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.918219 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:46.919157 15650 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.922963 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.811059 18857 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.925349 19210 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.888957 19302 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:46.908775 15655 rpcz_store.cc:276] 0709 13:07:45.628776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.639096 (+ 10320us) service_pool.cc:224] Handling call
0709 13:07:45.639373 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.639560 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.340087 (+700527us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.859316 (+519229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.859368 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.859409 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.859471 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.859579 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9388,"prepare.queue_time_us":860778,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":119251,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":18723,"thread_start_us":1194353,"threads_started":3,"wal-append.queue_time_us":447367}
I20260709 13:07:46.810343 19233 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.919373 19301 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:46.934175 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:46.941881 15654 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:46.923089 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.947013 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:46.947767 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 246030us
I20260709 13:07:46.919107 15652 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.954542 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:46.959728 15578 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:46.896106 19319 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:46.920655 19274 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.910954 19346 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.933094 19276 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.938325 19339 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.937077 18691 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.965046 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:46.964177 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.976498 15649 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:46.910368 19067 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.956310 19289 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:46.915467 19201 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:07:46.981823 16235 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:46.984999 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 84708.8us
I20260709 13:07:46.968266 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.963512 19301 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.974177 15721 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:46.961659 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 129090us
I20260709 13:07:46.954665 19299 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:46.933512 19244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.007s
I20260709 13:07:46.891600 19149 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.957875 19196 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:46.961656 19210 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:46.945248 19034 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:46.981489 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:46.894811 19297 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:46.888433 19342 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:46.970989 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.967795 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:46.987560 19290 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:46.987617 19270 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:46.989267 19067 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.989650 19347 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.991426 19233 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:46.991683 19234 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:46.992080 18857 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:46.993791 19015 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.001s
I20260709 13:07:46.994625 19280 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:47.019513 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:46.998397 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:47.002786 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.005048 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:46.900779 19308 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.005702 19313 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:47.017179 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.073035 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.026130 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.216328 15723 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.011132 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1182) took 1943 ms. Trace:
I20260709 13:07:47.186632 19270 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.167703 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47475.9us
W20260709 13:07:47.157895 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.023613 15650 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:47.032600 15648 raft_consensus.cc:2410] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:47.190608 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.187844 15655 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.054793 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.006548 15652 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:47.187181 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.187922 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:47.020205 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 228109us
W20260709 13:07:47.191282 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 67081.3us
I20260709 13:07:47.020262 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.167397 15573 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:47.024169 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.048535 19317 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:47.019661 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.233762 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.217929 16274 rpcz_store.cc:276] 0709 13:07:45.067777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.068543 (+   766us) service_pool.cc:224] Handling call
0709 13:07:45.087942 (+ 19399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.312366 (+224424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.312487 (+   121us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.316261 (+  3774us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.038526 (+722265us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.038581 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.038673 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.857801 (+819128us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b24003a7c18. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d927ac9c4 00007f2d927aaacb 00007f2d92965dc9 00007f2d92965a55 00007f2d9296509d 00007f2d9559710e 00007f2d955ae88c 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221
0709 13:07:47.010754 (+152953us) raft_consensus.cc:1685] finished
0709 13:07:47.010785 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.011054 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88224,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8725,"spinlock_wait_cycles":92623744,"thread_start_us":930517,"threads_started":2,"wal-append.queue_time_us":1083432}
W20260709 13:07:47.016665 19272 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.542s	user 0.003s	sys 0.008s
W20260709 13:07:47.023511 19310 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 13:07:47.251458 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.998399 19201 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:47.005815 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.046569 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1188) took 1405 ms. Trace:
I20260709 13:07:47.167515 19319 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.205896 15651 raft_consensus.cc:606] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:47.210954 15647 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:47.005904 19284 consensus_meta.cc:287] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.627s	user 0.000s	sys 0.007s
W20260709 13:07:46.980486 19300 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.192s	user 0.012s	sys 0.000s
I20260709 13:07:46.969727 19348 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.116825 19244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.007s	sys 0.020s
I20260709 13:07:47.215400 15576 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:47.016918 19042 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.000s
I20260709 13:07:47.252233 15655 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.254407 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.281291 15652 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:47.282634 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.283702 15652 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.255358 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:46.980834 19276 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.257251 15725 raft_consensus.cc:2368] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:47.025570 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.258576 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.011698 19242 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:46.997373 19194 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.647s	user 0.005s	sys 0.005s
I20260709 13:07:47.262189 16275 rpcz_store.cc:276] 0709 13:07:45.640891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.733426 (+ 92535us) service_pool.cc:224] Handling call
0709 13:07:47.046227 (+1312801us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400654fd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:47.046445 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492924800}
W20260709 13:07:47.263517 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 408717us
I20260709 13:07:47.262629 19165 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.264488 15651 raft_consensus.cc:614] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:47.061900 18960 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.187855 19333 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.259060 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.008175 19311 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.056818 19279 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.975734 19274 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.202741 19210 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:47.310045 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 305068us
W20260709 13:07:47.310802 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.274451 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.276661 15723 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:47.201859 19305 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:47.278750 15728 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:47.284754 15648 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:47.252190 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 284467us
I20260709 13:07:47.019896 19302 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.242s
I20260709 13:07:47.233999 19270 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.250975 19067 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:47.008396 19349 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.316s
I20260709 13:07:47.026870 19017 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.244s
I20260709 13:07:47.040215 19309 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.231s
I20260709 13:07:47.332125 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:46.976760 19346 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.293639 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.293848 15652 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:47.013484 18900 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.261618 19201 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:47.265964 19310 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.300890 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.301333 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.214082 19015 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.297700 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:47.354387 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56778.9us
I20260709 13:07:47.264039 19356 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:47.316359 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:47.212524 19347 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.327164 15579 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:47.296156 19357 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:47.233315 19317 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:47.334679 15648 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:47.283041 19300 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.274495 19319 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.343040 15723 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:47.343392 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.344846 15727 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:47.314766 19210 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:47.292204 19042 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.350268 15651 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:47.352375 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.340130 15724 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:47.355320 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57851.8us
I20260709 13:07:47.326537 19067 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.355265 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 120200us
I20260709 13:07:47.298610 19194 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.302872 19341 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:07:47.403802 19126 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:47.404206 19126 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:47.405050 19126 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.407235 18900 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:47.408126 19201 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.409037 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.409384 19201 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.409663 15575 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:47.410764 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.410976 19340 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:07:47.412155 19340 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:47.412676 19340 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:47.412724 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.413955 19293 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:47.414394 19293 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.414733 19293 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.415012 19276 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.373718 19052 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:47.415948 19052 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:47.416422 19052 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:47.418517 19352 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:47.421808 19300 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.423942 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2352) took 1078 ms. Trace:
I20260709 13:07:47.423573 19339 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.424438 15728 rpcz_store.cc:276] 0709 13:07:46.346127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.346284 (+   157us) service_pool.cc:224] Handling call
0709 13:07:47.423735 (+1077451us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540039a654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:47.423871 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932444416}
I20260709 13:07:47.426349 15654 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.427014 19305 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.430776 19339 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.432205 19317 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.366832 19288 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.436259 19288 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.360499 19333 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.438004 15724 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:47.438395 19333 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:47.438954 19333 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.442520 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.442880 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.327059 19034 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.306210 19165 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.361763 15648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:47.455519 15648 raft_consensus.cc:606] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:47.456001 15648 raft_consensus.cc:614] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:47.362488 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.364409 16278 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:47.364424 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.366400 15650 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:47.367488 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51255.8us
I20260709 13:07:47.462419 15722 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.462738 15651 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:47.463070 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.368260 15729 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.288205 19348 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.374482 15652 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.376124 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.376394 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.386715 15649 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.387758 19015 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:47.437717 19353 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:47.387987 19194 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.388574 19279 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:47.389148 19342 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.391638 19347 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.375308 19067 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.395030 19149 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.397293 19308 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:47.400156 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:47.477694 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 101649us
W20260709 13:07:47.479449 16277 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:07:47.483769 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.488147 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.491801 15652 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:07:47.499446 16236 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.928s (SENT)
I20260709 13:07:47.500128 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:47.530136 15651 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:47.532274 15650 raft_consensus.cc:606] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:47.532707 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:47.530639 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 67635.5us
I20260709 13:07:47.534298 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.480341 19126 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.483053 19317 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.543819 15652 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:47.547377 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.542814 15724 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.530483 19300 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.555405 15653 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:47.551133 19342 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:47.551124 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.569223 15655 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:47.569705 15728 raft_consensus.cc:2368] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:47.556282 19270 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.486460 19357 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:47.557719 19165 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:47.588907 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:47.589121 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54889.3us
I20260709 13:07:47.589774 15579 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:47.591025 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.539650 19194 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.559878 16277 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:47.561084 15578 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
W20260709 13:07:47.562199 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 78537.2us
I20260709 13:07:47.552779 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.569933 15722 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:47.487040 19276 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:07:47.603930 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.544200 19308 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:47.540661 19274 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.609416 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:47.560518 15544 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.600133 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:47.611102 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50669.9us
I20260709 13:07:47.611143 15722 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:07:47.605948 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 106549us
I20260709 13:07:47.577046 19360 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:47.618523 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.590508 19289 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:47.601644 19324 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.727s	user 0.015s	sys 0.000s
I20260709 13:07:47.619652 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.620774 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.413829 19340 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.624037 15722 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:47.597270 19357 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:47.625159 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.608078 19300 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.628945 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.629237 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.630419 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.630544 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.631055 15728 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:47.626121 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.605247 19345 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:47.632705 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.606456 19042 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:47.634145 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.634315 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.619938 19274 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:47.638767 15729 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.649282 19015 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:47.650281 19344 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.651081 19354 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:47.652370 19357 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.653790 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.654469 15722 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:47.654991 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.655298 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.655834 15722 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:47.656569 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.657225 15722 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.656569 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.658227 15655 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.646062 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.659955 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.660742 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:47.661546 16277 raft_consensus.cc:2410] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:07:47.626304 19351 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:47.664455 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.676824 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:47.677639 15574 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.665489 15577 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:47.670418 15650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377274f9c9482a924840f15b616a13"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:47.681171 15650 raft_consensus.cc:606] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:47.681677 15650 raft_consensus.cc:614] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:47.623345 19360 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:47.633972 19310 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.686177 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.693338 15652 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.694561 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.615056 19292 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:47.699307 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:47.700145 15575 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.700318 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.638252 19319 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:47.621147 19194 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:47.716957 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.715188 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.695442 15577 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:07:47.683993 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:47.697199 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3812487840000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:07:47.722960 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2804487840001002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:07:47.723325 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2255487840001251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:07:47.723755 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1463487840001108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:07:47.626943 19289 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.612589 19308 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.703891 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.732748 15722 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.704811 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:47.686430 19347 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.713227 15655 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:47.714802 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:47.715135 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.736439 15651 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.658424 19340 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.641170 19274 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:47.723246 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.723707 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:47.724261 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0779487840001138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 13:07:47.687988 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:47.741446 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0032487840001068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:07:47.741490 15650 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:47.742151 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.743194 15726 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:47.743505 15728 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:47.743342 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:47.704532 19351 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:47.631439 19341 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.715137 19354 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:47.724789 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.750840 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:47.702548 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 69908.5us
W20260709 13:07:47.727702 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 98800.8us
I20260709 13:07:47.733500 15571 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.705399 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:47.692255 19342 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:47.735845 19347 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.777698 15571 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:47.779982 15575 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:47.736840 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.738790 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.622974 19324 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.647472 18691 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:07:47.794948 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.739841 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.703802 19299 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.699081 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.692777 19042 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:47.793790 19194 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:47.800783 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.800947 19359 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.801610 15724 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:47.802567 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.807992 19351 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.810070 19324 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:47.810305 15727 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.811051 19274 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:47.811780 19365 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:47.812357 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.812513 19274 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.813670 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.814965 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.815815 19348 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.816183 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.817631 19289 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:47.760006 19342 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.754374 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:47.847458 16277 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:47.755056 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:47.848768 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 173870us
I20260709 13:07:47.870893 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:47.869930 15543 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:47.753121 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:47.760538 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.752017 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.761950 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:47.887384 15722 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:47.762101 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:47.762377 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.889303 15577 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:47.762562 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.745842 19017 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.766280 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.766847 19360 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.771466 19270 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:47.738830 19165 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:47.735505 15652 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:47.640694 19345 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.741123 19034 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:47.789739 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:47.744099 19288 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:47.798290 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:47.741025 19305 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:47.817169 19354 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.771821 19297 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:47.818173 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.819474 19293 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:47.795885 18857 consensus_meta.cc:287] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.002s
I20260709 13:07:47.821094 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:47.929989 15721 raft_consensus.cc:2410] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:47.821612 19042 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:47.822599 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.822834 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:47.930948 15655 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:47.732126 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 48267.7us
I20260709 13:07:47.814754 19244 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:47.932440 19244 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.786985 19347 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.773926 19149 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:47.895063 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 142010us
I20260709 13:07:47.800817 19194 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:47.855623 19342 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.913094 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:47.801630 19359 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:47.910589 19343 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:47.927181 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 182631us
I20260709 13:07:47.903007 19165 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:47.937340 15572 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:47.867280 19324 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:07:47.755962 15574 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
W20260709 13:07:47.929770 19379 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:47.959404 19149 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.963877 15648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.012s
W20260709 13:07:48.001680 15648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.001s	sys 0.013s
I20260709 13:07:47.911540 19375 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:48.006630 19375 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:48.007110 19375 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.967095 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:47.898180 19067 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.010771 15720 raft_consensus.cc:2368] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7.
I20260709 13:07:48.011840 19067 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:48.012760 19366 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:07:48.016240 19201 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.003s
W20260709 13:07:47.971742 19052 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:07:48.025108 19052 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:47.975044 19244 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
W20260709 13:07:47.976836 15654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.014s	sys 0.003s
I20260709 13:07:47.897107 19302 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:07:47.934710 19042 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:47.835124 19299 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.001402 19149 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.970181 19017 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.026517 15724 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:47.996677 19165 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:48.030181 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 159384us
I20260709 13:07:47.931026 19305 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.023844 19343 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:48.027817 19308 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:48.130322 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 163323us
W20260709 13:07:48.132730 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.138522 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:48.142638 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:48.147696 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.149377 15655 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.149528 15650 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.149614 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:48.150547 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:48.150715 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:48.151087 15655 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:48.134620 18900 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.152078 15577 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:48.137333 19290 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:48.146736 19317 consensus_meta.cc:287] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.003s
I20260709 13:07:48.141763 19017 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.152001 19324 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:48.179693 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:48.153707 18900 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:48.161422 19377 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:07:48.186233 19387 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:48.196739 19343 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.198477 19346 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.194020 19067 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:48.192114 19297 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:48.204706 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.211642 19034 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:48.238159 19280 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.238740 15723 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:48.239116 15723 pending_rounds.cc:85] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
I20260709 13:07:48.212347 19299 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.239317 15723 pending_rounds.cc:107] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:48.239638 15723 raft_consensus.cc:2889] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:48.213789 19210 consensus_meta.cc:287] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.841s	user 0.014s	sys 0.005s
I20260709 13:07:48.241575 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:48.153357 19042 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.215826 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:48.216580 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:48.243723 15574 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:48.218269 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 199891us
I20260709 13:07:48.227345 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:48.158679 19302 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.248458 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:48.205612 19347 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:48.236820 19333 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.797s	user 0.005s	sys 0.009s
I20260709 13:07:48.254732 15571 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.195173 18900 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.258154 15572 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.267606 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:48.268774 15573 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.277374 19388 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:07:48.278692 19359 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.237636 19196 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.284216 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:48.286298 15655 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:48.289254 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:48.305672 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:48.306339 15572 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.308949 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 683) took 1290 ms. Trace:
I20260709 13:07:48.278990 19373 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.309357 15720 rpcz_store.cc:276] 0709 13:07:47.018673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.019419 (+   746us) service_pool.cc:224] Handling call
0709 13:07:48.308741 (+1289322us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400114754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:48.308888 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786784128}
I20260709 13:07:48.240474 19210 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.238695 19280 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.281710 19333 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.281924 19302 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:48.282608 19345 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.252290 19297 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:48.299795 19126 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.001s
I20260709 13:07:48.258819 19300 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:48.250216 19317 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:07:48.318285 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 130000us
I20260709 13:07:48.211710 19017 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.356308 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:48.356957 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:48.357160 15655 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:48.358263 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:48.355481 15573 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:48.359820 15580 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:48.238734 19034 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.340624 19052 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:48.360774 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 181163us
I20260709 13:07:48.341955 19373 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.362010 15578 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.320808 19359 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:48.301227 19196 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.368001 15572 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:48.353361 19302 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:48.366163 19340 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.003s
I20260709 13:07:48.399549 15578 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
W20260709 13:07:48.390986 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.376151 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:48.376726 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:48.363248 19373 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.366775 19359 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.405750 15653 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:48.406049 19067 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:48.410897 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:48.433835 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57217.1us
I20260709 13:07:48.402691 19305 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:48.374267 19302 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.438406 19411 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.410359 19402 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:48.451371 19399 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:48.432544 19067 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:48.455196 19400 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:07:48.456027 19397 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:07:48.458578 19383 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:07:48.462590 19343 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.443786 19406 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:48.494792 19412 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:48.495059 19405 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:48.498261 19402 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.540472 19402 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.493556 19342 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.542207 19347 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.524933 19284 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:48.544276 19284 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.544452 19342 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.545320 19284 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:48.529073 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 118250us
I20260709 13:07:48.547849 19333 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.442052 19411 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.442745 19340 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.548600 19411 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.548776 19340 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.531416 19359 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.550367 19359 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.551172 19340 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:48.535914 19401 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 13:07:48.537250 19067 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.551884 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:48.552848 19340 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:48.553252 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:48.546892 19375 consensus_meta.cc:287] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:07:48.530047 15646 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:48.546821 19284 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.553396 19340 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:48.538872 19293 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.554651 19302 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.531708 18900 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.569072 19412 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:48.569552 19280 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.569279 19340 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.570103 19333 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:48.572300 19398 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.386s	user 0.000s	sys 0.002s
I20260709 13:07:48.572173 19411 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.574227 19196 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.576815 19165 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.522151 19149 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.573869 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 668) took 1308 ms. Trace:
I20260709 13:07:48.582582 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:48.584532 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:48.586412 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:48.596657 15648 rpcz_store.cc:276] 0709 13:07:47.265343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.456764 (+191421us) service_pool.cc:224] Handling call
0709 13:07:47.457145 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.457548 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.457587 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.461355 (+  3768us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.002073 (+540718us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.002117 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.002182 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.573648 (+571466us) raft_consensus.cc:1685] finished
0709 13:07:48.573666 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.573800 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3570,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":540329,"threads_started":1,"wal-append.queue_time_us":677625}
I20260709 13:07:48.597774 15577 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:48.597846 15574 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:07:48.593511 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.599294 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:48.603453 19165 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.603468 19149 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.610267 16278 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.611233 15728 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.611768 19333 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:48.612947 19333 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:48.638105 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 203135us
I20260709 13:07:48.640877 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:48.579103 19375 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.649536 19415 raft_consensus.cc:476] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:48.653304 19420 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:48.653882 19420 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.654858 19420 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.636387 19324 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:07:48.663064 19386 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.689s	user 0.003s	sys 0.000s
W20260709 13:07:48.657119 19301 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.454s	user 0.008s	sys 0.012s
I20260709 13:07:48.676817 19301 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.680296 15576 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.682605 19324 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.683564 19290 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:48.684332 19290 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.663748 19412 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:48.815168 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:48.853176 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.884013 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 68984.1us
I20260709 13:07:48.892480 19411 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:48.894506 19421 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:48.894733 19302 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:48.895141 19421 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:48.884536 19412 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.896167 19421 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.897219 19017 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.897388 19412 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:48.895161 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:48.899537 19290 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.900394 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 681) took 1198 ms. Trace:
I20260709 13:07:48.900087 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:48.818080 19420 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:48.761299 18691 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.900777 15651 rpcz_store.cc:276] 0709 13:07:47.701718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.817781 (+116063us) service_pool.cc:224] Handling call
0709 13:07:47.818202 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:47.818815 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.818842 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:47.819426 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:07:47.958286 (+138860us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:47.997552 (+ 39266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.003676 (+  6124us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.003850 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.003920 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.656160 (+652240us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:48.900174 (+244014us) raft_consensus.cc:1685] finished
0709 13:07:48.900196 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.900330 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5688,"prepare.queue_time_us":47009,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":14023,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":207,"spinlock_wait_cycles":48394112,"thread_start_us":128604,"threads_started":1,"wal-append.queue_time_us":154000}
I20260709 13:07:48.907918 19422 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.897873 19017 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.911777 18691 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:48.950256 19310 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:48.961434 18691 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:48.916834 19412 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:48.961767 19310 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.910979 19411 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:07:48.961608 19017 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:48.962735 19420 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.982192 19420 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:48.980216 19412 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:49.004817 19417 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.005576 19417 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.037710 15651 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.044803 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.045661 15648 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.049849 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.052969 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 1.11692e+06us
I20260709 13:07:49.056694 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.059900 16235 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:49.063266 19417 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.064486 19310 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.065759 15649 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:49.066304 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.066900 15652 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.051527 19017 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.068094 19017 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.051318 19412 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:49.075302 15648 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:49.075851 19017 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.082959 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.083748 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.083797 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.084573 19348 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.085295 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:49.097644 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1875) took 1663 ms (client timeout 1570 ms). Trace:
I20260709 13:07:49.096757 15652 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:07:49.122125 15647 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.122373 15646 rpcz_store.cc:269] 0709 13:07:47.434730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.442576 (+  7846us) service_pool.cc:224] Handling call
0709 13:07:49.097416 (+1654840us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400248bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:49.097561 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672663808}
I20260709 13:07:49.123929 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.124197 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.032652 19210 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.089370 19194 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:49.093173 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3674603680000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:07:49.127378 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.096299 18900 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:49.124593 15648 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.124398 16235 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:49.115525 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57779.4us
I20260709 13:07:49.125757 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.131579 15646 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.134620 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.135843 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:49.136430 15720 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:49.137272 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.137696 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:49.138439 15729 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:49.138337 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.139089 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:49.139351 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.140023 15726 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:49.140864 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.141639 15652 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:49.145114 16276 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.149195 15646 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:49.141108 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.126396 19293 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.125696 19348 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.152370 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1200) took 1290 ms. Trace:
I20260709 13:07:49.154592 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.156845 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.158671 16236 leader_election.cc:400] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:49.159073 16236 leader_election.cc:403] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.161106 15648 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:49.150190 15727 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 3.
I20260709 13:07:49.164811 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.165558 15723 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:49.166519 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.167296 15721 raft_consensus.cc:2410] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:49.167388 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.129637 19277 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.129292 19149 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.154946 16277 rpcz_store.cc:276] 0709 13:07:47.862578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.862721 (+   143us) service_pool.cc:224] Handling call
0709 13:07:47.863114 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:47.897611 (+ 34497us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:48.027714 (+130103us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.074710 (+1046996us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:49.075310 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:07:49.075472 (+   162us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.151397 (+ 75925us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.152079 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.152150 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.152185 (+    35us) raft_consensus.cc:1685] finished
0709 13:07:49.152196 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.152311 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765737,"prepare.queue_time_us":32607,"prepare.run_cpu_time_us":7287,"prepare.run_wall_time_us":21907,"raft.queue_time_us":1904632,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":1735,"thread_start_us":407747,"threads_started":3,"wal-append.queue_time_us":313423}
I20260709 13:07:49.164503 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.169308 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.163723 16276 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:49.172493 16274 raft_consensus.cc:2368] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:07:49.169881 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.174065 16275 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.171855 15722 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:49.121116 19422 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:07:49.173503 15647 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:49.170778 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.133651 19423 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.175258 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:49.181449 15720 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:49.150274 19276 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:49.187366 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48398.3us
I20260709 13:07:49.170334 19244 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:49.165781 19348 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.173121 19346 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.168911 19272 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:07:49.178220 19274 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.164472 19293 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.189679 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:49.183125 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.202880 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.184645 19276 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.205749 19276 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.187019 19342 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.182375 19416 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.216634 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.221167 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.199014 19017 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.232110 19017 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:49.232323 19346 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:49.233083 19017 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:49.179035 19149 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.184728 18900 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:49.204663 19293 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.188588 19423 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.178279 19277 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.237857 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.227547 15650 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:49.245649 16276 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.252096 19389 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.252632 19389 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:49.253525 16276 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:49.218791 19342 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.256850 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.236249 19274 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.236353 19288 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.235966 19276 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.260208 16275 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:49.259266 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.278061 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.278795 19272 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.279204 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.259684 19345 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.279764 19276 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:49.279956 19272 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.280380 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.281083 19272 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.281504 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.273877 19288 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.282717 19288 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.284802 19272 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.277375 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.287505 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 717) took 1734 ms. Trace:
I20260709 13:07:49.287859 15580 rpcz_store.cc:276] 0709 13:07:47.553180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.553414 (+   234us) service_pool.cc:224] Handling call
0709 13:07:47.553669 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.360306 (+806637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.287282 (+926976us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400293954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:49.287450 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853555968}
I20260709 13:07:49.293079 19149 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:49.299098 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 711) took 1903 ms. Trace:
I20260709 13:07:49.299644 15576 rpcz_store.cc:276] 0709 13:07:47.395738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.395852 (+   114us) service_pool.cc:224] Handling call
0709 13:07:47.396166 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.680745 (+1284579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.298862 (+618117us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400055854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:49.299038 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952722816}
I20260709 13:07:49.300650 19351 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:49.301193 19351 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.302106 19423 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.303224 19351 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.307029 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:49.307257 19429 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:49.308070 19375 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.309190 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.299192 19277 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:49.309886 19347 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.253484 19389 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:49.310312 19357 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.311034 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.311781 19347 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.313163 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:49.313860 19347 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.314292 19347 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:49.314720 19347 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:49.315153 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 1.03096e+06us
I20260709 13:07:49.315961 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.317111 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:49.318727 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1825) took 1021 ms. Trace:
I20260709 13:07:49.319098 15571 rpcz_store.cc:276] 0709 13:07:48.297312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.299497 (+  2185us) service_pool.cc:224] Handling call
0709 13:07:48.329031 (+ 29534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.318402 (+989371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.318429 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.318470 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.318501 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.318565 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.318672 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":976882}
I20260709 13:07:49.319610 16269 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.320225 19354 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.320959 19354 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.321177 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.323344 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:49.323460 19052 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.323913 19052 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:49.321862 19347 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.324797 19052 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.326352 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.330226 19347 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:49.330947 19347 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:49.331326 19347 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:49.331683 19347 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:49.332613 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.333271 15574 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:49.334216 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:49.334990 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.335160 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.336161 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.336964 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.321341 19354 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:49.338635 15580 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.349784 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.344159 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.345535 16277 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:49.350590 15577 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:49.351555 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.352144 15577 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.343497 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.353101 15580 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:49.357482 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 145791us
I20260709 13:07:49.325842 19052 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.360028 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.361809 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:49.361447 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:49.258756 19342 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.374832 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.379918 15573 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.374539 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.374387 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.380775 15579 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.372648 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.382908 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:49.346719 19272 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:49.384795 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.388549 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.388865 15572 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:49.390002 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.390740 15572 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.386462 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:49.360095 19308 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.393095 19277 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.374158 19042 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.393833 19277 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:49.394927 19277 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:49.395143 19403 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.395812 19403 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:49.396550 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.335711 19360 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.348475 19149 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.347740 19201 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.398057 15618 leader_election.cc:400] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:07:49.360755 19354 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.404304 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.388561 19351 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.375120 18857 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.403023 15618 leader_election.cc:403] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.403187 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.387918 19357 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.401362 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:49.388484 19272 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:49.397336 19126 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:49.427646 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.428220 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.428059 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:49.419572 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1199) took 1573 ms. Trace:
I20260709 13:07:49.430222 19340 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.429203 16273 rpcz_store.cc:276] 0709 13:07:47.845869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.846465 (+   596us) service_pool.cc:224] Handling call
0709 13:07:47.846784 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.847024 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:47.880389 (+ 33365us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.036310 (+1155921us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800418b40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:07:49.124274 (+ 87964us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.419120 (+294846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.419166 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:49.419210 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.419271 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.419515 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29340,"prepare.queue_time_us":187893,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":1170907,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4625,"spinlock_wait_cycles":10212608,"thread_start_us":382048,"threads_started":2}
I20260709 13:07:49.432657 15580 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:07:49.435966 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.437815 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.439088 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:49.439669 15722 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.440299 15727 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.441761 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.442523 15727 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:49.443662 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.444916 15721 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.446401 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.448371 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:49.449616 15722 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:49.455183 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.457157 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:49.460510 19384 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 1.319s	user 0.004s	sys 0.008s
I20260709 13:07:49.463066 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.467041 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.468788 15580 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.472759 19414 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:49.475797 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.476941 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.477938 19317 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:49.478248 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.478539 19317 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.479884 16273 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.480621 19317 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:49.485419 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 84127.7us
I20260709 13:07:49.469095 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1202) took 1543 ms. Trace:
I20260709 13:07:49.488271 16278 rpcz_store.cc:276] 0709 13:07:47.925616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.925913 (+   297us) service_pool.cc:224] Handling call
0709 13:07:47.940212 (+ 14299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.610916 (+670704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.468841 (+857925us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54007701d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:49.469033 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540444032}
I20260709 13:07:49.417009 15579 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:49.418794 16275 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:49.395282 19277 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:49.402307 19280 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.420253 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.496563 15571 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:49.422163 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 87060us
I20260709 13:07:49.425645 15572 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:49.499686 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:49.501459 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.487109 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.490195 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:49.502532 15579 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:49.477950 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.503990 16274 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:49.495267 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 66561.4us
I20260709 13:07:49.397548 19288 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.506628 16273 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:49.502979 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:49.506594 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.508507 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.402549 19270 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:07:49.414239 19351 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.517131 15572 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:49.524739 15572 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:49.426226 19272 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:49.526464 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.514988 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.400575 19339 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:07:49.532693 19420 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:49.534396 19375 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.534685 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.535807 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.536329 16272 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.426855 19126 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.550410 15580 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:49.542991 15577 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:49.538908 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:49.544296 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.544587 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.481798 19317 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:49.483881 19333 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:07:49.486254 19244 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:49.402275 19403 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:49.551994 15572 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:49.557022 15577 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:49.562983 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:49.687000 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 124124us
I20260709 13:07:49.687369 15577 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.688576 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.689846 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.690441 16274 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:49.560097 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:49.691668 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 131660us
I20260709 13:07:49.514318 19165 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:49.581128 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.697438 16278 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
W20260709 13:07:49.538273 19413 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:07:49.604207 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.406008 19201 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:49.623240 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45653us
W20260709 13:07:49.623857 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 97459.2us
I20260709 13:07:49.538620 19351 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.707226 19439 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:49.707645 19293 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.708473 19454 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.538416 19276 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.710306 16269 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:49.671792 16272 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:07:49.713539 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 198280us
I20260709 13:07:49.714567 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:49.715209 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:49.712690 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:49.638072 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.558054 19126 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.718448 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.692821 19067 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.562346 18900 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.539450 19357 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.416278 15573 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:07:49.692570 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:49.716904 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.717324 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.738718 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.688514 19270 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:49.730103 16274 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:49.697194 19388 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.741640 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.710389 19276 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:07:49.740571 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 48102.9us
I20260709 13:07:49.743065 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:49.684845 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.709899 19293 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:49.581844 19317 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:49.738775 16235 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:49.697490 19422 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:07:49.752841 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.716576 19165 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:49.722843 19406 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.754366 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.757148 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:49.757798 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:49.715361 19355 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:49.740752 19305 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.810760 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:49.817574 15580 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:49.692180 19277 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.739831 19270 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:49.740135 19454 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.750576 19388 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.815521 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:49.757426 19293 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:49.833029 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.753594 19340 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:49.755316 19034 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.807909 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:49.831336 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.808560 19413 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:49.753789 19378 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.753170 19361 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.833918 15654 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:07:49.809360 19015 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.767916 19333 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.802873 19297 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:49.750257 19299 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:49.800935 19324 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.837028 16278 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:49.753350 18900 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:49.843564 16274 raft_consensus.cc:1217] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:07:49.892442 16274 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:49.824254 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:49.847131 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:49.750499 19290 consensus_queue.cc:1059] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:07:49.753502 19416 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:07:49.759168 19370 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:07:49.836655 19388 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.859162 19015 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.835690 19357 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:07:49.896584 19345 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.004s
I20260709 13:07:49.913146 16278 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:07:49.924106 15649 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.803064 19317 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:50.064530 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.056s	sys 0.155s
W20260709 13:07:50.079694 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.056s	sys 0.155s
W20260709 13:07:50.080212 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 651159us
W20260709 13:07:49.913862 19348 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
I20260709 13:07:49.854947 19293 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:49.899325 19288 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:49.844177 19454 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.902122 19301 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:50.109155 19438 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:07:49.936445 15467 maintenance_manager.cc:419] P bcd214cd726347aba20c77156a32ce97: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033369
I20260709 13:07:50.133004 15649 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:50.114218 16278 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:50.062923 19345 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:50.205605 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.901232 18900 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.854674 19034 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.870489 19280 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:50.136480 19440 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
W20260709 13:07:50.191323 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 448309us
W20260709 13:07:50.204698 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 447592us
I20260709 13:07:50.173382 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1818) took 1958 ms. Trace:
I20260709 13:07:49.859484 19333 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.237902 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:50.213631 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 382212us
I20260709 13:07:49.900632 19165 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.175678 19310 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:50.181169 19436 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.495s	user 0.001s	sys 0.001s
I20260709 13:07:50.179602 19288 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:50.227020 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 488268us
I20260709 13:07:50.269987 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:50.257642 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.859524 19452 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:50.271230 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.862666 19276 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.239528 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.239784 15654 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:50.275452 15654 pending_rounds.cc:85] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 5
I20260709 13:07:50.275770 15654 pending_rounds.cc:107] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:50.276041 15654 raft_consensus.cc:2889] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:50.277442 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.245893 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:50.234627 19416 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.254508 19201 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.279018 19201 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.278892 19416 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.281127 19416 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.137351 19348 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:49.912626 19270 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.282745 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.227659 16276 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:50.224517 19456 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.273948 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 449668us
I20260709 13:07:50.237289 15575 rpcz_store.cc:276] 0709 13:07:48.215033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.217024 (+  1991us) service_pool.cc:224] Handling call
0709 13:07:48.217346 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.217682 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:48.217985 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.310111 (+1092126us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800446bc0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d998e758f 00007f2d92926571 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd
0709 13:07:49.406527 (+ 96416us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.407416 (+   889us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.412747 (+  5331us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.412900 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.412932 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.412993 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.140324 (+727331us) raft_consensus.cc:1685] finished
0709 13:07:50.140411 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.173241 (+ 32830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969764,"prepare.queue_time_us":247152,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":897078,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":22282,"spinlock_wait_cycles":44765952,"thread_start_us":304423,"threads_started":2,"wal-append.queue_time_us":220483}
I20260709 13:07:50.286324 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.287107 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.314209 15650 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:50.288595 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.281306 19201 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.290776 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.322278 15722 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:50.322906 15725 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:07:50.294705 19448 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:07:50.325722 15544 connection.cc:256] RPC call timeout handler was delayed by -1.008981431000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:07:50.326258 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0071814310000491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:07:50.327008 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:50.296459 19348 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:50.300303 19272 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.001s
I20260709 13:07:50.305437 19299 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.261312 19034 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:50.316732 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 207118us
I20260709 13:07:50.136046 19340 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:50.318089 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.261634 19444 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
W20260709 13:07:50.261768 19274 consensus_meta.cc:287] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.000s
I20260709 13:07:50.331707 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.335561 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.335729 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.335912 16274 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:50.336298 15692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.011s	sys 0.027s
I20260709 13:07:50.262544 19301 raft_consensus.cc:2764] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:07:50.337303 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:50.337817 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.255882 19310 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:50.346948 19272 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.363126 19310 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.363708 16274 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:50.364563 19272 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:50.365094 16274 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:50.339924 15723 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.366112 19015 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.367549 15723 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:50.367971 15722 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:50.368788 15723 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:50.346392 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.347291 15647 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:50.370287 19348 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.371107 19348 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:50.371763 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:50.372380 19348 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.356935 19270 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:50.375160 19345 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.375571 19345 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.375890 19345 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.372437 15575 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 5.
I20260709 13:07:50.384020 19310 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.385537 18900 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.272105 19293 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.386817 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 962) took 1240 ms. Trace:
W20260709 13:07:50.327780 19443 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.478s	user 0.001s	sys 0.001s
I20260709 13:07:50.350682 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:50.356762 15692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.011s	sys 0.027s
I20260709 13:07:50.322196 19357 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.354811 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2030) took 2129 ms. Trace:
I20260709 13:07:50.325495 19370 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.409385 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72153.1us
I20260709 13:07:50.409617 19370 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.410739 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:50.411481 19052 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.034s	user 0.008s	sys 0.001s
I20260709 13:07:50.337672 19201 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.401557 15724 rpcz_store.cc:276] 0709 13:07:48.219620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.221444 (+  1824us) service_pool.cc:224] Handling call
0709 13:07:48.251805 (+ 30361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.367563 (+115758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.367607 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.367662 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.367712 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.348822 (+1981110us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400398d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:50.348872 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.349016 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265667968}
I20260709 13:07:50.328433 19420 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:50.256141 19450 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.340440 19356 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.393702 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.365290 16272 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:50.401518 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.387308 16271 rpcz_store.cc:276] 0709 13:07:49.146524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.146651 (+   127us) service_pool.cc:224] Handling call
0709 13:07:49.166158 (+ 19507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.237423 (+ 71265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:49.328054 (+ 90631us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b1800340480. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:07:49.328320 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.427964 (+ 99644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.428014 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:49.428057 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.386533 (+958476us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54007017d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:50.386596 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.386742 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36420,"prepare.queue_time_us":89804,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":33128,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":27715,"spinlock_wait_cycles":107681536,"thread_start_us":99242,"threads_started":1,"wal-append.queue_time_us":377808}
I20260709 13:07:50.406471 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:50.406893 15692 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.062s (SENT)
I20260709 13:07:50.407680 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.421061 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:50.408428 19310 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.408385 19371 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.329730 19456 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.425542 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:50.426106 15571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.006s	sys 0.012s
W20260709 13:07:50.426595 15571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.006s	sys 0.012s
I20260709 13:07:50.415349 15653 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:50.429011 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.415309 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.412751 15574 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:50.417263 15648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.028s	sys 0.043s
W20260709 13:07:50.408241 19354 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.996s	user 0.003s	sys 0.007s
I20260709 13:07:50.392161 19274 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.425477 15575 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:07:50.432458 15648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.028s	sys 0.043s
I20260709 13:07:50.435235 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.416783 19355 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.412918 18900 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:50.454295 19299 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:50.459483 19457 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:50.461792 15725 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:50.407735 19459 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.443838 18691 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.404062 19034 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:50.476555 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1786) took 1148 ms. Trace:
I20260709 13:07:50.424731 19015 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:50.434129 19375 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.486738 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.514596 15724 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.434118 19052 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.440454 19416 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:50.443389 19450 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:50.451525 19445 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:50.503232 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 265017us
I20260709 13:07:50.467487 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:50.496649 15578 rpcz_store.cc:276] 0709 13:07:49.328089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.331097 (+  3008us) service_pool.cc:224] Handling call
0709 13:07:49.331431 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.331747 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.331773 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.337653 (+  5880us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.526965 (+189312us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:49.527040 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.527168 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.476188 (+949020us) raft_consensus.cc:1685] finished
0709 13:07:50.476234 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.476467 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":285,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":128799,"threads_started":1,"wal-append.queue_time_us":377215}
I20260709 13:07:50.514178 19454 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:50.520179 19456 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.486526 19288 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:50.496018 19310 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.433898 19233 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:50.440661 19354 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.431736 19356 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.488708 18900 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.528728 16273 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:50.464550 19370 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.606309 19468 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.606962 19468 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.609377 19468 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.522495 19445 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:50.611933 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 159244us
I20260709 13:07:50.520289 19201 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:50.513340 18691 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:50.523602 19342 consensus_meta.cc:287] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.126s	user 0.009s	sys 0.002s
I20260709 13:07:50.533360 19456 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.616963 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 205015us
W20260709 13:07:50.611093 19126 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.001s
W20260709 13:07:50.592509 19290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.014s	sys 0.000s
I20260709 13:07:50.528358 19333 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:50.581979 19416 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.526379 19310 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:50.615419 19067 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.856s	user 0.006s	sys 0.005s
I20260709 13:07:50.521320 19052 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.516530 19015 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.648445 15576 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.614749 19452 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:50.657035 15544 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.613965 19445 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.619834 19280 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:50.653637 19290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.015s	sys 0.001s
I20260709 13:07:50.529296 19469 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:07:50.610641 19450 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.662199 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:50.744892 18691 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.745800 19473 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:50.746845 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 92674.6us
W20260709 13:07:50.724611 19347 consensus_meta.cc:287] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.392s	user 0.013s	sys 0.001s
I20260709 13:07:50.740710 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 970) took 1422 ms. Trace:
I20260709 13:07:50.748441 16277 rpcz_store.cc:276] 0709 13:07:49.318260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.318389 (+   129us) service_pool.cc:224] Handling call
0709 13:07:49.345238 (+ 26849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.350510 (+  5272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.740403 (+1389893us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b540044d9d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:50.740627 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61084032}
I20260709 13:07:50.749908 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:50.748615 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:50.750913 15724 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:50.751377 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 185651us
I20260709 13:07:50.663611 15722 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:07:50.750910 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93948.8us
I20260709 13:07:50.751552 16274 raft_consensus.cc:2376] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7. Re-sending same reply.
I20260709 13:07:50.654855 19270 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:50.753716 15722 pending_rounds.cc:85] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 5
I20260709 13:07:50.758100 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.758690 15722 pending_rounds.cc:107] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:50.758853 15724 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:50.759053 15722 raft_consensus.cc:2889] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.754163 19370 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:50.659530 19310 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:50.740089 19042 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.346s	user 0.006s	sys 0.006s
I20260709 13:07:50.761489 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:50.762240 19463 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.734800 19351 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.027s	user 0.011s	sys 0.000s
I20260709 13:07:50.763304 15721 raft_consensus.cc:2410] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:07:50.734582 19471 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:07:50.742751 19470 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:50.656395 19276 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:50.738657 19361 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:50.762748 19463 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:50.769784 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.646588 19342 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:50.771036 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 156607us
I20260709 13:07:50.724810 19354 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.654605 19126 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.774741 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:50.776341 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:50.778098 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 734) took 1260 ms. Trace:
I20260709 13:07:50.747665 19347 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.658725 19416 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.828393 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 691) took 1733 ms. Trace:
I20260709 13:07:50.659758 19373 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:07:50.662968 19371 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:07:50.761600 19370 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:50.652200 19456 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:50.834225 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.767354 19359 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.835259 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.729840 19345 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.654695 19459 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:07:50.707626 19288 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.894330 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:50.765921 19270 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:50.838924 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 62724.1us
I20260709 13:07:50.838776 15652 rpcz_store.cc:276] 0709 13:07:49.094654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.202248 (+107594us) service_pool.cc:224] Handling call
0709 13:07:49.210359 (+  8111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.210568 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.210594 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.211015 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.414996 (+203981us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:50.788627 (+1373631us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.788923 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.789028 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.789084 (+    56us) raft_consensus.cc:1685] finished
0709 13:07:50.789101 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.828306 (+ 39205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1350351,"raft.queue_time_us":474,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8710,"thread_start_us":203614,"threads_started":1,"wal-append.queue_time_us":305014}
I20260709 13:07:50.847244 16270 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.847172 16275 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:50.787613 19361 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:50.691861 19446 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:07:50.853387 19416 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.854591 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2034) took 2633 ms. Trace:
I20260709 13:07:50.851853 19347 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:50.877444 19482 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:50.835321 19356 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:50.883533 19345 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:50.884243 19042 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.884533 19480 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.885210 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58027us
I20260709 13:07:50.972746 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:50.972963 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:50.885537 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 110905us
I20260709 13:07:50.886204 19387 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.934427 19360 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:50.887012 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.982040 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.982568 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.888294 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.890002 19452 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:50.893162 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1796) took 1550 ms. Trace:
W20260709 13:07:50.970873 19388 consensus_meta.cc:287] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.001s
I20260709 13:07:51.145695 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:50.832311 16278 rpcz_store.cc:276] 0709 13:07:49.517182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.221817 (+704635us) service_pool.cc:224] Handling call
0709 13:07:50.255065 (+ 33248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.274744 (+ 19679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.274787 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.337328 (+ 62541us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.488546 (+151218us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:50.777189 (+288643us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.777618 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.777725 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.777789 (+    64us) raft_consensus.cc:1685] finished
0709 13:07:50.777809 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.777996 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8779,"raft.queue_time_us":90154,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":48676,"thread_start_us":376506,"threads_started":2,"wal-append.queue_time_us":290460}
I20260709 13:07:50.899693 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:50.854481 15649 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.147065 15726 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:50.902577 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 67397.5us
I20260709 13:07:50.939841 15728 rpcz_store.cc:276] 0709 13:07:48.221151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.221284 (+   133us) service_pool.cc:224] Handling call
0709 13:07:48.251485 (+ 30201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.611712 (+360227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.854291 (+2242579us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400106b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:50.854514 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803155200}
I20260709 13:07:50.880242 19456 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:50.943655 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:50.932534 19436 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:07:50.943770 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 189793us
I20260709 13:07:50.853835 19473 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:50.970108 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.973965 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.838544 19301 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:50.977432 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:50.984340 15646 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:50.986167 15571 rpcz_store.cc:276] 0709 13:07:49.342917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.497421 (+154504us) service_pool.cc:224] Handling call
0709 13:07:49.497799 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.498204 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.498243 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.510553 (+ 12310us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.427071 (+916518us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.427131 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.427249 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.892910 (+465661us) raft_consensus.cc:1685] finished
0709 13:07:50.892931 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.893092 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2473,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10420,"thread_start_us":864948,"threads_started":1,"wal-append.queue_time_us":1032454}
I20260709 13:07:51.170403 15577 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:50.767227 19351 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.148427 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:51.175653 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:50.836951 19276 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:51.176928 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 203035us
I20260709 13:07:51.177919 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:50.968057 18900 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.159597 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:50.979441 19387 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.254771 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:51.168982 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.152235 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:50.934075 19359 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.148448 19290 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.180276 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:51.321627 15571 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:51.308676 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.311128 15577 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:51.311421 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.181205 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:51.319954 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 160477us
I20260709 13:07:50.977970 19042 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:51.247188 19488 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:51.323211 16278 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:51.180302 19067 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.168841 19196 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.310322 19387 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.340988 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:51.247081 19360 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:51.333822 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 152688us
I20260709 13:07:51.172093 19293 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.320879 19372 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:51.160521 19388 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.319756 18900 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.343010 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:51.171646 19469 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:51.172881 19345 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:51.178103 19052 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.359495 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:51.309832 19356 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:51.248821 19473 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:51.376366 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:51.151263 19361 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.316933 19348 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:51.381263 19498 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:51.370417 19372 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.166394 19370 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.381930 19280 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:51.382344 19345 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:51.383551 19494 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:07:51.377753 16278 raft_consensus.cc:2376] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7. Re-sending same reply.
I20260709 13:07:51.421324 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:51.165982 19480 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.383937 19463 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.400352 15723 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:51.369839 19403 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.321094 19290 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.368798 19371 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:51.342978 19459 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:51.432219 19042 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:51.432866 19481 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.708s	user 0.003s	sys 0.000s
I20260709 13:07:51.434365 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:51.435658 19445 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.674s	user 0.004s	sys 0.004s
I20260709 13:07:51.363741 19196 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.532575 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.534576 19196 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.537180 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2049) took 1187 ms. Trace:
I20260709 13:07:51.537443 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:51.436367 19480 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:51.437165 19310 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.675s	user 0.006s	sys 0.002s
I20260709 13:07:51.437405 19270 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.437891 19361 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.403790 19342 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.417732 18900 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:51.440971 19492 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:51.442302 19345 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.444536 19388 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.445273 19473 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.446980 19276 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.448092 19149 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:51.596601 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1806) took 1190 ms. Trace:
I20260709 13:07:51.433784 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1914) took 1295 ms. Trace:
W20260709 13:07:51.441584 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.624189 15654 rpcz_store.cc:276] 0709 13:07:50.138648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.138799 (+   151us) service_pool.cc:224] Handling call
0709 13:07:50.139150 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.276588 (+137438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.433517 (+1156929us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.433716 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230654336}
W20260709 13:07:51.449549 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.445685 16272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 726) took 1944 ms (client timeout 2062 ms). Trace:
W20260709 13:07:51.600677 15655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.007s
I20260709 13:07:51.422219 15652 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.463349 15727 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:51.648028 15655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.005s	sys 0.007s
I20260709 13:07:51.649379 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2044) took 2208 ms. Trace:
I20260709 13:07:51.649951 15727 rpcz_store.cc:276] 0709 13:07:49.440667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.443295 (+  2628us) service_pool.cc:224] Handling call
0709 13:07:51.462840 (+2019545us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b58001a4398. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eeeee 0000000000375939 00007f2d9a9621e0 00007f2d9aa2b0c4 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:51.462994 (+   154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.648478 (+185484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.649069 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5532032}
W20260709 13:07:51.651944 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 473913us
I20260709 13:07:51.538121 19387 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.653548 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:51.655793 19387 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.656942 19387 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:51.658052 19371 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.659119 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:51.550184 18900 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:51.659591 16272 rpcz_store.cc:269] 0709 13:07:49.501136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.735821 (+234685us) service_pool.cc:224] Handling call
0709 13:07:51.445424 (+1709603us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54006392d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.445602 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432032128}
I20260709 13:07:51.661159 19415 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.538106 16278 raft_consensus.cc:2376] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9. Re-sending same reply.
I20260709 13:07:51.542534 19310 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.663565 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.665037 16278 raft_consensus.cc:2410] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:51.665347 19310 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.607043 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2363) took 1211 ms. Trace:
I20260709 13:07:51.666186 15653 rpcz_store.cc:276] 0709 13:07:50.395360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.430093 (+ 34733us) service_pool.cc:224] Handling call
0709 13:07:50.430479 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.442820 (+ 12341us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:50.944609 (+501789us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.344732 (+400123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.360995 (+ 16263us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.361183 (+   188us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.361458 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.606189 (+244731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.606396 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.606490 (+    94us) raft_consensus.cc:1685] finished
0709 13:07:51.606511 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.606741 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420135,"prepare.queue_time_us":421176,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":285,"raft.queue_time_us":58815,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":43216,"spinlock_wait_cycles":36347648,"thread_start_us":537909,"threads_started":3,"wal-append.queue_time_us":562006}
I20260709 13:07:51.669365 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:51.605989 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.463613 19290 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.365978 19293 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.673494 19293 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.452735 19297 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:51.674000 19459 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.674425 19297 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:51.674979 19459 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.676158 19297 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.677742 19297 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.454118 19351 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.449059 19359 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.464033 19403 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.709381 19403 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:51.553606 19450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.005s
I20260709 13:07:51.389586 19469 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:51.723759 19450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.016s	sys 0.005s
I20260709 13:07:51.725090 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.545398 19492 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:51.726586 19492 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:51.727352 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.730602 15647 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:51.631013 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.623993 19510 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:07:51.658149 19447 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:51.735350 19447 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.537559 15722 rpcz_store.cc:276] 0709 13:07:50.349497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.368666 (+ 19169us) service_pool.cc:224] Handling call
0709 13:07:50.368943 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.759706 (+390763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.536861 (+777155us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54003cb9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.537103 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676516224}
I20260709 13:07:51.739399 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.740628 15722 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:51.448889 19308 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:51.743155 19308 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.743968 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:51.745527 19469 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.649963 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1907) took 2200 ms. Trace:
I20260709 13:07:51.696269 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.695794 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.700721 19343 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.747030 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:51.747586 16272 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:51.747887 16278 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:51.748117 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1918) took 1241 ms. Trace:
I20260709 13:07:51.700944 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.701504 18691 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.748735 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:51.677984 19459 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.678500 19452 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.540329 19445 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.746625 15655 rpcz_store.cc:276] 0709 13:07:49.449882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.451882 (+  2000us) service_pool.cc:224] Handling call
0709 13:07:49.452223 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.452463 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:50.985189 (+1532726us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.649221 (+664032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.649355 (+   134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.649489 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.649595 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.649868 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1402274,"prepare.queue_time_us":1385509,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":8467,"raft.queue_time_us":24886,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":291,"thread_start_us":811921,"threads_started":2,"wal-append.queue_time_us":643381}
I20260709 13:07:51.755354 19280 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:51.749543 18691 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.756228 19280 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.756826 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1911) took 1907 ms. Trace:
I20260709 13:07:51.758224 19459 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.759187 18691 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.759101 19459 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.711156 19351 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.683003 19196 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.682863 19485 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.659276 19371 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.712324 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:51.712911 18900 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.716413 19490 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:51.704195 19414 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.704416 15653 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:51.659241 19149 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.747730 19343 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.622359 15572 rpcz_store.cc:276] 0709 13:07:50.406083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.406965 (+   882us) service_pool.cc:224] Handling call
0709 13:07:50.407279 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.416635 (+  9356us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:50.643444 (+226809us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.836191 (+192747us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.836864 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.837043 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.837098 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.837199 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.438610 (+601411us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b18000496c0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:51.595499 (+156889us) raft_consensus.cc:1685] finished
0709 13:07:51.595765 (+   266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.596247 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8873,"prepare.queue_time_us":407470,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":32773,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":37566,"spinlock_wait_cycles":51020032,"thread_start_us":320742,"threads_started":2,"wal-append.queue_time_us":307200}
I20260709 13:07:51.719233 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.748805 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.754159 19452 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.748531 15654 rpcz_store.cc:276] 0709 13:07:50.506896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.704585 (+1197689us) service_pool.cc:224] Handling call
0709 13:07:51.748035 (+ 43450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.772668 15720 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:51.812836 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.764070 16273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 729) took 2261 ms (client timeout 1570 ms). Trace:
I20260709 13:07:51.766863 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1213) took 2288 ms. Trace:
I20260709 13:07:51.802428 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.772614 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 728) took 1373 ms. Trace:
W20260709 13:07:51.762133 15651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.002s	sys 0.014s
I20260709 13:07:51.849433 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2366) took 1007 ms. Trace:
I20260709 13:07:51.850014 15653 rpcz_store.cc:276] 0709 13:07:50.827473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.668785 (+841312us) service_pool.cc:224] Handling call
0709 13:07:51.835258 (+166473us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:51.771286 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.761763 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:51.844113 16275 rpcz_store.cc:276] 0709 13:07:49.477773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.494786 (+ 17013us) service_pool.cc:224] Handling call
0709 13:07:49.503251 (+  8465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.901818 (+1398567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.766306 (+864488us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54006982d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.766619 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090291584}
I20260709 13:07:51.759213 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1915) took 1552 ms. Trace:
I20260709 13:07:51.761725 19459 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.801409 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:51.763378 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:51.870126 15725 raft_consensus.cc:2368] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12.
I20260709 13:07:51.765533 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:51.842953 16273 rpcz_store.cc:269] 0709 13:07:49.501987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.514754 (+ 12767us) service_pool.cc:224] Handling call
0709 13:07:51.763608 (+2248854us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54006dc9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.763807 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109822336}
I20260709 13:07:51.768501 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:51.874334 15726 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:51.875882 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.817028 19280 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.794585 19510 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.879513 19510 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:51.781082 19293 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.883253 19149 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.883548 19343 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.766963 19445 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.886776 19293 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.889286 19293 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.766115 19308 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:51.769874 15729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2390) took 1477 ms (client timeout 1855 ms). Trace:
I20260709 13:07:51.845095 15723 rpcz_store.cc:276] 0709 13:07:50.398805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.398962 (+   157us) service_pool.cc:224] Handling call
0709 13:07:51.772110 (+1373148us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54001fcf54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.772410 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251146624}
I20260709 13:07:51.792042 19359 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:51.892345 15651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.007s	sys 0.014s
I20260709 13:07:51.885286 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 727) took 1487 ms. Trace:
I20260709 13:07:51.791738 19447 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.891388 15577 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:51.859396 15649 rpcz_store.cc:276] 0709 13:07:50.207012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.207167 (+   155us) service_pool.cc:224] Handling call
0709 13:07:50.236460 (+ 29293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.151099 (+914639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.758660 (+607561us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540035c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.759045 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420881152}
I20260709 13:07:51.773159 19373 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.789655 19034 raft_consensus.cc:3055] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:51.893683 15729 rpcz_store.cc:269] 0709 13:07:50.292057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.331348 (+ 39291us) service_pool.cc:224] Handling call
0709 13:07:51.769393 (+1438045us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b540004b354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.769665 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102192512}
I20260709 13:07:51.779893 19015 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.903227 16277 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:51.897037 15720 rpcz_store.cc:276] 0709 13:07:50.398376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.398533 (+   157us) service_pool.cc:224] Handling call
0709 13:07:51.772052 (+1373519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.882125 (+110073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.884885 (+  2760us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540004b350. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.885174 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3157806464}
I20260709 13:07:51.897900 15652 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:07:51.908733 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47776us
I20260709 13:07:51.788439 19342 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.820984 19317 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.906813 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:51.896661 19359 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:51.914423 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 113309us
I20260709 13:07:51.911659 16272 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:51.904224 19034 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:51.918077 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2367) took 1086 ms. Trace:
I20260709 13:07:51.912331 16278 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:51.881032 19510 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.921049 19310 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:51.921960 19510 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.919679 15652 rpcz_store.cc:276] 0709 13:07:50.827789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.399192 (+571403us) service_pool.cc:224] Handling call
0709 13:07:51.911306 (+512114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.924453 15575 raft_consensus.cc:2410] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:51.923703 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 692) took 2100 ms. Trace:
W20260709 13:07:51.930248 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.757310 15648 rpcz_store.cc:276] 0709 13:07:49.849483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.850557 (+  1074us) service_pool.cc:224] Handling call
0709 13:07:49.866149 (+ 15592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.437341 (+571192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.437386 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.443866 (+  6480us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.678391 (+234525us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.678453 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.756168 (+1077715us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b540035cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.756248 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.756307 (+    59us) raft_consensus.cc:1685] finished
0709 13:07:51.756322 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.756655 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2804,"raft.queue_time_us":334615,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13469,"spinlock_wait_cycles":95419264,"thread_start_us":709949,"threads_started":2,"wal-append.queue_time_us":366460}
I20260709 13:07:51.916481 19359 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:51.933636 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.926734 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:51.939926 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 125479us
I20260709 13:07:51.915714 19414 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.943873 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:51.944401 19373 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.946332 15655 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:07:51.946856 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.947695 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2364) took 1531 ms. Trace:
I20260709 13:07:51.947903 19373 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.946542 19015 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:51.948084 15655 rpcz_store.cc:276] 0709 13:07:50.416136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.757086 (+1340950us) service_pool.cc:224] Handling call
0709 13:07:51.757574 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.946879 (+189305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.947439 (+   560us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540017cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.947612 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433406848}
I20260709 13:07:51.949383 15723 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:07:51.932935 16274 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:51.906756 19351 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.950877 19389 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.951412 19451 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 2.257s	user 0.003s	sys 0.000s
I20260709 13:07:51.953117 19351 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.953486 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1922) took 1438 ms. Trace:
I20260709 13:07:51.953974 15654 rpcz_store.cc:276] 0709 13:07:50.515101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.919036 (+1403935us) service_pool.cc:224] Handling call
0709 13:07:51.952545 (+ 33509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.953050 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.953085 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.953153 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:51.953210 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.953275 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.953403 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.956744 19308 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:51.957296 16271 raft_consensus.cc:2410] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:51.957475 19308 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.956930 15648 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.962904 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1926) took 1192 ms. Trace:
I20260709 13:07:51.963369 15648 rpcz_store.cc:276] 0709 13:07:50.770706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.956349 (+1185643us) service_pool.cc:224] Handling call
0709 13:07:51.956700 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.962605 (+  5905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.962815 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:51.964680 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:51.965193 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.965474 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 728) took 2639 ms. Trace:
I20260709 13:07:51.965745 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.965886 19464 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:51.966666 15728 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:51.966794 19464 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.968822 15652 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:51.969591 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2387) took 1681 ms. Trace:
I20260709 13:07:51.969521 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1925) took 1212 ms. Trace:
I20260709 13:07:51.970088 15652 rpcz_store.cc:276] 0709 13:07:50.757008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.967817 (+1210809us) service_pool.cc:224] Handling call
0709 13:07:51.968347 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.969275 (+   928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.969457 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:51.972373 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.972873 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:51.973953 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 973) took 2651 ms. Trace:
I20260709 13:07:51.974141 19414 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.974171 19373 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:51.973410 19280 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:51.977110 19280 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.977512 19280 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:51.978688 19280 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.980140 19280 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.980515 19126 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:51.970868 19351 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:51.982741 19351 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.983542 19355 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:51.985463 19194 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.986375 19276 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.987027 19276 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:51.989300 19276 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:51.992210 19301 consensus_queue.cc:1059] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:51.993235 19447 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:51.993466 19301 raft_consensus.cc:3055] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:51.993901 19301 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:51.994073 19403 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.994632 19403 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:51.994987 19301 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:51.962962 19514 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 13:07:51.961907 19308 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.022691 15727 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:51.969991 15721 rpcz_store.cc:276] 0709 13:07:50.288026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.362466 (+ 74440us) service_pool.cc:224] Handling call
0709 13:07:51.969159 (+1606693us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400107554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:51.969415 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763024256}
I20260709 13:07:51.993901 19447 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.023918 19403 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:52.024982 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.026150 19342 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.026919 19277 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.027195 19473 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:51.965903 15576 rpcz_store.cc:276] 0709 13:07:49.325507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.325623 (+   116us) service_pool.cc:224] Handling call
0709 13:07:49.325944 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.671327 (+1345383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.964996 (+1293669us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001c5554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.965287 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2989296384}
I20260709 13:07:51.931876 19459 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.030540 15727 pending_rounds.cc:85] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 7
I20260709 13:07:51.974408 16269 rpcz_store.cc:276] 0709 13:07:49.337492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.360280 (+ 22788us) service_pool.cc:224] Handling call
0709 13:07:49.360555 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.710906 (+350351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.973507 (+2262601us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400771ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:51.973788 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803933056}
I20260709 13:07:52.004758 19149 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.918857 19196 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.036331 15725 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.037009 19034 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:52.041378 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 97711.4us
I20260709 13:07:52.041872 19371 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.042018 19490 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.042673 15649 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.003042 19351 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:51.914130 19485 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.048442 19492 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.055634 15648 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:52.056546 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:51.927599 15651 rpcz_store.cc:276] 0709 13:07:49.823534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.830457 (+  6923us) service_pool.cc:224] Handling call
0709 13:07:49.834719 (+  4262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.834954 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:50.967346 (+1132392us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.923126 (+955780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.923243 (+   117us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.923363 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.923451 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.923616 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1018460,"prepare.queue_time_us":1011758,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":18118,"thread_start_us":1059871,"threads_started":2,"wal-append.queue_time_us":736739}
I20260709 13:07:52.082438 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1920) took 1570 ms. Trace:
I20260709 13:07:52.082888 15649 rpcz_store.cc:276] 0709 13:07:50.511562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.911108 (+1399546us) service_pool.cc:224] Handling call
0709 13:07:52.042367 (+131259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.082173 (+ 39806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.082382 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:52.059337 15727 pending_rounds.cc:107] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:52.083807 15727 raft_consensus.cc:2889] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.082470 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.094449 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:52.097527 19149 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.103147 19034 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:52.106621 15728 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:52.107599 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.108008 19165 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.108867 19165 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.111251 19492 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.118615 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.119518 15576 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.122248 19447 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.123373 15655 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:52.125137 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 697) took 1301 ms. Trace:
I20260709 13:07:52.059062 19346 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:52.067417 19490 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.125623 15655 rpcz_store.cc:276] 0709 13:07:50.823924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.949300 (+1125376us) service_pool.cc:224] Handling call
0709 13:07:51.949705 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.123954 (+174249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.124753 (+   799us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002e2a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.125054 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398731008}
I20260709 13:07:52.093494 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.106689 16269 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:52.126502 19346 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.092178 19464 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.134236 19490 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.143088 15619 leader_election.cc:400] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12.
I20260709 13:07:52.150316 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.150449 19452 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.151862 19346 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.153220 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.153844 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.153950 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.154523 19373 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:52.155670 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.155550 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 91869.5us
I20260709 13:07:52.181079 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.156792 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.158493 15578 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:52.154553 15724 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:52.162925 19165 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.164338 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 969) took 2903 ms. Trace:
I20260709 13:07:52.171828 19196 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.175457 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.176805 15619 leader_election.cc:403] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.176946 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.155900 15571 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:52.185715 15655 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:52.184688 15575 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:52.186143 16276 rpcz_store.cc:276] 0709 13:07:49.261074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.261223 (+   149us) service_pool.cc:224] Handling call
0709 13:07:49.261505 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.286277 (+1024772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.163786 (+1877509us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54005424d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.164144 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221423360}
I20260709 13:07:52.194644 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.195205 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:52.195736 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.133433 19473 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:52.201751 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 116190us
I20260709 13:07:52.201751 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.203678 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.204083 19351 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.206315 19149 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:52.206696 19361 consensus_meta.cc:287] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.004s
I20260709 13:07:52.207072 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.207605 15648 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:52.208475 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:52.209615 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.209908 16269 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:52.210429 16276 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:52.210913 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.211519 19456 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.211676 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.212083 19456 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.210425 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.209740 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.207638 15574 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.216598 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.202152 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.219203 19485 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.220082 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:52.220036 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.220743 16276 raft_consensus.cc:2376] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8. Re-sending same reply.
I20260709 13:07:52.224231 16269 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:52.225047 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:52.225174 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 169691us
I20260709 13:07:52.230439 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:52.199506 19196 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.232190 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:52.236431 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:52.236812 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:52.237414 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.543s (SENT) [suppressed 15 similar messages]
I20260709 13:07:52.237612 15725 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:52.237998 15728 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:52.240767 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.241654 19473 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.245335 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.246253 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.246299 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.246853 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1917) took 1715 ms. Trace:
I20260709 13:07:52.247643 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.249343 19359 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.253423 19456 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:52.255548 19459 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.266543 15573 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.266788 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.267519 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.268047 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.268603 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.269088 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.269273 15572 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:52.270211 19485 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.270437 15543 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.270677 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.270938 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.271454 15648 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:52.272164 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.272905 15648 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:52.273146 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.274003 15652 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:52.274279 19485 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.258693 15650 rpcz_store.cc:276] 0709 13:07:50.504518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.760073 (+1255555us) service_pool.cc:224] Handling call
0709 13:07:51.760629 (+   556us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:51.905480 (+144851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.905530 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:51.938773 (+ 33243us) log.cc:844] Serialized 52 byte log entry
0709 13:07:52.095918 (+157145us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:52.133974 (+ 38056us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.134334 (+   360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.134432 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.219710 (+ 85278us) raft_consensus.cc:1685] finished
0709 13:07:52.219730 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.219907 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135488,"prepare.queue_time_us":37753,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":144902,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":15079,"thread_start_us":139705,"threads_started":1,"wal-append.queue_time_us":234849}
I20260709 13:07:52.275038 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.273725 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.275560 19485 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.276402 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.277202 15723 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:52.274313 16276 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:52.278141 19459 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.278899 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.279843 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.280098 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.281199 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.282482 19373 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:52.283036 19373 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.283927 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.284080 19373 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.285882 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.281747 16276 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:52.287137 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.258908 15579 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:52.288393 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:52.288825 15574 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:07:52.288367 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.292734 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.293473 15579 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.293849 15649 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:52.295466 15649 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.292645 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:52.298184 19510 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.298776 19510 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.299445 19510 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.299769 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1801) took 2794 ms. Trace:
I20260709 13:07:52.300364 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.300153 15580 rpcz_store.cc:276] 0709 13:07:49.505676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.569778 (+ 64102us) service_pool.cc:224] Handling call
0709 13:07:49.570147 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.818190 (+248043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.299288 (+2481098us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400293454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.299613 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568008448}
I20260709 13:07:52.301550 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.302770 19210 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.304011 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.296968 15649 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.293939 15654 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:52.287544 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.301721 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.288646 15655 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:52.298271 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:52.303237 19210 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.308305 15576 raft_consensus.cc:2410] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:52.309221 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:52.309465 15573 raft_consensus.cc:2410] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:52.317996 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78190.6us
I20260709 13:07:52.318253 15580 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:52.321501 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93129.7us
I20260709 13:07:52.325570 19317 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.327482 19317 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.327960 19317 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.330874 19196 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:52.330921 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.313918 19210 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.338727 15578 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:52.338864 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.339303 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:52.339537 16276 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:52.339785 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.348978 15578 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:52.342478 15726 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:52.344771 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.347582 16275 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:52.356405 15579 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:52.354372 16275 pending_rounds.cc:85] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 7
I20260709 13:07:52.358762 16275 pending_rounds.cc:107] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:07:52.359066 16275 raft_consensus.cc:2889] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.325922 19361 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.347482 19351 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12.
W20260709 13:07:52.363901 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57093.9us
I20260709 13:07:52.342289 19359 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:52.363646 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1919) took 1854 ms. Trace:
I20260709 13:07:52.346180 19339 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.370497 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.368388 15653 rpcz_store.cc:276] 0709 13:07:50.509332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.850903 (+1341571us) service_pool.cc:224] Handling call
0709 13:07:51.907465 (+ 56562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.133851 (+226386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.133883 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.133926 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:52.133952 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.363441 (+229489us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400369054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.363479 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.363589 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508642176}
I20260709 13:07:52.371330 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:52.374590 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 70690us
I20260709 13:07:52.377686 15579 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.378309 15579 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.379236 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.384788 19530 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.385279 19530 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.385596 19530 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.378720 19339 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.390257 19462 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.390954 19462 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.395294 16275 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:52.396765 16275 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:52.398113 19194 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.358222 19473 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:07:52.380710 19464 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:52.401461 15651 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:07:52.393719 19462 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.389310 19210 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.364869 19277 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:52.411623 19280 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:52.403295 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.408586 15575 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:52.412853 19522 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.544s	user 0.000s	sys 0.002s
I20260709 13:07:52.415055 15571 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:52.401754 15578 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:07:52.423918 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56644.4us
I20260709 13:07:52.417806 19462 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.418586 19510 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.409320 19317 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.431336 16276 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:52.431752 19490 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.435442 15578 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:52.437183 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:52.442276 19277 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.455194 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.442307 15579 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.446497 19210 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.426937 19462 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:52.448729 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.452152 16272 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.456768 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:52.466004 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.466703 15725 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.467161 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:52.468472 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:52.469018 16275 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.470958 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1210) took 2994 ms. Trace:
I20260709 13:07:52.471414 16270 rpcz_store.cc:276] 0709 13:07:49.476804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.479097 (+  2293us) service_pool.cc:224] Handling call
0709 13:07:49.479357 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.901433 (+1422076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.470458 (+1569025us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400698f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.470754 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3145396096}
I20260709 13:07:52.474015 16270 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.474849 15571 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:52.475318 15725 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:52.462468 19510 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.479002 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.402771 19459 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.486943 19210 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.487320 16276 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:52.491868 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54779.1us
I20260709 13:07:52.491871 16270 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:52.492539 15579 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.477229 19280 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.495079 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.496381 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.463856 19462 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.498276 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.498699 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:52.503051 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.494812 15723 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:52.510552 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.494488 19280 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.498059 19473 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.508324 19210 consensus_queue.cc:1059] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:52.518244 19351 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.518394 19464 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.518721 19351 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:52.518814 19317 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.519176 19351 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.520155 19462 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.521134 19485 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.522259 19375 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.523208 19375 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.523555 19375 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.534763 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.538550 19339 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.516845 19280 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.512547 19510 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.517391 19473 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:52.543800 16275 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:52.546432 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.546185 19375 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.547153 19356 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.515161 19452 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.547343 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.521920 19462 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:52.554454 19490 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:52.557803 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.559275 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.560097 19510 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.560796 19530 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.562181 19473 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.567291 19034 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.576740 19342 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.572206 19510 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:52.581300 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2361) took 2221 ms. Trace:
I20260709 13:07:52.571663 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:52.570389 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 103873us
W20260709 13:07:52.586769 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.590487 15647 rpcz_store.cc:276] 0709 13:07:50.360166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.371031 (+ 10865us) service_pool.cc:224] Handling call
0709 13:07:50.371300 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.731340 (+1360040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.580968 (+849628us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002e2554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:52.581223 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3124802304}
I20260709 13:07:52.592165 15579 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:52.586666 19293 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.586846 19034 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:52.601908 19034 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.605523 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:52.606598 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.609619 19372 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:52.609848 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 689328us
I20260709 13:07:52.596855 19194 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.596603 19490 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.610358 19416 consensus_queue.cc:1059] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:07:52.614097 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 658944us
I20260709 13:07:52.614331 19530 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.616254 19420 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.618271 15727 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:52.618649 19463 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.618383 19165 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:52.625171 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:52.610914 19511 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:52.630069 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.631108 19511 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.634718 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:52.635571 16278 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:52.623169 19372 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.622233 19165 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:52.644218 19165 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:52.646124 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.640341 19483 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:07:52.640699 19333 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.642563 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.642467 19042 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:52.647347 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.651700 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.632882 19459 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.648790 19389 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:52.655555 19456 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:52.624285 19490 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:07:52.673871 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.668301 19372 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:52.633196 19463 consensus_queue.cc:1243] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:52.690495 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.690872 15574 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:52.691140 15723 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.665913 19333 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.641737 19509 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:52.636766 19511 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.662194 19415 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:52.663808 19034 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.601872 19510 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.656057 19351 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.660020 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.680616 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.693846 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.670338 19340 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:52.721108 15572 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:52.680893 19373 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.668494 19414 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:52.721258 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:52.699193 19333 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.728022 15580 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.672328 19456 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.714645 19459 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:52.764555 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 752) took 2015 ms (client timeout 1928 ms). Trace:
I20260709 13:07:52.764716 19459 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:52.764982 16271 rpcz_store.cc:269] 0709 13:07:50.749186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.466915 (+717729us) service_pool.cc:224] Handling call
0709 13:07:52.764311 (+1297396us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54004c2054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:52.764477 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820246784}
I20260709 13:07:52.726236 19373 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.766147 19373 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.766853 19459 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.757027 19356 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:52.757565 19372 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.726445 19509 consensus_queue.cc:1243] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:52.770984 19420 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:52.759845 19456 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.761150 19351 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.763840 19280 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.778705 15723 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:52.689828 19017 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:07:52.811206 19277 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:52.813383 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 249689us
I20260709 13:07:52.814177 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:52.815325 19452 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.815744 19452 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:52.816126 19452 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.818611 19342 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:52.820034 19342 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:52.822494 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 162577us
W20260709 13:07:52.823150 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 227481us
I20260709 13:07:52.824679 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:52.826813 19464 raft_consensus.cc:3055] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.827351 19464 raft_consensus.cc:740] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:52.828049 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106681us
I20260709 13:07:52.834137 19416 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.834769 19416 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:52.835254 19416 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.835357 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.836593 19456 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:52.839099 19276 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.813813 19301 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:52.838415 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:52.843750 19308 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:52.813592 19277 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:52.845803 19530 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.866230 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:52.853217 19456 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:52.880686 19464 consensus_queue.cc:260] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.891901 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2398) took 1162 ms. Trace:
I20260709 13:07:52.885450 19333 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.894199 18691 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:52.900738 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 62425.5us
I20260709 13:07:52.894796 18691 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:52.906168 18691 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.868753 19548 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:52.892586 15720 rpcz_store.cc:276] 0709 13:07:51.729911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.905924 (+176013us) service_pool.cc:224] Handling call
0709 13:07:51.931702 (+ 25778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.657176 (+725474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.657207 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.657686 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.714531 (+ 56845us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:52.714584 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.714674 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.891623 (+176949us) raft_consensus.cc:1685] finished
0709 13:07:52.891651 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.891823 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689244,"raft.queue_time_us":690390,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":56469,"threads_started":1,"wal-append.queue_time_us":142032}
W20260709 13:07:52.911551 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.912086 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:52.912849 15723 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:52.913195 19375 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.913618 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:52.864698 19530 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:52.915247 19530 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.916576 19530 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.917923 19463 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.918310 19463 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:52.942641 19423 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.943161 19423 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:52.944237 19149 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:52.944720 19149 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:52.945734 19149 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.950258 19408 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.950701 19408 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:52.951622 19408 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:52.952886 19408 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.954196 19361 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.954819 19361 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:52.955770 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:52.957377 19361 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:52.957540 19356 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.881857 19340 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:52.959468 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.881871 19464 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.960805 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:52.872689 19456 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:52.960853 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 94810.1us
I20260709 13:07:52.910218 19034 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:52.970017 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 154101us
W20260709 13:07:52.978790 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 153379us
I20260709 13:07:52.960274 19356 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:52.972016 19042 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.972349 19456 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:52.989539 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.987419 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:52.973781 19280 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:52.989862 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:52.993046 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.976687 19333 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:52.996251 19556 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:52.976760 19452 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.005335 16278 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:52.986578 19563 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.006481 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.010761 16271 raft_consensus.cc:1240] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:52.985597 19293 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:53.000981 19414 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.018492 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.021342 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 976) took 1344 ms. Trace:
I20260709 13:07:53.022243 19317 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.026535 19356 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.031622 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.042644 15580 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:53.044170 19511 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.034210 19317 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:53.009754 19333 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:53.050285 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:53.013058 19563 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.051651 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.052690 19373 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.075980 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:53.067567 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 60568.1us
I20260709 13:07:53.075846 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.075480 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.032697 16277 rpcz_store.cc:276] 0709 13:07:51.676775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.914150 (+237375us) service_pool.cc:224] Handling call
0709 13:07:52.541187 (+627037us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:52.544461 (+  3274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.812518 (+268057us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:52.812783 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.977689 (+164906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.983918 (+  6229us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.989451 (+  5533us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.989735 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.995421 (+  5686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.995487 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.021127 (+ 25640us) raft_consensus.cc:1685] finished
0709 13:07:53.021146 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.021252 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269455,"prepare.queue_time_us":4304,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":279232,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":9914,"spinlock_wait_cycles":8932608,"thread_start_us":163796,"threads_started":1,"wal-append.queue_time_us":205741}
I20260709 13:07:53.127549 16271 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:07:53.129146 15580 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:53.072423 16278 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
W20260709 13:07:53.079741 19473 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:07:53.132264 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.134258 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.134850 15579 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:53.134953 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.135689 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.136476 15579 raft_consensus.cc:2410] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:07:53.154945 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.143880 19452 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:53.145037 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:53.162993 15571 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.163549 15651 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:53.145452 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.145931 19340 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.147233 15648 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:53.167253 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.072011 19511 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.149112 19423 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.174796 19340 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.175489 19423 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.175748 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 755) took 1016 ms. Trace:
I20260709 13:07:53.176100 15575 rpcz_store.cc:276] 0709 13:07:52.159242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.202862 (+ 43620us) service_pool.cc:224] Handling call
0709 13:07:52.203236 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.422782 (+219546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.175516 (+752734us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400292a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:53.175670 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471131520}
I20260709 13:07:53.176903 19340 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.177429 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.149907 19416 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.150198 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.150489 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:53.151083 15577 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:53.152475 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:53.138134 19346 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.156509 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.184576 15653 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.063098 19317 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:53.157636 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 81724.8us
I20260709 13:07:53.161798 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.198637 15574 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:53.146714 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.200443 19288 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:53.200779 16277 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:53.202224 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.073293 19165 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:53.204106 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.166149 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.080700 19510 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.149019 15543 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:53.206584 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57647.5us
I20260709 13:07:53.207890 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.069679 19563 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.170169 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.173424 19293 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.211199 19293 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.163056 19372 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.214408 19372 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.215430 19375 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:53.217057 19372 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.174104 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.217577 19017 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:53.218055 15655 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:53.218127 19017 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.219389 19293 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:53.220425 19017 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:53.169343 19414 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.169210 19389 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.178016 15575 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:53.163856 19473 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.221457 19389 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.223014 19473 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:53.195151 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.223500 19389 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.223714 15575 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:53.224273 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0444312160000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 13:07:53.164515 19301 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.206651 15579 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:53.225505 19301 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.209843 19554 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:53.227211 15575 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:53.227336 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.228055 16272 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.220353 16271 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:53.199607 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.072993 19333 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:53.027567 18691 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.227605 15575 pending_rounds.cc:85] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 6
I20260709 13:07:53.240656 15575 pending_rounds.cc:107] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:53.240967 15575 raft_consensus.cc:2889] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.241014 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.169492 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.241758 15580 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:53.241998 16278 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.193379 19346 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.243345 15648 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:53.243716 15648 pending_rounds.cc:85] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 8
I20260709 13:07:53.243922 15648 pending_rounds.cc:107] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:53.243959 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.244222 15648 raft_consensus.cc:2889] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:53.256935 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:53.261461 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61971.7us
I20260709 13:07:53.238363 19359 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.265350 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.227774 19301 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.238858 19333 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:53.246055 19554 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:53.275553 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:53.275907 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.246290 19473 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.282528 15647 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:53.282562 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.278204 15646 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:53.281847 15573 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:53.256345 19017 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.242503 19510 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:53.286743 19483 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:53.288074 15655 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:53.240032 19422 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:07:53.289139 19560 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:07:53.327649 19510 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.290562 18691 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.269567 19359 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.290568 19333 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.302254 19406 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:53.303082 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.303828 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.306716 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.307475 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.311761 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.348057 15572 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:07:53.313753 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:53.349661 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:53.316524 19554 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.319402 15576 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.320143 19456 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.367906 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.286298 19346 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.283447 19553 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:53.257334 19492 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:53.386435 19416 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.359064 19462 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.387262 19373 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.387537 19462 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.389628 19462 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.363974 16275 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:53.390725 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.391382 19480 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.391790 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.374337 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:53.375787 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.375845 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.397342 16277 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 5: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:53.398101 19356 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:53.398726 19356 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.400239 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 745) took 1247 ms. Trace:
I20260709 13:07:53.400645 15577 rpcz_store.cc:276] 0709 13:07:52.152743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.152900 (+   157us) service_pool.cc:224] Handling call
0709 13:07:53.400073 (+1247173us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54003f8ed4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:53.400167 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215985536}
I20260709 13:07:53.400990 19356 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.405460 19356 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.406505 19356 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:53.406836 19356 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:53.407852 19356 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.408926 19356 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.411437 19359 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:53.414170 19333 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:53.416204 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45500.9us
I20260709 13:07:53.377452 19456 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.379469 19375 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.382122 19372 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.381880 19317 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.382694 19553 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.383414 18691 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.366565 19017 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.385532 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.436513 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.437013 16271 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.437183 15728 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.419529 16278 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:53.421957 15653 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:53.428030 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.430446 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:53.438692 15721 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.432497 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.441226 19422 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:53.441481 15726 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:53.441802 19422 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.442458 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.443608 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.443898 19422 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.442473 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.459599 15724 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:53.446439 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:53.382149 19149 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.464270 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:53.435344 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 159197us
I20260709 13:07:53.391796 19480 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:53.463579 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:53.467437 15720 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:53.471302 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:53.465700 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.469411 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.434703 19372 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:53.518416 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.477089 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.436524 18691 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.525014 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55685.3us
I20260709 13:07:53.544363 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.465061 19340 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.565673 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:53.565922 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:53.566586 15653 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:53.566830 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101245us
I20260709 13:07:53.567916 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:53.567566 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.571472 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:53.564530 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.565673 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.577088 15724 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.486246 19196 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:53.527664 19372 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.438992 19375 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.590431 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.600692 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.602560 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.561746 19414 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.467711 19017 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.539610 18691 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.473196 19351 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
W20260709 13:07:53.584515 19572 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:53.565635 19340 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:53.641460 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.585289 19165 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:53.578366 19456 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.644542 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.609200 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:53.578653 19408 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.652679 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:53.658211 15573 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:53.656317 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 88830.2us
I20260709 13:07:53.601356 19483 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.599045 19346 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:53.665203 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:53.666071 16278 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.607210 19288 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.605922 19492 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.600571 19560 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:53.684720 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:53.606930 19276 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.680999 15721 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:53.646109 19340 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:53.654625 19165 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.608011 19308 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:53.704634 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:53.771101 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 205256us
W20260709 13:07:53.775669 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 71186.2us
I20260709 13:07:53.776798 16278 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:53.690322 19196 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:53.787346 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:53.775949 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:53.713840 19165 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:53.779476 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:53.771916 19569 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:53.797494 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:53.776060 19373 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.771330 19492 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:53.807767 16278 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:53.789928 19578 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 13:07:53.779912 19462 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.780784 19554 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.773662 19210 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:53.846199 19408 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:53.937357 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:53.846611 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:53.847647 19576 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:07:53.848022 19574 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:07:53.848829 19580 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:07:53.849830 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.854678 19466 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:53.772831 19483 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:53.863324 15728 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:53.864228 15646 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:53.867046 16271 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:07:53.862498 15724 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:53.988185 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:53.988932 15724 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:53.871376 19017 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:53.804112 19570 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:53.874920 19375 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.686586 19480 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:53.881781 19485 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:53.960605 19553 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:53.883105 19378 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:53.883189 19373 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:53.885020 19459 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.053100 19459 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.844623 19317 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:53.811254 19356 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:54.056715 19356 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:53.907301 19510 consensus_meta.cc:287] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.003s
I20260709 13:07:53.910964 19301 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.920506 16269 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:07:53.924803 15573 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:07:53.926240 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 128794us
I20260709 13:07:54.064046 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:53.936195 16236 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.543s (SENT)
I20260709 13:07:53.929594 19456 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.994179 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:53.997637 15650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.016s
I20260709 13:07:53.810240 19196 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:53.958702 19554 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:07:54.066888 15650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.005s	sys 0.016s
I20260709 13:07:54.066896 15728 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:54.011554 16278 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:53.991631 19466 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:54.023379 19149 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:07:54.015013 19351 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:54.060312 19586 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:07:54.032856 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.034106 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.038257 18691 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.041179 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.042500 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:54.045928 19571 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.678s	user 0.000s	sys 0.011s
I20260709 13:07:54.049305 19511 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.052143 19340 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.061467 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:54.065232 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.071463 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.026695 19463 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.074910 16276 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:54.079062 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.080375 15720 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:07:54.079093 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 992) took 1084 ms. Trace:
I20260709 13:07:54.058990 19480 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.072952 19351 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:54.070201 19456 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.085462 19356 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:54.066663 19276 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:07:54.067152 19378 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.082872 19511 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:54.120955 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.088342 19554 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.090341 19196 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.091096 15647 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.058423 19510 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.074795 19017 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.091914 15652 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:54.098839 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 162668us
I20260709 13:07:54.102372 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.006899 19485 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.120857 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:54.135066 15653 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:54.087575 16270 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.096679 16273 rpcz_store.cc:276] 0709 13:07:52.996180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.146884 (+150704us) service_pool.cc:224] Handling call
0709 13:07:53.147176 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.182703 (+ 35527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.182737 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.228136 (+ 45399us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.332837 (+104701us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:53.332894 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.332988 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.078903 (+745915us) raft_consensus.cc:1685] finished
0709 13:07:54.078919 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.079039 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41628,"raft.queue_time_us":35620,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":44380,"thread_start_us":85513,"threads_started":1,"wal-append.queue_time_us":280928}
I20260709 13:07:54.130290 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:54.131464 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:54.070101 19301 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.137719 16278 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:54.142571 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:54.099711 19408 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:54.144315 15618 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:54.145748 16236 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.614s (SENT)
I20260709 13:07:54.154371 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:54.100170 19280 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.147339 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:54.147629 19351 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:54.148388 19581 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 13:07:54.149137 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:54.150291 19594 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:54.150210 19317 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.151207 19577 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:07:54.173132 19317 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.142496 19414 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:54.157456 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 126404us
I20260709 13:07:54.159904 15651 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.161228 15652 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:54.170568 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.139863 19463 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:54.180516 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 140443us
I20260709 13:07:54.132467 19017 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.072269 19492 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.181067 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.171298 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.193672 15653 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:07:54.182411 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.182365 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.103431 19456 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.207124 15653 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:07:54.184092 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.177039 18691 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.152902 19408 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:54.226166 19408 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:54.226513 19511 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.227602 19511 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.230536 19351 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.231405 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.232043 15729 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:54.189082 19560 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.233968 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.234622 15651 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:54.235457 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.190591 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:54.236402 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45874.1us
I20260709 13:07:54.236527 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.237509 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.238255 15650 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:54.085896 19373 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.242431 19588 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.207677 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 993) took 1211 ms. Trace:
I20260709 13:07:54.243243 16269 rpcz_store.cc:276] 0709 13:07:52.996490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.134728 (+138238us) service_pool.cc:224] Handling call
0709 13:07:54.207466 (+1072738us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400697654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:54.207608 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692582784}
I20260709 13:07:54.202384 16275 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:54.244172 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 98429.5us
I20260709 13:07:54.177227 19356 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.153913 19595 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:54.176047 19194 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:54.223652 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1241) took 1220 ms. Trace:
I20260709 13:07:54.223881 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.248545 16276 rpcz_store.cc:276] 0709 13:07:53.003430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.155168 (+151738us) service_pool.cc:224] Handling call
0709 13:07:53.155424 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.095802 (+940378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.223420 (+127618us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54006306d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:54.223591 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109354368}
I20260709 13:07:54.225019 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.249697 15726 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.249840 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.250496 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.250957 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.251077 15729 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:54.200567 19473 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.169847 19375 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:54.081971 19165 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.242487 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.258546 15723 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:54.191665 19017 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.252509 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.193715 19593 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.268456 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.252584 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.203114 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1216) took 2212 ms. Trace:
I20260709 13:07:54.257769 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:54.259829 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:54.199388 19378 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:54.264209 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.265913 15572 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:54.182638 19414 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.267393 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.267325 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.263850 19042 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:54.281627 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.281404 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.269559 15729 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:54.287195 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.255191 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.199388 19317 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.272094 15727 raft_consensus.cc:2410] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:07:54.292405 19423 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:54.293299 19423 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.293646 19423 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:54.294081 19598 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.294430 19408 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.284953 19588 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.296500 19408 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.275712 15720 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:54.267925 19375 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.269129 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:54.301097 19165 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:54.301774 19575 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:54.190649 19466 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.302943 19575 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.291570 19042 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.282327 15725 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.302783 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.310699 15723 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.285794 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.312109 15653 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:54.285662 15574 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:54.303957 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46275.5us
I20260709 13:07:54.304672 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.313200 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.313421 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.271514 15578 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:54.287737 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:54.315927 15729 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.248313 19356 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:54.314584 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.303954 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:54.309408 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:54.320566 15573 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:54.251958 19473 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:54.281852 18691 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.256757 19560 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.268748 19593 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:54.264464 19600 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.320652 15720 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4.
I20260709 13:07:54.306854 19408 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.269744 16274 rpcz_store.cc:276] 0709 13:07:51.991165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.991323 (+   158us) service_pool.cc:224] Handling call
0709 13:07:52.115530 (+124207us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:52.776671 (+661141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.776943 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:52.785840 (+  8897us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.989993 (+204153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.990074 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.990142 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.990225 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.202931 (+1212706us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54004c2050. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:54.203042 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1608,"prepare.queue_time_us":7802,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":10231,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":3809,"spinlock_wait_cycles":1525433472,"thread_start_us":178473,"threads_started":1,"wal-append.queue_time_us":362457,"wal-append.run_cpu_time_us":1044,"wal-append.run_wall_time_us":1004866}
W20260709 13:07:54.355652 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.329638 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:54.275241 19414 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.310221 19595 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.326812 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.369899 15721 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:54.369613 18691 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:54.324440 19356 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.374125 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:54.328341 19378 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.307061 19464 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.308491 19575 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:54.323105 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.362951 15571 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:54.365453 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:07:54.410476 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.341552 15720 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:54.378458 18691 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.411865 18691 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:54.393676 16272 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:54.393733 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:54.412878 16275 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:07:54.414237 16273 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:54.371297 19557 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.405102 15723 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:54.339715 19600 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.410404 15653 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.340968 15651 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:54.401321 15725 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:54.369542 19595 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.426968 15726 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:54.429786 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.396512 19408 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.396162 19378 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:54.424798 18691 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.445318 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.445966 18691 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.354938 19560 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.446779 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.414047 19165 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.449678 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.450181 15726 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:54.450388 15722 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:54.443161 19595 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.428336 19605 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.440831 19600 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.449313 19378 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.469779 15653 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:54.447708 19340 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.471534 15653 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:54.471186 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:54.471421 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 200756us
I20260709 13:07:54.478644 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:54.479445 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 149856us
W20260709 13:07:54.482702 15577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.009s
W20260709 13:07:54.483320 15577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.009s
I20260709 13:07:54.453665 19194 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:54.469224 19372 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.865s	user 0.010s	sys 0.002s
I20260709 13:07:54.489807 19598 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.492851 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.415962 19423 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.468541 19605 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.500082 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.517001 15723 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:54.519098 15652 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.516992 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:54.521847 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 198250us
I20260709 13:07:54.525378 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:54.438891 19557 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.456979 19165 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.510174 19462 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:54.543988 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.544751 15726 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 5: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:54.449692 19473 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.518865 19605 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.573550 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:54.518805 19340 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:07:54.533795 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 168169us
I20260709 13:07:54.516600 19372 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.448942 19593 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.577319 15648 raft_consensus.cc:2376] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12. Re-sending same reply.
I20260709 13:07:54.590159 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:54.593438 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.590835 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.594259 15723 raft_consensus.cc:2368] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:07:54.536268 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:54.617990 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 82156.7us
I20260709 13:07:54.619906 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:54.617349 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.582101 19553 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.624456 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.622669 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2096) took 1182 ms. Trace:
I20260709 13:07:54.585783 19473 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.621073 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:54.626595 15729 rpcz_store.cc:276] 0709 13:07:53.440365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.316672 (+876307us) service_pool.cc:224] Handling call
0709 13:07:54.316928 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.317122 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:54.445850 (+128728us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.622337 (+176487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.622387 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:54.622431 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.622497 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.622617 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":288995,"threads_started":2}
I20260709 13:07:54.584004 19612 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.648442 15649 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.607452 19598 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:54.664611 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.624550 19361 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.621423 19042 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.624737 19593 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.666896 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:54.590343 19617 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:54.586316 19620 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
W20260709 13:07:54.755544 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.755863 15729 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:54.441594 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:54.703449 19575 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.699975 15648 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:54.662135 19602 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:54.681044 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:54.705214 19592 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:54.719342 19462 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:07:54.783989 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103006us
I20260709 13:07:54.724625 19553 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:54.731797 19607 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 13:07:54.736352 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1868) took 1291 ms. Trace:
I20260709 13:07:54.746631 19301 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.754317 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.624373 19483 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:54.696069 19613 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:07:54.770989 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 182538us
W20260709 13:07:54.809762 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.772181 15729 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:54.662966 19625 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.780812 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.775172 19631 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:54.774514 19560 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:54.787730 15576 rpcz_store.cc:276] 0709 13:07:53.444536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.447104 (+  2568us) service_pool.cc:224] Handling call
0709 13:07:54.003263 (+556159us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9ecfc0 00007f2d9a9d7929 00007f2d9a9d73d2 00007f2d93f4ebd4
0709 13:07:54.003609 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.152723 (+149114us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:54.173083 (+ 20360us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.562561 (+389478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.576689 (+ 14128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:54.576759 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.713078 (+136319us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:54.735982 (+ 22904us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000c7bd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:54.736052 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.736253 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25610,"prepare.queue_time_us":21256,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":31,"raft.queue_time_us":72392,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4215,"spinlock_wait_cycles":359956864,"thread_start_us":358555,"threads_started":2,"wal-append.queue_time_us":342163}
I20260709 13:07:54.772312 19614 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.798839 19408 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:54.799192 19608 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:07:54.768464 19042 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:07:54.800510 19017 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.007s
I20260709 13:07:54.807504 19483 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:54.650216 19194 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.789541 19373 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.808386 15725 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.664186 19612 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.787385 19480 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.003s
I20260709 13:07:54.786955 19620 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.921079 16270 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:54.862017 19456 consensus_meta.cc:287] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:07:54.807943 19592 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:54.790913 19462 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.843127 19625 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:54.937451 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.845042 19631 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:54.846153 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.811152 19609 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.168s	user 0.005s	sys 0.004s
I20260709 13:07:54.796746 19553 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.803191 19372 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.859036 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.863914 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:54.864485 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.866326 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.970780 15729 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:54.971045 16278 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:54.918087 19612 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.866889 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.805778 19622 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.900055 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1878) took 1054 ms. Trace:
W20260709 13:07:54.853981 19351 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.002s
W20260709 13:07:54.856007 19616 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:07:54.700662 19361 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:54.862242 19610 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:07:54.855211 19464 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.865255 19483 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.844314 19623 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:54.939649 15720 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:54.857628 19165 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:54.864259 19459 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.871542 19557 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:54.863469 19510 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.971602 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:55.083069 15729 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.866580 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.084197 15721 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:54.969728 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 349910us
I20260709 13:07:54.975060 15723 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:55.085125 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:54.854773 19017 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:54.980069 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 125475us
W20260709 13:07:55.090546 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.856068 19356 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:54.859792 19632 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
W20260709 13:07:54.986630 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 231570us
I20260709 13:07:54.920537 19620 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:54.980219 15575 rpcz_store.cc:276] 0709 13:07:53.845574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.929383 (+ 83809us) service_pool.cc:224] Handling call
0709 13:07:53.929799 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.938229 (+  8430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.938285 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.963785 (+ 25500us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.330335 (+366550us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:54.330370 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.330431 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.899750 (+569319us) raft_consensus.cc:1685] finished
0709 13:07:54.899793 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.899983 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3686,"thread_start_us":307747,"threads_started":1,"wal-append.queue_time_us":448657}
W20260709 13:07:54.990556 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.012s
I20260709 13:07:54.990804 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:54.937884 19554 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:55.120131 19356 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:54.860949 19614 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.120724 19356 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:55.121645 19645 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:54.975132 19408 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:54.980159 19622 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.940907 19456 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:54.984974 19373 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.989064 19480 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.132372 19480 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:55.072301 19464 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:55.110924 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.105008 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:07:55.115447 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.117859 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.012s	sys 0.012s
I20260709 13:07:55.107525 19459 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:55.145323 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:54.936666 19598 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.119346 19624 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.229s
I20260709 13:07:55.125578 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.127302 15728 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:55.151635 15654 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:55.112897 19616 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:55.140965 15723 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:55.142328 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.143751 19464 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:55.150899 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:55.127069 19625 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.152693 15544 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:55.199204 15724 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:55.198515 19643 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:55.155309 19554 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:55.209756 19643 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:55.210000 19554 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:55.211622 19638 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:55.212368 19554 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:55.210988 19643 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.133925 19622 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.267073 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:55.272083 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:55.274412 15723 raft_consensus.cc:2410] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:55.274340 15725 raft_consensus.cc:2376] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 4. Re-sending same reply.
W20260709 13:07:55.275091 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.205724 19600 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.003s
I20260709 13:07:55.282358 19210 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:55.122221 19645 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.286082 19210 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:55.282263 19557 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.287602 19557 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.288234 19210 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:55.268105 19511 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.002s
I20260709 13:07:55.285092 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.204728 19625 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.299871 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:55.265983 19611 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 13:07:55.341828 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 189623us
I20260709 13:07:55.076282 19623 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.392902 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.393582 15723 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:55.394415 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.145129 19373 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.395340 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.398005 19408 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.406280 19645 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.406991 19646 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.404618 19557 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.404722 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.410189 15725 raft_consensus.cc:2410] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:55.410683 19641 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:07:55.160912 19459 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.395829 19610 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:55.418972 15723 raft_consensus.cc:2410] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:55.423256 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:55.424717 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 782) took 2005 ms. Trace:
I20260709 13:07:55.425585 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:55.378384 19625 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.427271 15648 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:55.425141 15577 rpcz_store.cc:276] 0709 13:07:53.419015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.419532 (+   517us) service_pool.cc:224] Handling call
0709 13:07:53.419954 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.640450 (+220496us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:53.679523 (+ 39073us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.483944 (+804421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.484546 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.494387 (+  9841us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.494430 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.870892 (+376462us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540038efd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:54.870960 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.411778 (+540818us) raft_consensus.cc:1685] finished
0709 13:07:55.424490 (+ 12712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.424645 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4060,"prepare.queue_time_us":150005,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":42,"raft.queue_time_us":106200,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":34218,"spinlock_wait_cycles":506178688,"thread_start_us":701796,"threads_started":1,"wal-append.queue_time_us":837562}
I20260709 13:07:55.433508 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:55.434322 15655 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:55.402704 19643 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.130709 19592 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.425904 19351 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.338836 19600 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:55.402868 19634 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:55.429777 19656 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.425004 19646 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:55.433827 19614 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.483431 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.464457 19624 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:55.496711 15580 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 10. Ops: []
I20260709 13:07:55.509608 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.511524 15577 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 4: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:55.289391 19620 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.482474 19631 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.488579 19361 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:55.514338 15727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.003s	sys 0.025s
I20260709 13:07:55.518549 19646 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.489382 19642 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.521690 15578 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:07:55.522008 15727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.003s	sys 0.025s
I20260709 13:07:55.522856 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2094) took 2083 ms. Trace:
I20260709 13:07:55.492856 19632 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:55.485484 19351 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.555946 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:55.546520 19644 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.559247 19644 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.566593 19619 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.917s	user 0.011s	sys 0.017s
I20260709 13:07:55.566808 15725 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:55.567955 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.571056 19149 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:55.571702 19149 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.572338 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2423) took 1547 ms (client timeout 1730 ms). Trace:
W20260709 13:07:55.572765 15722 rpcz_store.cc:269] 0709 13:07:54.024722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.033818 (+  9096us) service_pool.cc:224] Handling call
0709 13:07:55.572187 (+1538369us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54001fc554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:55.572283 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857128192}
I20260709 13:07:55.575109 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.575955 15721 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:55.576129 19308 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:55.577087 15721 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:55.576820 19308 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.568560 15725 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:07:55.569952 19593 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:55.579623 19593 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.580973 19612 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.000s
I20260709 13:07:55.581413 19612 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.582110 19632 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.583443 19647 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:07:55.585428 19640 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:55.588301 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 727) took 1411 ms. Trace:
I20260709 13:07:55.581729 19593 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:55.587481 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.649058 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1007) took 2187 ms. Trace:
I20260709 13:07:55.573872 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:55.523293 15727 rpcz_store.cc:276] 0709 13:07:53.439808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.293056 (+853248us) service_pool.cc:224] Handling call
0709 13:07:54.293372 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.293581 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:54.474342 (+180761us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.873145 (+398803us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800277720. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287
0709 13:07:54.873492 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.522457 (+648965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.522505 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.522552 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.522632 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.522789 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3888,"prepare.queue_time_us":332357,"prepare.run_cpu_time_us":2805,"prepare.run_wall_time_us":28475,"raft.queue_time_us":226602,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":35704,"spinlock_wait_cycles":5089024,"thread_start_us":968701,"threads_started":4,"wal-append.queue_time_us":330145}
I20260709 13:07:55.649952 15722 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.649433 16271 rpcz_store.cc:276] 0709 13:07:53.461759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.059796 (+598037us) service_pool.cc:224] Handling call
0709 13:07:54.076060 (+ 16264us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:54.082619 (+  6559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.082648 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:54.132095 (+ 49447us) log.cc:844] Serialized 78 byte log entry
0709 13:07:54.381862 (+249767us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:54.412865 (+ 31003us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.413254 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.413563 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.413747 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.413837 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.707891 (+294054us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18004af6e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:55.559203 (+851312us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b18004af6e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926557 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:55.648824 (+ 89621us) raft_consensus.cc:1685] finished
0709 13:07:55.648846 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.648999 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54056,"prepare.queue_time_us":620996,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":120,"raft.queue_time_us":27743,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":21932,"spinlock_wait_cycles":42098176,"thread_start_us":161524,"threads_started":1,"wal-append.queue_time_us":356150}
I20260709 13:07:55.624341 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:55.646880 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 267114us
I20260709 13:07:55.653020 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:55.663739 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.664821 15574 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:55.666004 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:55.513332 19624 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.684751 19624 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.685487 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:55.686190 16273 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:55.686303 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:55.687142 19653 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:07:55.688215 19605 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.092s	user 0.009s	sys 0.001s
I20260709 13:07:55.648629 15647 rpcz_store.cc:276] 0709 13:07:54.177121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.296379 (+119258us) service_pool.cc:224] Handling call
0709 13:07:54.296733 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.319972 (+ 23239us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:54.574788 (+254816us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.852263 (+277475us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b48000ce358. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:54.945486 (+ 93223us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.945670 (+   184us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.987263 (+ 41593us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.987671 (+   408us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:54.987707 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.987783 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.286991 (+299208us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b180016bf40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:07:55.588021 (+301030us) raft_consensus.cc:1685] finished
0709 13:07:55.588051 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.588227 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34774,"prepare.queue_time_us":140808,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":5500,"raft.queue_time_us":32451,"raft.run_cpu_time_us":3991,"raft.run_wall_time_us":576418,"spinlock_wait_cycles":22194304,"thread_start_us":470586,"threads_started":2,"wal-append.queue_time_us":387817}
I20260709 13:07:55.688741 19301 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:55.688616 19605 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:55.665580 19149 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:55.696914 15646 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:55.696792 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 275273us
I20260709 13:07:55.697897 15722 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:55.700273 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.488397 19656 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.704945 15543 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:55.561877 19644 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.625313 19466 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.692415 19473 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.000s
I20260709 13:07:55.686210 19459 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.737789 15721 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:55.708530 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.744894 15722 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 4.
I20260709 13:07:55.754506 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:55.709846 19560 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.546937 19642 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:55.667412 19634 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:07:55.727389 19557 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:07:55.827576 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.851683 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 198708us
W20260709 13:07:55.852348 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.813572 15729 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.705s	user 0.006s	sys 0.001s
I20260709 13:07:55.846765 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:55.760711 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 833527us
W20260709 13:07:55.846314 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 84940.3us
I20260709 13:07:55.854717 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.855305 15723 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:07:55.845748 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.856456 16271 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:55.824203 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.853192 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:07:55.857247 15725 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
W20260709 13:07:55.858620 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 153766us
I20260709 13:07:55.860610 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:55.863529 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:55.755558 19210 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:55.869844 15729 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:07:55.870267 16236 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.684s (SENT)
I20260709 13:07:55.885409 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:55.738118 19554 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:07:55.891058 19652 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.891297 19280 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:55.894088 19485 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.894668 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.895306 16274 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.896311 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:55.897083 16276 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:55.897993 19623 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.898268 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.898612 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:55.898981 16276 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.899226 19612 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.899425 16271 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:55.900269 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.900862 16271 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.902652 19462 consensus_meta.cc:287] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.951s	user 0.010s	sys 0.000s
I20260709 13:07:55.902510 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:55.903137 19462 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.904333 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.905059 16277 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:55.907270 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.874996 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:55.755249 19466 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:55.914912 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51531.7us
W20260709 13:07:55.926321 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51401us
I20260709 13:07:55.929850 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:55.873168 19210 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.934743 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:55.852784 19560 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.905278 19462 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:55.942601 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72362.4us
I20260709 13:07:55.943305 19210 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:55.943953 19459 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:07:55.991689 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:55.956161 19351 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.955615 19466 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.911082 19308 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:55.915287 19593 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.948661 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:55.977671 16276 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:55.891106 19480 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:55.936892 19554 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.963529 19649 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:55.981281 19667 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.981997 19622 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
W20260709 13:07:56.055099 19595 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.578s	user 0.006s	sys 0.007s
I20260709 13:07:56.055025 19622 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.055594 19595 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.057483 19622 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:55.979874 19605 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:55.982182 19661 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.982411 19655 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.985405 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:55.957975 19623 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.988703 19210 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:56.065183 19378 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.579s	user 0.007s	sys 0.006s
I20260709 13:07:56.065271 19623 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.997969 16271 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:56.058219 19667 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:56.030057 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 81441us
I20260709 13:07:56.047170 19375 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.096640 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 728) took 1919 ms. Trace:
I20260709 13:07:56.119940 15651 rpcz_store.cc:276] 0709 13:07:54.177358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.301516 (+124158us) service_pool.cc:224] Handling call
0709 13:07:54.301912 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.434889 (+132977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.096338 (+1661449us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400156654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.096576 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89208192}
W20260709 13:07:56.095979 15646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 733) took 1237 ms (client timeout 1551 ms). Trace:
I20260709 13:07:56.121060 16274 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:56.102794 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.085712 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2090) took 2652 ms. Trace:
I20260709 13:07:56.122797 16277 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:56.054064 19645 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:56.054282 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 125545us
I20260709 13:07:56.057761 19595 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:55.992614 19665 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:56.068641 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:56.125803 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:56.127218 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:56.052105 19643 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
W20260709 13:07:56.097536 19483 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.021s	user 0.007s	sys 0.003s
I20260709 13:07:56.058413 19649 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.142454 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:56.197675 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55308.9us
W20260709 13:07:56.121402 15646 rpcz_store.cc:269] 0709 13:07:54.858569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.858706 (+   137us) service_pool.cc:224] Handling call
0709 13:07:56.095689 (+1236983us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540015a4d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:56.095874 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669703424}
I20260709 13:07:56.123114 15724 rpcz_store.cc:276] 0709 13:07:53.432916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.996571 (+563655us) service_pool.cc:224] Handling call
0709 13:07:54.010426 (+ 13855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.204982 (+1194556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.085419 (+880437us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003becd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.085645 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733374336}
I20260709 13:07:56.141907 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:56.074903 19670 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:07:56.195964 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 70260.1us
I20260709 13:07:56.156911 16276 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.011307 19308 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.075511 19561 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.075978 19480 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.014655 19554 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:56.066864 19210 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.065939 19623 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.102356 19466 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.207975 15544 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.082743 19632 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.066681 19656 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.067924 19560 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.085355 19672 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:56.077781 19642 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:07:56.221448 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.250044 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.250447 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.155457 19414 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:56.065837 19378 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.155153 19459 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.146618 19612 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:56.203532 19557 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:56.225958 19553 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.244s	user 0.009s	sys 0.003s
I20260709 13:07:56.015517 19593 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.093823 15475 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.206593 19598 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.236747 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.240810 16276 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:07:56.218879 19595 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.234076 16278 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:56.246999 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.222230 19554 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.221850 19667 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.196630 19588 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:56.227813 19680 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.221693 19561 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.267387 19612 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.271497 19459 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.305891 19473 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.311163 19625 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.868s	user 0.013s	sys 0.000s
I20260709 13:07:56.273509 19553 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.310231 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.257642 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.249676 19210 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.243098 19466 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.243042 19655 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.219086 19308 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:56.268426 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.270624 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.205628 19483 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.303210 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:56.310408 16276 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 13:07:56.313364 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.328894 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.369917 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:56.375008 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 138336us
I20260709 13:07:56.409765 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2388) took 2275 ms. Trace:
W20260709 13:07:56.378413 15474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 252) took 35040 ms (client timeout 15000 ms). Trace:
I20260709 13:07:56.378944 19680 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.435263 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1889) took 1320 ms. Trace:
I20260709 13:07:56.498561 15724 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:07:56.378600 19678 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:07:56.427848 15475 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:56.499881 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.498368 15650 rpcz_store.cc:276] 0709 13:07:54.133902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.238960 (+105058us) service_pool.cc:224] Handling call
0709 13:07:54.239247 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.276195 (+ 36948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.276243 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.276967 (+   724us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.392965 (+115998us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:54.393017 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.864702 (+471685us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b48000ce358. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9a93caa1 00007f2d9a933b37 00007f2d9a9339ca 00007f2d9aa2b26f 00007f2d9aa2af37 00007f2d9aa3f55c 00007f2d9aa3f508 00007f2d9aa3f488 00007f2d9aa3f443 00007f2d9aa3e6ec 00007f2d99968a96
0709 13:07:56.409390 (+1544688us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.409455 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.409507 (+    52us) raft_consensus.cc:1685] finished
0709 13:07:56.409524 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.409691 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31425,"raft.run_cpu_time_us":2185,"raft.run_wall_time_us":555604,"spinlock_wait_cycles":98002688,"thread_start_us":115466,"threads_started":1,"wal-append.queue_time_us":178987,"wal-append.run_cpu_time_us":2908,"wal-append.run_wall_time_us":1406602}
W20260709 13:07:56.539891 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 236813us
I20260709 13:07:56.543373 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:56.545704 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 346067us
I20260709 13:07:56.501272 16276 pending_rounds.cc:85] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 8
I20260709 13:07:56.548796 16276 pending_rounds.cc:107] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:07:56.549278 16276 raft_consensus.cc:2889] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.389940 19598 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:56.380656 19561 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.250864 19672 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.498888 15571 rpcz_store.cc:276] 0709 13:07:55.114987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.115092 (+   105us) service_pool.cc:224] Handling call
0709 13:07:55.115407 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:55.127063 (+ 11656us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:55.542752 (+415689us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.912974 (+370222us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:56.407941 (+494967us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b2c000014c8. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:07:56.408629 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 13:07:56.408832 (+   203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:56.408894 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.408988 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.412622 (+  3634us) raft_consensus.cc:1685] finished
0709 13:07:56.434957 (+ 22335us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.435175 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6167,"prepare.queue_time_us":392402,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":7827,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9296,"spinlock_wait_cycles":7200000,"thread_start_us":616656,"threads_started":2,"wal-append.queue_time_us":347339}
W20260709 13:07:56.502152 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.428467 19210 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:56.523953 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.553412 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.456073 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 145961us
I20260709 13:07:56.386294 19378 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.378670 19588 consensus_queue.cc:1243] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:56.263950 19414 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.406108 19017 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.562350 15729 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:56.539381 19406 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.548446 19667 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:56.547477 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:56.438257 19375 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.540122 19632 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.412429 19553 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.387403 19649 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.389776 19612 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.429320 19634 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.543375 19593 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.539714 19622 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.406428 19473 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:56.580909 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 439059us
I20260709 13:07:56.648169 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.648377 16278 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:56.461741 19620 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.496791 19645 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:56.405827 19459 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.487270 19557 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:56.539877 19684 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.582938 15475 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.406867 19625 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.628979 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2104) took 2264 ms. Trace:
W20260709 13:07:56.635933 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.657733 15720 rpcz_store.cc:276] 0709 13:07:54.365022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.498936 (+133914us) service_pool.cc:224] Handling call
0709 13:07:54.522636 (+ 23700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.060464 (+537828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.628730 (+1568266us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400399754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.628918 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958323968}
I20260709 13:07:56.635789 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:56.635948 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 88574.9us
W20260709 13:07:56.647346 19679 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:07:56.556753 19361 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.369872 19595 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.624483 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1888) took 1509 ms. Trace:
I20260709 13:07:56.638475 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.662604 15579 rpcz_store.cc:276] 0709 13:07:55.114691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.114815 (+   124us) service_pool.cc:224] Handling call
0709 13:07:55.130109 (+ 15294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.871856 (+741747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.871887 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.871927 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.871960 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.624189 (+752229us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400293e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.624251 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.624412 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705429760}
I20260709 13:07:56.639825 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.640244 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.664783 15723 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:56.666216 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1257) took 1097 ms. Trace:
I20260709 13:07:56.666596 16269 rpcz_store.cc:276] 0709 13:07:55.568489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.609856 (+ 41367us) service_pool.cc:224] Handling call
0709 13:07:55.663479 (+ 53623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.663823 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.663851 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.697997 (+ 34146us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.942392 (+244395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.942440 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.942505 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.666006 (+723501us) raft_consensus.cc:1685] finished
0709 13:07:56.666050 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.666164 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24055,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":183716,"threads_started":1,"wal-append.queue_time_us":486315}
I20260709 13:07:56.636047 19375 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.643134 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.554154 19685 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:56.620782 19648 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 1.341s	user 0.009s	sys 0.009s
W20260709 13:07:56.673496 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.638499 19462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.020s	sys 0.043s
I20260709 13:07:56.572805 19661 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:56.582553 19210 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.609338 19672 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.559651 19560 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:07:56.609170 19456 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.623097 19373 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:56.682693 19462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.044s
I20260709 13:07:56.692590 19661 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.718904 19560 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.719408 19560 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.721355 19560 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.641199 19683 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.607924 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.611275 19317 consensus_queue.cc:1059] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:56.659240 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:56.645058 19644 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:56.617614 19624 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:07:56.671541 15575 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:56.671650 15576 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:56.675186 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.730484 15720 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.676759 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2092) took 3243 ms. Trace:
I20260709 13:07:56.677182 19649 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:56.739122 19649 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.677636 19656 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:56.672909 19375 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.679236 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:56.742899 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63730.7us
W20260709 13:07:56.660799 19301 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.972s	user 0.010s	sys 0.002s
I20260709 13:07:56.681038 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.670382 19692 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:56.644330 19406 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.657711 19645 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:56.686800 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:56.755877 15579 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.674016 15475 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 1 to 4, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:56.651543 19622 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.698063 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.707147 19473 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.707312 19595 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.665690 19361 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.680416 19605 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.778753 19605 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.780016 19361 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.708420 19483 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.709291 19625 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.710508 19414 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.714002 19680 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.714493 19308 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:56.715674 19466 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:56.500046 15474 rpcz_store.cc:269] 0709 13:07:21.390380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.399592 (+  9212us) service_pool.cc:224] Handling call
0709 13:07:56.272689 (+34873097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:46.651269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:46.967312 (+316043us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:46.975641 (+  8329us) write_op.cc:435] Acquired schema lock
0709 13:07:46.978171 (+  2530us) tablet.cc:662] Decoding operations
0709 13:07:46.995977 (+ 17806us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:46.996087 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:46.996116 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:46.996976 (+   860us) tablet.cc:701] Row locks acquired
0709 13:07:46.997025 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:07:46.997215 (+   190us) write_op.cc:270] Start()
0709 13:07:46.997369 (+   154us) write_op.cc:276] Timestamp: P: 1783602466997146 usec, L: 0
0709 13:07:46.997389 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:47.176059 (+178670us) log.cc:844] Serialized 3915 byte log entry
0709 13:07:47.822077 (+646018us) op_driver.cc:464] REPLICATION: finished
0709 13:07:48.142887 (+320810us) write_op.cc:301] APPLY: starting
0709 13:07:48.151933 (+  9046us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:48.242907 (+ 90974us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:48.290124 (+ 47217us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:48.449065 (+158941us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:48.449432 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:07:48.449487 (+    55us) write_op.cc:312] APPLY: finished
0709 13:07:48.449918 (+   431us) log.cc:844] Serialized 71 byte log entry
0709 13:07:48.450164 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.450295 (+   131us) write_op.cc:454] Released schema lock
0709 13:07:48.450365 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:48.450835 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:48.450880 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2796397,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":236668,"apply.run_cpu_time_us":8738,"apply.run_wall_time_us":364701,"num_ops":9,"prepare.queue_time_us":725342,"prepare.run_cpu_time_us":99133,"prepare.run_wall_time_us":848108,"raft.queue_time_us":109045,"raft.run_cpu_time_us":3511,"raft.run_wall_time_us":185112,"replication_time_us":824497,"thread_start_us":805794,"threads_started":4,"wal-append.queue_time_us":379136,"wal-append.run_cpu_time_us":17048,"wal-append.run_wall_time_us":1851137}]]}
W20260709 13:07:56.726778 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 166217us
W20260709 13:07:56.690521 19276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.012s	sys 0.052s
I20260709 13:07:56.763615 19695 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:56.731659 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72504.7us
W20260709 13:07:56.732883 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.733597 19554 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.662009 19598 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.735131 19644 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.736209 19685 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:56.738184 19661 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:56.738323 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.731523 15728 rpcz_store.cc:276] 0709 13:07:53.433502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.125317 (+691815us) service_pool.cc:224] Handling call
0709 13:07:54.125714 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.151872 (+1026158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.676464 (+1524592us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400107554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:56.676687 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302900480}
I20260709 13:07:56.748122 15729 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:56.803334 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:56.748718 15720 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:56.761061 15723 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:56.758960 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:56.762451 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.770926 15579 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:56.807725 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.753386 19301 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:56.741111 19557 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.814970 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.641199 19632 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.837100 19651 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:56.837523 19632 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.789386 15475 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 5, term changed from 4 to 6, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to <none>, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:56.837554 19651 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:56.839124 15475 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 8, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:56.841023 19623 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.000s
W20260709 13:07:56.808544 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.840646 15475 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 5, leader changed from <none> to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 5 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:56.842351 15720 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:56.846064 19466 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:56.846809 19617 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.847680 19681 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.695s	user 0.001s	sys 0.000s
I20260709 13:07:56.847471 19617 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.850196 19605 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.850454 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.850612 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:56.851071 15722 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:56.851195 19649 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.827677 19625 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:56.809659 15619 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:56.851989 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.852531 19696 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.853015 19696 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.811671 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:56.791973 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 187615us
I20260709 13:07:56.853771 15576 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:56.812500 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50125.4us
I20260709 13:07:56.829664 19473 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.851357 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1268) took 1158 ms. Trace:
I20260709 13:07:56.834695 19644 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.808058 16272 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:56.858319 16273 rpcz_store.cc:276] 0709 13:07:55.692643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.693245 (+   602us) service_pool.cc:224] Handling call
0709 13:07:56.850472 (+1157227us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:56.851301 (+   829us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3771136}
I20260709 13:07:56.859045 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1267) took 1176 ms. Trace:
I20260709 13:07:56.859416 16272 rpcz_store.cc:276] 0709 13:07:55.683127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.689693 (+  6566us) service_pool.cc:224] Handling call
0709 13:07:56.758760 (+1069067us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:56.858992 (+100232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935040}
I20260709 13:07:56.814669 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.835206 19600 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.840523 19651 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.861104 19651 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.846634 19466 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.852665 15722 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:07:56.799495 19276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.013s	sys 0.053s
I20260709 13:07:56.747084 19656 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.855099 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.855329 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:56.869436 16278 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:56.853392 19696 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.814399 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:56.852705 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:56.875264 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:56.808789 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:56.856789 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50441.5us
I20260709 13:07:56.877564 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:56.857419 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.813546 19645 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.832486 19622 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.862360 15728 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:56.857512 15729 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:07:56.863034 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.817444 19308 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.809590 19456 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.853436 19423 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.867305 15543 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.872743 15720 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:07:56.845152 15475 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:56.868907 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.813273 19406 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.880276 15722 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:07:56.892895 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.893254 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84598.7us
I20260709 13:07:56.806929 19695 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.889355 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.894245 15723 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.908346 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.908704 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.886240 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:56.864634 19617 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:56.864225 19625 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:56.864794 19623 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.886487 19483 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:56.900812 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:56.916543 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.917245 15720 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:56.902632 16235 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.875195 19346 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.916503 15575 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:56.911010 15649 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.886296 19414 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:56.921974 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:56.927181 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.893690 19317 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:56.930894 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:56.932613 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:56.933339 15649 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.934706 19293 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:56.935089 19293 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.935406 19293 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:56.936990 19466 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.938253 19554 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:56.938673 19667 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:56.914017 19301 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:56.939119 19667 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.939471 19301 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:56.939563 19667 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:56.940421 19301 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:56.913453 19595 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:56.930568 19560 raft_consensus.cc:2764] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:07:56.942370 19625 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:56.911468 19683 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.914880 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.912177 19604 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:56.961282 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:56.961462 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:56.961539 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:56.887413 19473 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.902681 19356 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:56.885108 19629 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:56.890165 19685 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:56.926220 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.926720 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.927894 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:56.930342 19563 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:56.946674 15723 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:07:56.913174 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:56.960078 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:56.916066 19631 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:56.905339 15475 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 4, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:56.962644 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:56.925521 19346 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.930164 19644 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.964970 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:56.942440 19595 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:56.967041 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:56.924947 19690 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.928603 19414 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.977425 15650 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:56.911020 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 80128.8us
I20260709 13:07:56.929396 19483 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:56.965309 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:57.292315 16278 raft_consensus.cc:2376] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6. Re-sending same reply.
I20260709 13:07:57.292784 16276 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:57.294286 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:57.103163 15618 connection.cc:256] RPC call timeout handler was delayed by -1.8392606869999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:07:57.296860 15720 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
W20260709 13:07:57.052610 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.230122 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.299314 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.033939 15574 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:57.291808 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 365147us
I20260709 13:07:57.064396 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.301007 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:56.980357 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:57.024405 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.983301 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:57.305847 16271 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:57.306627 16274 raft_consensus.cc:2368] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
W20260709 13:07:57.299228 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.308215 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.033815 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:57.309523 16273 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:57.303017 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.007824 15649 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:07:57.304781 15646 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
W20260709 13:07:57.302052 15692 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.624s (SENT) [suppressed 22 similar messages]
I20260709 13:07:56.972194 19356 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.312268 19356 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.311888 19631 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.314769 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:57.315658 15618 connection.cc:256] RPC call timeout handler was delayed by -1.2742659489999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:07:57.316344 15649 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:57.309383 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.317991 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:57.316273 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1437249009999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:07:57.320466 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.321660 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.321851 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.323185 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.323879 15649 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.325733 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.327430 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.336793 15577 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:57.338397 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.339212 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:57.339743 15720 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.339637 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.343969 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:57.345203 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.346277 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:57.346997 16274 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:57.347714 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.348892 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.349709 15646 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:56.972424 19604 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.350387 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.329190 19317 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.981630 19560 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.320178 19308 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.351667 19483 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.356258 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:57.139307 19210 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.142745 19293 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.305473 19695 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.317350 19690 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.273581 19600 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:57.285928 19656 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:57.350394 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.406668 15650 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.359879 15726 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:57.338330 15475 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 8, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.299919 19563 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.350431 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:57.347667 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46746.6us
I20260709 13:07:57.364912 15720 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:57.305758 19346 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.305835 19414 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.987440 19629 consensus_queue.cc:1243] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:57.305444 19684 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.064370 19612 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:57.377681 15649 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:07:57.314846 19588 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.379980 16271 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:57.322751 19466 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.350813 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.404768 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.409718 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.412776 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:57.447046 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:57.447381 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.380924 19698 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.415550 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:57.449528 15577 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.400090 19423 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.411571 19652 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.427863 15475 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 9, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.442387 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.324816 19644 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.449892 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:57.419795 19563 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:57.461601 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.417685 19333 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.388526 19317 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.458760 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:57.466406 15653 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:07:57.463019 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.459093 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:57.443969 19667 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
I20260709 13:07:57.470963 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:57.470741 15475 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 8, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 8 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:07:57.405956 19705 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:57.408821 19600 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.452531 19165 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.459739 19560 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:57.487527 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:57.487466 15475 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:57.490886 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 171368us
I20260709 13:07:57.494073 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:57.489938 15648 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:07:57.446725 19684 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.496913 19683 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.470454 19423 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:57.497782 15475 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:07:57.500360 19696 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.001s
I20260709 13:07:57.500756 19165 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:57.500834 19696 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.501362 19165 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:57.503080 19696 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.449388 19612 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.449636 19588 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.483269 19308 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.490473 19473 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.456378 19698 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.453074 19466 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.485404 15577 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:57.516156 19423 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.518077 19317 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.481854 19333 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.518940 15475 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 7 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.520267 19356 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.520674 15654 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:57.521925 15571 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:57.523273 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2434) took 1977 ms. Trace:
I20260709 13:07:57.524181 19575 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.462175 19652 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.574169 19317 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:57.574870 19317 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.577258 19317 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.489818 19560 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.578289 19560 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:57.526521 19704 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:07:57.527215 19707 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:57.527390 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.502532 19165 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.474534 19667 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.595958 19667 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:07:57.558703 15577 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.495486 19631 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.602239 15727 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:57.602936 19042 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.603510 19042 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.606851 15722 raft_consensus.cc:1217] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-11.7]   Dedup: 7.5->[9.6-11.7]
I20260709 13:07:57.607426 15722 pending_rounds.cc:85] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 5
I20260709 13:07:57.607683 15722 pending_rounds.cc:107] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:57.607954 15722 raft_consensus.cc:2889] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.581564 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.573812 15721 rpcz_store.cc:276] 0709 13:07:55.545607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.577730 (+ 32123us) service_pool.cc:224] Handling call
0709 13:07:55.577963 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.755112 (+177149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.523027 (+1767915us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400106b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:57.523213 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366987136}
I20260709 13:07:57.610014 15646 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:57.584317 15576 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:57.539028 19293 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:57.586472 15649 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:57.462215 19595 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:57.593243 19651 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.006s
I20260709 13:07:57.611835 15475 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 10, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 10 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.621927 15573 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.629249 15475 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 10, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 10 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.627442 15574 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:57.633998 19604 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.645328 18691 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.645893 18691 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:57.619995 19210 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.652980 15475 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.650677 18691 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.655628 18691 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.695766 15578 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.651017 19575 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.708274 15475 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 9, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.731815 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 237871us
I20260709 13:07:57.732879 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:07:57.733457 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.738967 19293 raft_consensus.cc:2764] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:57.739877 19333 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.745571 19356 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.746481 19644 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.747200 19600 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.748320 19652 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.750560 19612 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.750751 19466 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.701611 19210 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:07:57.754729 19709 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:07:57.756140 19688 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.955s	user 0.002s	sys 0.000s
I20260709 13:07:57.755604 19346 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:57.762544 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.762773 15475 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:57.805030 16270 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:57.767197 15650 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:57.770318 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:57.780102 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:57.794937 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.794938 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:07:57.768855 19375 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.014s	user 0.013s	sys 0.001s
I20260709 13:07:57.768174 19605 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.813987 15475 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:57.820343 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1830) took 2682 ms. Trace:
W20260709 13:07:57.820830 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 1269) took 2127 ms (client timeout 2043 ms). Trace:
I20260709 13:07:57.820739 15580 rpcz_store.cc:276] 0709 13:07:55.137962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.138188 (+   226us) service_pool.cc:224] Handling call
0709 13:07:55.138527 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.499912 (+361385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.820098 (+2320186us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54000c71d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:57.820285 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823300992}
W20260709 13:07:57.821280 16275 rpcz_store.cc:269] 0709 13:07:55.692956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.693108 (+   152us) service_pool.cc:224] Handling call
0709 13:07:57.779936 (+2086828us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800003c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:07:57.820760 (+ 40824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45767552}
I20260709 13:07:57.780172 19301 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.833425 16277 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:57.822178 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.834860 16272 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:57.792191 19716 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:57.838469 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.764114 19563 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.838946 15475 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 2 to 4, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 4 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:07:57.843362 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:57.734897 19575 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.861193 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.823067 19644 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.820096 19652 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.863351 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:57.869160 16270 raft_consensus.cc:2410] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:57.863351 15475 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.865139 16275 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:57.866441 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 131589us
W20260709 13:07:57.867002 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 362269us
I20260709 13:07:57.795204 19210 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:57.873605 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:57.879235 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.838366 19698 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:57.890782 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:57.882323 15618 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:57.890735 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.822115 19375 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.851406 19588 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:57.962317 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:57.971997 16270 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.972642 18691 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:57.973417 18691 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:57.894598 15475 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 8, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.974553 18691 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.975601 15475 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.844972 19684 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:07:57.979116 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96952.5us
I20260709 13:07:57.837155 19605 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.000305 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:57.995318 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:57.997516 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:58.011412 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.012651 15576 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:57.840839 19301 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.860791 19716 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.024026 15646 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:58.026911 15572 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:57.872714 19644 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:57.877600 19652 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.020334 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.049495 16271 raft_consensus.cc:2368] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:58.017858 19196 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:58.035303 19671 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.883s	user 0.005s	sys 0.001s
I20260709 13:07:58.074086 15580 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
W20260709 13:07:58.036110 19720 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:58.036715 19042 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.038534 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.039754 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.076402 16275 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:58.083547 15576 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:07:58.041924 19414 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.595s	user 0.002s	sys 0.005s
I20260709 13:07:58.075971 15573 raft_consensus.cc:2410] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:58.079118 19612 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.094801 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.095768 16274 raft_consensus.cc:2368] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
I20260709 13:07:58.118162 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2446) took 1551 ms. Trace:
I20260709 13:07:58.101284 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1894) took 1143 ms. Trace:
I20260709 13:07:58.117501 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.147267 15579 raft_consensus.cc:2376] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5. Re-sending same reply.
I20260709 13:07:58.113180 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 793) took 1438 ms. Trace:
I20260709 13:07:58.096239 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.149832 16275 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:07:58.148358 15572 rpcz_store.cc:276] 0709 13:07:56.680597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.680765 (+   168us) service_pool.cc:224] Handling call
0709 13:07:58.112952 (+1432187us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400055354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.113094 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923078400}
I20260709 13:07:58.081151 19196 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:58.160640 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.161629 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.162447 16271 raft_consensus.cc:2410] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:58.118242 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2451) took 1504 ms. Trace:
W20260709 13:07:58.096956 19560 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 13:07:58.145630 15720 rpcz_store.cc:276] 0709 13:07:56.566594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.427132 (+860538us) service_pool.cc:224] Handling call
0709 13:07:57.427497 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:57.443404 (+ 15907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.443433 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:57.455251 (+ 11818us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.784699 (+329448us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.073489 (+288790us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.074377 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.074449 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.117892 (+ 43443us) raft_consensus.cc:1685] finished
0709 13:07:58.117911 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.118086 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2273,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":14942,"thread_start_us":568770,"threads_started":2,"wal-append.queue_time_us":654228}
I20260709 13:07:58.155428 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1897) took 1183 ms. Trace:
W20260709 13:07:58.138099 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 760) took 3243 ms (client timeout 1650 ms). Trace:
W20260709 13:07:58.097209 19663 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 1.944s	user 0.001s	sys 0.002s
I20260709 13:07:58.157773 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.167322 15729 rpcz_store.cc:276] 0709 13:07:56.614329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.537973 (+923644us) service_pool.cc:224] Handling call
0709 13:07:57.538272 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.538594 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.538620 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.539120 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.866559 (+327439us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.866602 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.866666 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.117846 (+251180us) raft_consensus.cc:1685] finished
0709 13:07:58.117866 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.118002 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5877,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":19913,"thread_start_us":327052,"threads_started":1,"wal-append.queue_time_us":576974}
I20260709 13:07:58.142984 16270 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:58.201562 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.201663 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.202214 16270 raft_consensus.cc:2376] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10. Re-sending same reply.
I20260709 13:07:58.175832 15576 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:07:58.174681 15726 rpcz_store.cc:269] 0709 13:07:54.864412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.866669 (+  2257us) service_pool.cc:224] Handling call
0709 13:07:58.107312 (+3240643us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400399c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.107484 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5478461824}
I20260709 13:07:58.176105 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:58.176414 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 354169us
I20260709 13:07:58.177289 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.119977 19623 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.193563 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.208007 16271 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:58.209021 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.209631 16271 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:07:58.210309 19210 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.211526 19605 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.184191 19510 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:58.212118 19735 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:58.212288 19510 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:07:58.213085 19736 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:58.213304 19510 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.214432 19510 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.180895 19560 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.219388 19652 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.152727 19346 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.205031 16275 raft_consensus.cc:2376] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9. Re-sending same reply.
I20260709 13:07:58.223418 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.224330 16275 raft_consensus.cc:2368] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
I20260709 13:07:58.225301 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.205379 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.206817 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.226549 16270 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:07:58.221151 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.227144 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.225455 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.227882 16274 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:58.206719 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.231334 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.231375 19652 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.232244 16270 raft_consensus.cc:2410] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:58.232892 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.233119 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.233878 16275 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.234325 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.234720 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2411) took 1086 ms. Trace:
I20260709 13:07:58.234833 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.235154 16274 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:58.235471 16275 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:07:58.236200 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.236402 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.236807 16274 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:58.237478 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.237648 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.229823 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.238284 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.239568 16274 raft_consensus.cc:2410] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:58.196458 19563 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.233788 16270 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:07:58.252565 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.240111 16271 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.235092 15653 rpcz_store.cc:276] 0709 13:07:57.148016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.491623 (+343607us) service_pool.cc:224] Handling call
0709 13:07:57.510981 (+ 19358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.840072 (+329091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.840096 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.843999 (+  3903us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.093875 (+249876us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:58.145500 (+ 51625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.145574 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.234523 (+ 88949us) raft_consensus.cc:1685] finished
0709 13:07:58.234542 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.234667 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24405,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":525813,"threads_started":2,"wal-append.queue_time_us":351019}
I20260709 13:07:58.174015 15577 rpcz_store.cc:276] 0709 13:07:56.972402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.597131 (+624729us) service_pool.cc:224] Handling call
0709 13:07:57.597552 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.597827 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:57.825742 (+227915us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.154917 (+329175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.154994 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:58.155063 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.155198 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.155354 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19459,"prepare.queue_time_us":517254,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":122,"thread_start_us":526930,"threads_started":2}
I20260709 13:07:58.255461 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:58.227321 19728 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:58.256328 15579 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:58.257181 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.238366 19423 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:58.259347 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 234692us
I20260709 13:07:58.263514 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.255491 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.263690 16274 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:58.240015 16275 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:58.264187 15576 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:07:58.258903 16270 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:58.255755 19652 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.256986 19605 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.258457 19042 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:58.276751 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.094128 19414 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.283653 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:58.284646 15618 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.030s (SENT)
I20260709 13:07:58.271641 19375 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.285432 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:58.282922 16236 leader_election.cc:336] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.650s (SENT)
I20260709 13:07:58.288821 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:58.290114 16236 connection.cc:256] RPC call timeout handler was delayed by -1.9317577079999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:07:58.291251 16274 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:58.291644 15651 raft_consensus.cc:2368] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:07:58.274488 19605 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:58.238551 19196 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.297365 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.280377 19644 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.280534 19716 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.283757 19042 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:58.284510 19560 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.287583 19423 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.311496 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1956) took 1406 ms. Trace:
I20260709 13:07:58.311995 15655 rpcz_store.cc:276] 0709 13:07:56.904818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.905481 (+   663us) service_pool.cc:224] Handling call
0709 13:07:56.921328 (+ 15847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.399194 (+477866us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:57.623315 (+224121us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.812222 (+188907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.812281 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.812329 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.311253 (+498924us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540024b3d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:58.311302 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.311431 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17433,"prepare.queue_time_us":356065,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":17540,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10605,"spinlock_wait_cycles":1098351872,"thread_start_us":390925,"threads_started":2,"wal-append.queue_time_us":378292}
I20260709 13:07:58.314457 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2116) took 1431 ms. Trace:
I20260709 13:07:58.314890 15722 rpcz_store.cc:276] 0709 13:07:56.883122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.606214 (+723092us) service_pool.cc:224] Handling call
0709 13:07:57.606593 (+   379us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:57.608680 (+  2087us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:58.016678 (+407998us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.196693 (+180015us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.204107 (+  7414us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.204445 (+   338us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:58.204522 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.204706 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.314227 (+109521us) raft_consensus.cc:1685] finished
0709 13:07:58.314247 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.314398 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":587291,"prepare.run_wall_time_us":33,"raft.queue_time_us":10600,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":16914,"spinlock_wait_cycles":12794624,"thread_start_us":516470,"threads_started":2,"wal-append.queue_time_us":194273}
I20260709 13:07:58.317319 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 1024) took 1356 ms. Trace:
I20260709 13:07:58.317746 16277 rpcz_store.cc:276] 0709 13:07:56.961155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.961258 (+   103us) service_pool.cc:224] Handling call
0709 13:07:58.317109 (+1355851us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54005609d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.317256 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003282688}
I20260709 13:07:58.292209 19563 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.292248 19749 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:58.304910 19744 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:07:58.298996 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.329133 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.342061 16277 raft_consensus.cc:2368] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:58.343098 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.343771 16277 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:58.330435 19600 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:58.344586 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.345249 16277 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:58.329310 16271 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:58.341645 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.346622 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.347429 16271 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:07:58.294931 19605 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.330682 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.334081 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:58.298381 19723 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:58.348752 15655 raft_consensus.cc:606] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:58.349705 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.344993 19690 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.351163 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.351989 15579 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:58.352825 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.353446 19301 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:07:58.351329 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.352018 19414 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.353888 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:58.355430 15723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2456) took 1739 ms (client timeout 1819 ms). Trace:
W20260709 13:07:58.356106 15723 rpcz_store.cc:269] 0709 13:07:56.615892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.807056 (+191164us) service_pool.cc:224] Handling call
0709 13:07:58.355241 (+1548185us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b540011c1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.355359 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45749120}
I20260709 13:07:58.358165 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.359082 15579 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:58.359120 19042 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.361989 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.362589 19749 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.363348 19749 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.363397 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.363981 19749 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:58.364797 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.364956 19749 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.344919 19600 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.366338 19644 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.146551 15571 rpcz_store.cc:276] 0709 13:07:56.957577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.585182 (+627605us) service_pool.cc:224] Handling call
0709 13:07:57.585589 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.585844 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:57.843034 (+257190us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.100897 (+257863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.100952 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.101000 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.101073 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.101212 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":519127,"raft.queue_time_us":100,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":19832,"spinlock_wait_cycles":6191360,"thread_start_us":482269,"threads_started":2}
I20260709 13:07:58.379283 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.378489 19652 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:58.424383 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 53367.2us
I20260709 13:07:58.424844 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.425707 16271 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:58.426898 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.388190 19652 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:07:58.443387 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 78680us
I20260709 13:07:58.444675 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.446517 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.448944 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.449645 16277 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.452270 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 786) took 1815 ms. Trace:
I20260709 13:07:58.452605 19600 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.453110 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1900) took 1407 ms. Trace:
I20260709 13:07:58.453482 15574 rpcz_store.cc:276] 0709 13:07:57.046096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.412003 (+365907us) service_pool.cc:224] Handling call
0709 13:07:58.452955 (+1040952us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000c62d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.453058 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412518144}
I20260709 13:07:58.455525 15692 leader_election.cc:400] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 5 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6.
I20260709 13:07:58.456588 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.452647 15578 rpcz_store.cc:276] 0709 13:07:56.636649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.636775 (+   126us) service_pool.cc:224] Handling call
0709 13:07:56.637058 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.696562 (+1059504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.452029 (+755467us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540038ead4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:58.452208 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344362752}
I20260709 13:07:58.458127 16271 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:58.458303 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.441956 19652 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.459856 16277 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:07:58.461316 19042 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.461774 19042 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:58.459615 19656 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:58.465126 19042 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.463371 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:58.465899 15655 raft_consensus.cc:606] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:58.465281 19656 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:07:58.468865 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:58.469480 15655 raft_consensus.cc:606] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.469854 15655 raft_consensus.cc:614] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:58.468498 19656 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:58.473459 19726 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.456s	user 0.000s	sys 0.002s
W20260709 13:07:58.477562 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.480713 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:58.481566 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2408) took 1334 ms. Trace:
I20260709 13:07:58.493566 15655 raft_consensus.cc:606] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:58.493968 15655 raft_consensus.cc:614] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:58.493659 15648 rpcz_store.cc:276] 0709 13:07:57.146985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.325404 (+178419us) service_pool.cc:224] Handling call
0709 13:07:58.481348 (+1155944us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002e4354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.481495 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376045440}
I20260709 13:07:58.482398 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 1021) took 1522 ms. Trace:
I20260709 13:07:58.495297 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.495608 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.495863 16277 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:58.482681 19752 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:58.484082 15722 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:58.484194 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.495713 16278 rpcz_store.cc:276] 0709 13:07:56.960275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.961324 (+  1049us) service_pool.cc:224] Handling call
0709 13:07:58.482155 (+1520831us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400697654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.482305 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758885760}
I20260709 13:07:58.485212 15726 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:58.500876 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.485729 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.486229 19372 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:58.448400 19644 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.490487 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.491204 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.497032 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.497730 19423 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.499178 16274 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:58.503739 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.510825 15543 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:58.515575 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.516398 16276 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.517040 15543 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:58.517151 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:58.499791 15651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 737) took 1596 ms (client timeout 1835 ms). Trace:
I20260709 13:07:58.517901 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:58.518391 15651 rpcz_store.cc:269] 0709 13:07:56.903782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.904285 (+   503us) service_pool.cc:224] Handling call
0709 13:07:58.493007 (+1588722us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400084154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.499726 (+  6719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3123771776}
I20260709 13:07:58.519055 16278 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.501825 15729 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.520349 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.521095 15720 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.522073 19716 raft_consensus.cc:2764] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:58.522574 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2449) took 1950 ms. Trace:
I20260709 13:07:58.522971 15724 rpcz_store.cc:276] 0709 13:07:56.572536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.518945 (+946409us) service_pool.cc:224] Handling call
0709 13:07:57.519239 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.519440 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.519464 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.519909 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.770711 (+250802us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.770766 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.770852 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.472887 (+702035us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:07:58.522300 (+ 49413us) raft_consensus.cc:1685] finished
0709 13:07:58.522319 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.522519 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15328640,"thread_start_us":250404,"threads_started":1,"wal-append.queue_time_us":359993}
I20260709 13:07:58.524060 19716 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:58.527207 15727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2439) took 2975 ms (client timeout 1765 ms). Trace:
I20260709 13:07:58.527310 19644 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:07:58.527616 15727 rpcz_store.cc:269] 0709 13:07:55.655458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.655847 (+   389us) service_pool.cc:224] Handling call
0709 13:07:58.527045 (+2871198us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400002654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:07:58.527136 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4372054400}
I20260709 13:07:58.528136 19644 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.527333 19456 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.530750 19456 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:58.532225 19708 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.239s	user 0.004s	sys 0.000s
I20260709 13:07:58.533747 19333 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:58.534353 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1953) took 1630 ms. Trace:
I20260709 13:07:58.534632 19333 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:58.535079 19333 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:58.535916 19333 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.537091 19333 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:58.519119 15544 connection.cc:256] RPC call timeout handler was delayed by -1.3004437700000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:07:58.544062 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:07:58.543862 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.529827 19042 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.554334 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.555176 15723 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.518042 16274 pending_rounds.cc:85] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 8
W20260709 13:07:58.557078 15544 connection.cc:256] RPC call timeout handler was delayed by -1.0191979250000713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260709 13:07:58.557718 16274 pending_rounds.cc:107] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:58.558207 16274 raft_consensus.cc:2889] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.559245 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:58.534739 15647 rpcz_store.cc:276] 0709 13:07:56.904027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.904213 (+   186us) service_pool.cc:224] Handling call
0709 13:07:56.919162 (+ 14949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.313140 (+393978us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:57.648921 (+335781us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.844981 (+196060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.845050 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:57.845108 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.534143 (+689035us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:58.534187 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.534302 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":441928,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":357,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6194,"spinlock_wait_cycles":905572224,"thread_start_us":528283,"threads_started":2,"wal-append.queue_time_us":398941}
W20260709 13:07:58.560416 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 103902us
I20260709 13:07:58.561462 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.563334 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.564127 15727 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
W20260709 13:07:58.571429 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.572345 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:58.577592 15729 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:07:58.584559 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.587168 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:58.598914 16277 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:58.608002 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.608871 15721 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:07:58.614352 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.614820 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.615553 15572 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.615716 15577 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:58.617385 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.618194 15580 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:58.621222 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.622069 15578 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:07:58.625147 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.625926 15571 raft_consensus.cc:2410] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:58.626497 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.627287 15577 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:58.625746 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.629505 15580 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:58.602351 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45663.8us
I20260709 13:07:58.554275 19276 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.499565 19563 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:58.635138 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.636021 15726 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.636601 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.637305 19652 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.637406 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.637673 15724 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:58.663591 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.666488 15725 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.664446 15648 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:58.667016 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78621.2us
I20260709 13:07:58.640614 16269 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:58.669322 15649 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:58.670595 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.671172 15651 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:07:58.672124 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.672133 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.663969 15723 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:07:58.674489 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.675056 15574 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:58.677155 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.583758 19757 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.641461 19752 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:58.679574 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.692167 16273 raft_consensus.cc:2410] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:58.639130 19716 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.680559 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:58.699244 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.652794 15720 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
W20260709 13:07:58.666050 19754 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 13:07:58.684494 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.702785 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.702857 15724 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.685492 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.687789 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.690292 15729 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.680589 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.693553 15575 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.693930 15721 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:58.694680 15726 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:07:58.657639 19456 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.696858 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.666150 19600 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.696920 15723 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:58.705891 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.667888 19749 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.708513 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.589103 19414 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:07:58.705797 19600 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:07:58.611171 19724 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:58.716049 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.720836 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.723555 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.740541 15654 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.740721 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.741390 15571 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:07:58.735630 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.736140 16275 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:07:58.738152 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.679688 19761 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.748831 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.746928 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.747828 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.748755 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.752058 15649 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:58.754612 19196 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:58.755235 19196 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:58.756590 19652 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.756319 19196 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.757324 19629 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:58.759171 19340 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.759613 19340 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:58.760571 19340 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.762573 16273 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:58.764128 19042 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.689107 19210 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:58.697896 19716 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:07:58.766072 19623 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.766355 19716 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.766657 19623 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:58.766937 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.673882 19276 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.767719 19623 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.769593 19276 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.702251 19423 raft_consensus.cc:2764] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:58.692716 19698 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:58.706635 19301 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.772544 19301 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:58.773247 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.672674 19563 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.774711 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.775411 16271 raft_consensus.cc:2368] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:07:58.775379 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.776463 16272 raft_consensus.cc:2410] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:58.776684 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.777319 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.748169 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.778555 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:58.779678 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.781013 15723 pending_rounds.cc:85] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
I20260709 13:07:58.781150 15728 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:58.781294 15723 pending_rounds.cc:107] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:58.781606 15723 raft_consensus.cc:2889] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.782168 19749 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.782408 19598 consensus_queue.cc:1175] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 13:07:58.782719 19749 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.785113 19749 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.785614 19749 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.751616 15573 raft_consensus.cc:2376] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11. Re-sending same reply.
I20260709 13:07:58.749246 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.787689 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.788486 16274 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.789582 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.790659 15728 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:58.795728 15652 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:58.800508 15724 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:58.695708 19757 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.803220 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.803503 15726 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:58.805042 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.805874 15652 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:07:58.761468 19605 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.742447 19600 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.807444 16275 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:07:58.807641 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:58.808444 15721 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:07:58.811844 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:07:58.812701 16275 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:07:58.813267 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.788328 19623 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.757915 19196 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.776629 19563 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:58.834964 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.742754 19456 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:07:58.839552 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.840543 15648 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.841089 15722 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:07:58.825791 15619 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:07:58.773564 19301 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.847887 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.848085 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.828826 15650 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:58.826715 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.832535 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:07:58.850561 16275 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.837975 15720 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:58.839529 16270 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:58.828028 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 128479us
I20260709 13:07:58.844472 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:58.791018 19340 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:58.844599 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 260103us
I20260709 13:07:58.855425 15653 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:58.855788 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:58.856994 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.858177 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.858705 15651 raft_consensus.cc:2368] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:07:58.859969 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:58.797410 19749 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:58.823112 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 138763us
I20260709 13:07:58.866956 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:58.807178 19372 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:07:58.812140 19629 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:58.880817 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.878211 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:58.876508 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:58.827358 19414 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:07:58.883034 19684 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.891642 19757 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.892295 19757 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.892674 19757 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.893002 19757 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.895071 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.895910 15572 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.896246 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9377274f9c9482a924840f15b616a13"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:07:58.897851 19605 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.898447 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:58.898674 19605 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.899194 19605 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.899552 19605 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.899880 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.901191 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.902407 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.903023 19771 raft_consensus.cc:2764] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:58.903286 15577 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:07:58.903990 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:58.912547 15571 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.905746 15573 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:58.901773 15580 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.906054 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1891) took 1949 ms. Trace:
I20260709 13:07:58.913784 15575 rpcz_store.cc:276] 0709 13:07:56.956709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.958436 (+  1727us) service_pool.cc:224] Handling call
0709 13:07:56.958811 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.707589 (+1748778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.905824 (+198235us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001351d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:07:58.905978 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3989140352}
W20260709 13:07:58.911744 15466 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.373s	user 0.006s	sys 0.009s
I20260709 13:07:58.872468 19690 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:58.909209 19770 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:58.861503 19652 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:58.908244 15655 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:07:58.922458 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:07:58.919342 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 241137us
I20260709 13:07:58.926785 16275 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:07:58.943395 15571 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:07:58.959863 19575 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.918167 19724 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:58.950380 19716 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.968526 15578 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:58.968652 19716 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:58.940053 19276 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:58.931622 19770 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:58.975626 15580 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:58.977542 15544 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:58.978176 19656 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.978845 19656 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:58.979434 19771 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:58.979921 19771 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:58.980947 19656 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:58.980751 19771 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:58.930258 19684 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:58.946442 19690 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:59.043080 19684 consensus_queue.cc:1243] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:07:59.060350 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 116581us
I20260709 13:07:59.067932 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:07:59.068979 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 150238us
I20260709 13:07:59.077494 16236 leader_election.cc:400] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:07:59.084699 16236 leader_election.cc:403] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:59.011026 19768 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:07:59.061568 19656 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:59.101423 19749 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:59.102515 19423 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.102957 19770 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.114217 19690 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:59.129913 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 256690us
I20260709 13:07:59.130887 15654 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:07:59.255728 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:59.257087 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:59.132047 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.132632 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 266519us
I20260709 13:07:59.135252 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:59.135911 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:59.258319 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:59.259572 15692 leader_election.cc:400] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:59.259837 15692 leader_election.cc:403] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:59.140380 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 268766us
I20260709 13:07:59.175874 15572 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
W20260709 13:07:59.139391 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 220277us
I20260709 13:07:59.314394 15652 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:59.314822 15647 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:07:59.316862 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56257.9us
I20260709 13:07:59.324856 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:07:59.325286 15655 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:59.326206 15728 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:59.325397 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:07:59.331190 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:07:59.330353 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 453902us
I20260709 13:07:59.139137 19652 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:59.138936 19423 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.405177 15543 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:07:59.419890 15648 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.002s
I20260709 13:07:59.420507 15648 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:07:59.421217 15649 raft_consensus.cc:606] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:59.421748 15649 raft_consensus.cc:614] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:59.405862 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 419334us
I20260709 13:07:59.426458 15650 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:59.426517 15725 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:59.342679 19644 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.000s
I20260709 13:07:59.427810 19423 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.461472 19778 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.330700 19333 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:07:59.445397 19785 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:59.329594 19723 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
W20260709 13:07:59.503252 15721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.036s	sys 0.075s
W20260709 13:07:59.504908 15721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.036s	sys 0.075s
W20260709 13:07:59.520443 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 115256us
I20260709 13:07:59.522676 15543 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:07:59.524807 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:59.526840 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:07:59.529428 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 210879us
I20260709 13:07:59.463497 19767 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 4. Current term is 5.
I20260709 13:07:59.473912 19684 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:07:59.454859 19644 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.534899 15618 leader_election.cc:400] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:07:59.539484 15618 leader_election.cc:403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:59.533618 15543 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:59.536728 19779 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:59.534560 19656 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.552855 19757 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:07:59.546844 19771 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:59.582504 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 302497us
W20260709 13:07:59.565342 19340 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.002s
I20260709 13:07:59.493685 19778 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:07:59.592970 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 166995us
I20260709 13:07:59.593273 16235 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:59.506709 19785 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.609477 15654 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
W20260709 13:07:59.596829 19605 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:07:59.626231 19723 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:07:59.627099 19723 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:59.627494 19723 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:59.628381 19723 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.629745 19723 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:59.648144 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54723.4us
I20260709 13:07:59.654480 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:07:59.689579 19777 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:07:59.689997 19644 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:59.570977 19656 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.571342 19757 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:07:59.639245 19600 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.007s
W20260709 13:07:59.706974 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 155948us
W20260709 13:07:59.704867 16236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.022s	sys 0.041s
W20260709 13:07:59.710227 16236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.022s	sys 0.041s
I20260709 13:07:59.706964 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:59.609598 19340 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 13:07:59.710641 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 582839us
I20260709 13:07:59.712402 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:59.714197 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 454708us
I20260709 13:07:59.716475 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:59.718155 15724 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.709733 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:59.712920 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.639673 19605 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.730690 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:07:59.744438 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:59.742945 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:07:59.747344 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:59.745353 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 82073.1us
I20260709 13:07:59.749315 15720 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:07:59.749446 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.750523 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.751948 15720 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:59.750079 16235 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:59.713244 19794 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:59.719285 19684 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.741875 19644 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.760381 15726 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:59.757200 15728 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:59.710871 19600 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:07:59.763828 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:07:59.758811 19786 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:07:59.773033 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:59.776073 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.758857 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.777802 15720 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:07:59.767619 19787 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:07:59.745630 19804 raft_consensus.cc:2764] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:59.781909 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.776907 15728 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:07:59.774245 15579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.009s	sys 0.013s
W20260709 13:07:59.786652 15579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.009s	sys 0.013s
I20260709 13:07:59.748452 19795 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.762928 19723 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.764003 19340 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:59.787078 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:07:59.786433 15720 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:59.786365 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3498092080000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
I20260709 13:07:59.768731 19644 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.763547 19797 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:59.795639 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.808779 15720 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:59.793793 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:07:59.804522 19644 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.810289 15725 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:07:59.776937 19769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.002s	sys 0.013s
I20260709 13:07:59.792771 15574 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:07:59.775768 19652 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.774075 19808 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:59.819028 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 541887us
I20260709 13:07:59.767920 19684 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.764827 19794 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.776777 19333 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:07:59.791678 19795 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:07:59.845963 19795 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:59.846545 19789 log.cc:927] Time spent T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:59.847669 19812 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:59.848393 19812 consensus_queue.cc:1059] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:59.849124 19784 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:07:59.850168 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 316629us
I20260709 13:07:59.850944 15543 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:07:59.798059 19723 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.853438 19723 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.859366 19623 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:59.860024 19623 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:07:59.860970 19623 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.862254 19781 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.862982 19781 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.863585 19781 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:59.866227 19210 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.829912 15728 raft_consensus.cc:1240] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:07:59.819208 19769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.002s	sys 0.014s
I20260709 13:07:59.794377 19340 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:07:59.843995 19794 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:07:59.869390 19794 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:59.845279 19333 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:59.870164 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 261639us
I20260709 13:07:59.870879 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:59.871125 19333 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:59.872414 19333 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:59.873131 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:07:59.876078 15466 maintenance_manager.cc:643] P bcd214cd726347aba20c77156a32ce97: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.614s	user 0.200s	sys 0.066s Metrics: {"bytes_written":29905,"cfile_init":1,"dirs.queue_time_us":472200,"dirs.run_cpu_time_us":562,"dirs.run_wall_time_us":23915,"drs_written":1,"lbm_read_time_us":152772,"lbm_reads_10-100_ms":3,"lbm_reads_gt_100_ms":1,"lbm_write_time_us":211321,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"raft.queue_time_us":834171,"rows_written":63,"thread_start_us":1265344,"threads_started":3,"wal-append.queue_time_us":363494}
W20260709 13:07:59.878710 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 124884us
I20260709 13:07:59.811296 19806 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:07:59.880082 15467 maintenance_manager.cc:419] P bcd214cd726347aba20c77156a32ce97: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10562 bytes on disk
W20260709 13:07:59.879307 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 83916.7us
I20260709 13:07:59.869942 19794 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.881310 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:07:59.840977 19791 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:59.838953 19805 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.839174 19778 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:07:59.939971 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:07:59.923947 19804 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.883765 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:59.963410 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 111045us
W20260709 13:07:59.964133 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 80460.9us
I20260709 13:07:59.965056 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:07:59.962657 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 127973us
I20260709 13:07:59.968551 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:07:59.971380 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 90198.5us
I20260709 13:07:59.939608 19820 raft_consensus.cc:3055] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:59.972738 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:59.975371 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:07:59.974705 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:07:59.886745 19806 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:07:59.972532 19804 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.119581 19605 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:07:59.971062 19656 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:00.270105 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 396998us
I20260709 13:07:59.976951 19820 raft_consensus.cc:740] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:07:59.970685 19805 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:00.342928 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 369556us
W20260709 13:08:00.404954 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.971860 19803 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:00.353838 19790 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:00.355396 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 379590us
I20260709 13:08:00.411330 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.357028 19802 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:59.973627 15580 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.413251 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.358340 15573 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:00.076642 19822 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:00.361323 19196 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.523s	user 0.013s	sys 0.005s
I20260709 13:08:00.362581 19808 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.363970 19797 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:00.368201 19795 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.006s
I20260709 13:07:59.972788 15572 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:59.970434 19767 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.978288 19690 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.963358 19771 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:00.120329 19815 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:00.098734 15466 maintenance_manager.cc:643] P bcd214cd726347aba20c77156a32ce97: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.136s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":320,"lbm_reads_lt_1ms":4}
I20260709 13:08:00.404018 19814 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.974084 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:00.373699 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:00.375299 15571 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.391398 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:00.371369 19819 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:00.418385 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:00.407697 19807 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.452s	user 0.009s	sys 0.000s
I20260709 13:08:00.425253 19834 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.428191 15572 pending_rounds.cc:85] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 8
I20260709 13:08:00.470590 15572 pending_rounds.cc:107] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:00.471048 15572 raft_consensus.cc:2889] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.433336 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2143) took 1642 ms. Trace:
I20260709 13:08:00.472636 15721 rpcz_store.cc:276] 0709 13:07:58.790732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.836231 (+ 45499us) service_pool.cc:224] Handling call
0709 13:07:58.863270 (+ 27039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.863492 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.863515 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.876138 (+ 12623us) log.cc:844] Serialized 26 byte log entry
0709 13:07:59.505695 (+629557us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:59.505771 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.505870 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.433060 (+927190us) raft_consensus.cc:1685] finished
0709 13:08:00.433089 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.433262 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":577700,"threads_started":1,"wal-append.queue_time_us":800186}
I20260709 13:07:59.972131 16235 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:00.383150 19625 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:08:00.437953 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1916) took 1812 ms. Trace:
I20260709 13:08:00.479171 15727 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.455932 15571 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
W20260709 13:08:00.482710 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2469) took 1984 ms (client timeout 1602 ms). Trace:
W20260709 13:08:00.483337 15722 rpcz_store.cc:269] 0709 13:07:58.494741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.500640 (+  5899us) service_pool.cc:224] Handling call
0709 13:08:00.478761 (+1978121us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003cb9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:00.478914 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780868992}
W20260709 13:08:00.445204 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 471174us
I20260709 13:08:00.444779 15725 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.420367 19794 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.419306 19822 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:00.426050 19656 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.426002 19605 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.421425 19600 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.430121 19816 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.493412 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 75125.3us
I20260709 13:08:00.496438 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.430191 19808 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:00.489993 19423 consensus_meta.cc:287] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.999s	user 0.016s	sys 0.003s
I20260709 13:08:00.514379 19423 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.446184 19813 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.468010 19778 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:00.440135 19684 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:00.443457 19690 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:00.430548 19196 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.532866 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 560787us
I20260709 13:08:00.496161 19510 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:00.538724 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:00.416354 19803 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.502197 19821 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.504781 19794 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:00.501904 19767 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.497622 19822 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.507314 19801 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:00.440513 19797 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.440793 19795 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.507543 19824 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:00.564090 15571 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:00.538595 19690 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.539839 19510 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:00.536082 19778 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.508481 19656 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.490340 19834 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.468959 19815 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.567478 19623 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.557288 19196 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.612164 19196 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.566174 19830 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.502847 19790 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:00.594511 15720 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:00.599455 16272 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:00.511525 19816 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:00.586548 19644 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.009s
W20260709 13:08:00.602363 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 114753us
I20260709 13:08:00.636610 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:00.637827 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.638535 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.639917 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.640007 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:00.603219 19781 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.007s
I20260709 13:08:00.583551 19042 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.536450 19813 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.588183 19835 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:00.607743 19656 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.609947 19827 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.510313 19820 consensus_queue.cc:260] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.583412 19600 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:00.594537 19723 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.005s
W20260709 13:08:00.631003 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 134641us
I20260709 13:08:00.633229 15571 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:00.634455 15572 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.573387 19794 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.626406 19830 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:00.642288 15573 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:00.656448 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.656579 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.558723 19771 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.573570 19821 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.601555 19800 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:00.675393 19816 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.675905 19846 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.675797 19800 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.676643 19846 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.580004 19801 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.680712 19801 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.681408 19801 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:00.683537 19795 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.589397 19824 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.687417 19824 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.688818 19834 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.632818 19842 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:00.689486 19834 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.669858 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:00.673699 19845 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.673936 19790 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.723460 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.674993 16274 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:00.675220 19835 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:00.701686 16271 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:00.694479 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:00.627812 19623 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.661032 19483 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.658087 19196 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:00.736071 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 344791us
I20260709 13:08:00.716495 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.712754 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.724323 15580 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
W20260709 13:08:00.726531 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56734.4us
I20260709 13:08:00.729684 15729 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:00.697675 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2148) took 1437 ms. Trace:
I20260709 13:08:00.668563 19829 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.687419 19794 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.666350 19684 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:00.701436 19838 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:08:00.734885 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.730877 19372 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:00.668824 19830 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.657378 19781 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:00.657495 19644 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:00.693162 19792 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.082s	user 0.020s	sys 0.019s
I20260709 13:08:00.738055 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:00.696769 19821 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.785555 19423 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:00.669809 19804 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:00.709486 19800 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.752279 15724 rpcz_store.cc:276] 0709 13:07:59.260107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.260284 (+   177us) service_pool.cc:224] Handling call
0709 13:07:59.419338 (+159054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.718862 (+299524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.697371 (+978509us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54003be7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:00.697600 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686598912}
I20260709 13:08:00.800176 19797 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.801395 19803 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:00.802054 19716 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:00.802174 19815 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:00.802650 19716 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.756021 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:00.689898 19842 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:00.799217 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:00.735630 19483 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.778117 19781 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:00.825662 19554 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.827411 19781 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.666164 19827 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.782191 19798 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.783967 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.834298 15571 raft_consensus.cc:2410] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:00.835640 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.782202 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.669935 19723 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.731032 19806 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.787300 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.690245 19847 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:08:00.662710 19510 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:00.789500 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:00.791568 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 69135.4us
W20260709 13:08:00.794333 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56407.2us
I20260709 13:08:00.729331 19805 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.765138 19684 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.681988 19801 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.805656 15724 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:00.757251 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.754324 19854 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:08:00.826558 15729 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.806118 15721 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:08:00.857712 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.901329 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.769497 19372 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:00.832646 19623 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:00.897270 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 140103us
I20260709 13:08:00.898798 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:00.892336 19847 consensus_queue.cc:1243] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:00.839591 19483 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.905282 19554 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:00.905966 19849 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:00.906767 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 62545.5us
I20260709 13:08:00.917289 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:00.908870 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:00.919548 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:00.910135 15729 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:00.878170 19781 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.922238 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:00.900214 19778 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.905315 19372 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:00.961551 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44373.5us
W20260709 13:08:00.972371 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50216.1us
W20260709 13:08:00.969857 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.903663 19805 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:00.971374 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:00.975476 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:00.977303 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:00.978417 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 43516.8us
I20260709 13:08:00.978953 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:00.917707 19827 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.961323 19806 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.961622 19716 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:00.976843 19839 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.980340 19850 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.985066 19829 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.999356 19816 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:01.006178 19833 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.985164 19846 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:00.976698 19837 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:01.008702 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 215211us
I20260709 13:08:01.011677 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2146) took 1752 ms. Trace:
I20260709 13:08:01.066639 15726 rpcz_store.cc:276] 0709 13:07:59.259550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.259656 (+   106us) service_pool.cc:224] Handling call
0709 13:07:59.260033 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.768241 (+508208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.000568 (+1232327us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400399c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:01.011610 (+ 11042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150152064}
W20260709 13:08:01.015362 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1125319149999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260709 13:08:01.016672 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.015794 19827 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.019416 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:01.071491 15572 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:00.979250 19845 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.025468 16271 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:00.844521 19835 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.052171 19808 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.059252 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.091059 15722 raft_consensus.cc:2393] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:01.092119 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.092998 15722 raft_consensus.cc:2368] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10.
W20260709 13:08:01.093356 19822 consensus_meta.cc:287] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.003s
I20260709 13:08:01.093889 19822 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.094200 19846 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:01.062687 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:01.098308 15571 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:01.099212 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:01.099481 19690 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:08:01.100176 19690 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.018980 16272 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:01.093883 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:01.102631 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:01.069372 15618 leader_election.cc:336] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.541s (SENT)
I20260709 13:08:01.072685 19837 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:01.073185 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:01.009793 19842 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.012627 19839 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:01.088311 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:01.089766 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:01.113806 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:01.104097 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:01.118000 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48669.2us
W20260709 13:08:01.119254 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.033859 19850 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:01.109982 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.082055 19824 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.123617 15544 leader_election.cc:400] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10.
I20260709 13:08:01.124094 15544 leader_election.cc:403] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:01.115813 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:01.088932 19845 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:01.087009 19723 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.127663 15726 raft_consensus.cc:2393] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:01.130941 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:01.133404 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:01.133687 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:01.109020 19822 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.109421 19644 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.138908 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:01.114840 19839 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.139600 16270 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.140883 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:01.141674 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.142910 15729 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:01.142997 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.147078 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:01.147050 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.147924 16272 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.150415 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.151643 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:01.152226 16278 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.148543 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.121565 19797 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.134384 19800 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.164268 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.165194 16274 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:01.133006 19783 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.129191 19806 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.134263 19845 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.139318 19846 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.135385 19808 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.137912 19821 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.186373 19834 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:01.187605 19850 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.190152 19372 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.159925 19858 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:08:01.135602 19796 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.136320 19824 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.204128 16277 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.178099 19723 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.232270 16276 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:01.208645 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1986) took 2073 ms. Trace:
I20260709 13:08:01.206797 19690 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.182468 19822 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.232935 15647 rpcz_store.cc:276] 0709 13:07:59.135642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.315484 (+179842us) service_pool.cc:224] Handling call
0709 13:07:59.315787 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.316052 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.316075 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.001072 (+1684997us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b2c00074958. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:01.005899 (+  4827us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.115919 (+110020us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:01.115957 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.116038 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.208250 (+ 92212us) raft_consensus.cc:1685] finished
0709 13:08:01.208281 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.208567 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205509,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5060,"spinlock_wait_cycles":3340160,"thread_start_us":109526,"threads_started":1,"wal-append.queue_time_us":184027}
I20260709 13:08:01.221638 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.241892 16274 raft_consensus.cc:2410] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:01.176281 16270 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:01.207789 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:01.210194 19846 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:01.247566 16278 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:01.180423 19799 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:08:01.180553 19837 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.251752 19372 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.243398 19723 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.254766 19723 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.258561 19779 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.259155 19779 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:01.251214 19830 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.258603 16272 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:01.215168 19483 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.247138 19684 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.249655 19846 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.249387 19822 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:01.271543 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.262917 19723 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.274590 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 141287us
I20260709 13:08:01.275951 15649 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:01.276618 15722 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:01.284080 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:01.267768 19808 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.285424 19372 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.287748 19690 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.288919 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:01.289521 15646 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.288475 19690 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:01.305840 15618 leader_election.cc:336] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.721s (SENT)
I20260709 13:08:01.312875 15646 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:01.284356 19723 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.311465 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:01.293200 19779 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.293164 19808 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:01.324560 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.328078 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:01.309485 19822 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.326743 15618 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:01.333148 15646 raft_consensus.cc:2376] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7. Re-sending same reply.
I20260709 13:08:01.335357 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:01.328881 19837 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:01.375309 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.376288 15649 raft_consensus.cc:2410] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:01.341089 19372 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.378057 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.378947 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:01.379429 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.380074 15646 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:01.384100 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.380872 15649 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:01.370501 19879 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.394887 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.382941 19800 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10.
I20260709 13:08:01.379771 19372 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.395989 15649 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:08:01.387367 19875 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:08:01.384682 19858 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:01.403688 19880 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:01.406646 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:01.407526 15649 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.383739 19824 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.409876 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.410699 15650 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:01.413460 15726 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:01.413126 19839 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.414767 15649 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:01.414923 19372 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.414458 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.440028 15650 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:01.416386 15726 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:01.441241 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.442327 15726 raft_consensus.cc:2410] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:01.423041 19808 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:01.424613 19723 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:01.424862 19865 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
I20260709 13:08:01.425916 19690 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:01.428027 19872 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:08:01.431036 19846 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.398988 19830 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:01.392827 19873 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:08:01.395550 19879 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.619705 19879 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:01.406680 19877 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:01.434496 19483 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.435253 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2120) took 2863 ms. Trace:
I20260709 13:08:01.630851 15727 rpcz_store.cc:276] 0709 13:07:58.572123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.573787 (+  1664us) service_pool.cc:224] Handling call
0709 13:08:00.478916 (+1905129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.490381 (+ 11465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.435037 (+944656us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003cb9d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:01.435176 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4380584192}
I20260709 13:08:01.632505 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:01.633193 15727 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.437094 16273 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:01.634158 16273 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:01.438563 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.635993 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.636770 15649 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:01.444499 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.474261 19858 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:01.503273 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:01.534269 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.638495 15726 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:01.650187 15726 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:01.637732 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.707037 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.711790 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.703647 16273 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.734716 16273 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.744757 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:01.743891 19785 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:01.744778 19873 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:01.729334 19842 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.770686 19845 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.006s
I20260709 13:08:01.799096 15653 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:01.797525 19814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.011s	sys 0.041s
I20260709 13:08:01.691375 19858 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.808450 15653 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:01.810824 15653 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:01.816475 19839 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.819018 15650 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.797272 19842 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.824021 15727 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:08:01.804289 19814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.011s	sys 0.041s
I20260709 13:08:01.837349 15724 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:01.817622 19372 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.799157 19845 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.848085 19340 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.837188 19814 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:01.850512 15652 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:01.945281 15649 raft_consensus.cc:2368] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
W20260709 13:08:01.943282 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.952178 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:01.849538 16273 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:01.971506 15726 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:01.971599 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1307) took 2005 ms. Trace:
W20260709 13:08:01.958788 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.878635 19809 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.994s	user 0.007s	sys 0.004s
I20260709 13:08:01.972071 19372 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.877601 19858 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.885177 19813 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.867944 19842 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.857846 19892 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:01.986358 19892 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.875648 19879 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:01.868024 19814 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:01.883963 19845 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:01.881304 19820 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.974478 19815 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.010752 19815 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:01.974874 19563 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:08:01.972240 16273 rpcz_store.cc:276] 0709 13:07:59.965999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.966141 (+   142us) service_pool.cc:224] Handling call
0709 13:07:59.966390 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.436973 (+1470583us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54006322a0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598adc0 00007f2d95a151c0 00007f2d95a16231 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c
0709 13:08:01.970828 (+533855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.971317 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90010880}
I20260709 13:08:01.854562 19846 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:01.995133 19483 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:01.998914 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:01.999795 19892 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:02.013955 19815 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:02.022745 19575 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.033809 19612 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:02.031581 19483 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.038769 19483 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:02.040073 19858 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.041162 19892 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.041019 19858 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.041806 19842 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.042110 19892 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.042886 19842 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.044978 19892 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.050583 19575 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.057359 16276 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:02.057608 19575 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.059062 19845 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.059525 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:02.059757 19845 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.059250 19723 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.063164 19845 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.069095 19333 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.077135 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.077407 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.078460 16276 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:02.069176 19858 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.079542 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.046361 19483 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.099186 19842 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.099709 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.098392 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.115012 15646 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:02.120355 16272 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:02.120419 19483 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.123135 19796 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:02.123781 19796 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.128341 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:02.129297 15728 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.129707 15722 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.130285 15722 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:02.131718 15722 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.132956 19757 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.133181 15722 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.137187 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.137887 16270 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.140292 19813 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.147765 15722 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:08:02.148741 19696 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:02.150765 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.152944 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.154138 16272 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:02.155821 19826 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.156306 19301 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.157455 19826 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:02.157912 19826 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:02.158291 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:02.159596 19839 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.159202 19826 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.160043 19839 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.160482 19839 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.160969 19826 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.161147 19901 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.161811 19901 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.164786 19901 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.166594 19814 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:02.170130 15722 pending_rounds.cc:85] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 10
I20260709 13:08:02.170825 15722 pending_rounds.cc:107] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:08:02.171167 15722 raft_consensus.cc:2889] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.173660 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1929) took 1159 ms. Trace:
I20260709 13:08:02.178857 15572 rpcz_store.cc:276] 0709 13:08:01.014371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.083878 (+ 69507us) service_pool.cc:224] Handling call
0709 13:08:02.173258 (+1089380us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400175f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.173423 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436764416}
W20260709 13:08:02.175273 19898 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:02.182528 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 825) took 1172 ms. Trace:
I20260709 13:08:02.182603 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2480) took 1167 ms. Trace:
I20260709 13:08:02.189106 19839 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.149655 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:02.191208 16275 raft_consensus.cc:2410] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:08:02.195684 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 46381.1us
W20260709 13:08:02.191977 15578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1917) took 3555 ms (client timeout 1541 ms). Trace:
I20260709 13:08:02.196022 19897 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.196894 19897 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:02.196771 15578 rpcz_store.cc:269] 0709 13:07:58.636228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.636390 (+   162us) service_pool.cc:224] Handling call
0709 13:08:02.191427 (+3555037us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540026cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.191696 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705777920}
I20260709 13:08:02.197353 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:02.197515 19897 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.183202 15729 rpcz_store.cc:276] 0709 13:08:01.015315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.146939 (+131624us) service_pool.cc:224] Handling call
0709 13:08:01.153247 (+  6308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.153614 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.153641 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.163077 (+  9436us) log.cc:844] Serialized 52 byte log entry
0709 13:08:02.032539 (+869462us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800365f80. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:02.053549 (+ 21010us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:02.062632 (+  9083us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.066286 (+  3654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.075536 (+  9250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.181977 (+106441us) raft_consensus.cc:1685] finished
0709 13:08:02.182179 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.182389 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23739,"prepare.queue_time_us":4284,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":16000,"raft.run_cpu_time_us":655,"raft.run_wall_time_us":89672,"spinlock_wait_cycles":4994816,"thread_start_us":17766,"threads_started":1,"wal-append.queue_time_us":872177}
W20260709 13:08:02.195055 15574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1920) took 3487 ms (client timeout 1721 ms). Trace:
I20260709 13:08:02.183056 15576 rpcz_store.cc:276] 0709 13:08:01.009429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.009685 (+   256us) service_pool.cc:224] Handling call
0709 13:08:01.013164 (+  3479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.013537 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:01.036125 (+ 22588us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.138329 (+102204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.138915 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.139082 (+   167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:01.139113 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.139171 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.891877 (+752706us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b1800410620. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:02.181818 (+289941us) raft_consensus.cc:1685] finished
0709 13:08:02.181956 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.182277 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28167,"prepare.queue_time_us":22585,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":9974,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":9007,"spinlock_wait_cycles":13981568,"thread_start_us":58114,"threads_started":1,"wal-append.queue_time_us":136422}
W20260709 13:08:02.198899 15574 rpcz_store.cc:269] 0709 13:07:58.707833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.707973 (+   140us) service_pool.cc:224] Handling call
0709 13:08:02.194564 (+3486591us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400109354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.194835 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387595648}
I20260709 13:08:02.192116 15575 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.211287 16270 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:02.214694 15728 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:02.178340 19879 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.216919 19858 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.228159 19858 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.230860 19858 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.220522 19757 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.226845 19333 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:02.167330 19814 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.214823 19796 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.250398 15653 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:02.236949 19757 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:02.252187 19757 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:02.253232 15693 connection.cc:256] RPC call timeout handler was delayed by -1.4220217080001021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:08:02.253881 15693 connection.cc:256] RPC call timeout handler was delayed by -1.2393217080000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:08:02.249053 19456 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:02.256129 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:02.257205 19456 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.274407 19456 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.260159 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 807) took 1116 ms. Trace:
I20260709 13:08:02.260804 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.276034 16274 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.262332 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:02.263135 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 65963.3us
I20260709 13:08:02.279526 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:02.249087 19845 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:02.285647 19845 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.290262 19456 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.294548 19820 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:02.275594 16277 rpcz_store.cc:276] 0709 13:08:01.143404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.232359 (+ 88955us) service_pool.cc:224] Handling call
0709 13:08:01.232732 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.233131 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.233168 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.240046 (+  6878us) log.cc:844] Serialized 52 byte log entry
0709 13:08:02.073180 (+833134us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b180041c200. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:02.175876 (+102696us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:02.246209 (+ 70333us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.248952 (+  2743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.249065 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.259672 (+ 10607us) raft_consensus.cc:1685] finished
0709 13:08:02.259782 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.259948 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9558,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":6347,"spinlock_wait_cycles":3092736,"thread_start_us":93089,"threads_started":2,"wal-append.queue_time_us":975990}
I20260709 13:08:02.295377 19820 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.297056 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:02.297991 19456 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.298550 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:02.299516 19820 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.300643 15577 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:02.302569 16271 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:02.302651 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1865) took 2328 ms. Trace:
I20260709 13:08:02.303205 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:02.306823 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 809) took 1162 ms. Trace:
I20260709 13:08:02.303620 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.301786 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.312829 16275 rpcz_store.cc:276] 0709 13:08:01.143958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.207449 (+ 63491us) service_pool.cc:224] Handling call
0709 13:08:02.306593 (+1099144us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54006847d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.306745 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179955968}
I20260709 13:08:02.303092 15577 rpcz_store.cc:276] 0709 13:07:59.974687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.974829 (+   142us) service_pool.cc:224] Handling call
0709 13:08:02.300263 (+2325434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.301066 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.302417 (+  1351us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b5400109350. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.302572 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5347311360}
W20260709 13:08:02.315574 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 102821us
I20260709 13:08:02.306764 19839 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.321167 16271 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:02.308871 19814 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.328774 19768 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:02.329334 19768 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.329521 19575 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:02.329833 19768 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.330279 19575 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:02.331535 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.331365 19575 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.335880 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.336519 16272 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.339110 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:02.307389 19897 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.343876 19605 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.344303 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2153) took 1919 ms. Trace:
I20260709 13:08:02.344563 19605 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:02.344725 15721 rpcz_store.cc:276] 0709 13:08:00.427111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.513530 (+ 86419us) service_pool.cc:224] Handling call
0709 13:08:00.543875 (+ 30345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.902203 (+358328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.343708 (+1441505us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540011bcd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:02.344097 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601835776}
I20260709 13:08:02.345841 19605 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.347026 19879 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.349119 19879 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.347467 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:02.351076 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:02.353194 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2151) took 1929 ms. Trace:
I20260709 13:08:02.353905 16275 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:02.355376 16275 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:02.353549 15720 rpcz_store.cc:276] 0709 13:08:00.423711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.423851 (+   140us) service_pool.cc:224] Handling call
0709 13:08:00.424209 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.628440 (+204231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.352802 (+1724362us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003bf1d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:02.353039 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391261568}
I20260709 13:08:02.349803 16274 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:02.364199 19813 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.365361 19813 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.365736 19813 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:02.366850 19813 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.368247 19813 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.374531 19845 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:02.374652 19901 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:02.376724 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:02.377470 19757 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.377930 19757 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.378466 19757 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.378319 19652 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:02.378731 19801 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.380012 19652 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.380442 19652 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.380836 19652 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.350250 19879 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.387776 19757 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.389479 19897 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.391865 19757 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.373793 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:02.377728 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:02.394704 19761 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:02.395345 19761 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:02.397377 19901 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:02.399891 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.400801 19901 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:02.414837 19796 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.435882 16272 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:02.402899 19897 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:02.445015 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:02.445971 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:02.470557 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.408594 19761 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.501964 19629 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.502461 19629 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:02.503412 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 56990.1us
I20260709 13:08:02.505957 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:02.505748 19629 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.507503 19629 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.507910 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:02.508757 19900 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.509411 19903 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:02.509545 19793 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:02.501062 19757 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:02.509917 19903 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.519317 19903 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.531442 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.773s (SENT) [suppressed 34 similar messages]
W20260709 13:08:02.532593 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.534577 19901 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:02.539876 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.551348 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 155872us
I20260709 13:08:02.552572 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:02.514312 19793 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:02.591593 19793 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.594957 19612 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.595511 19612 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:02.562357 19723 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.596410 19723 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.596892 19723 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.596709 19612 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:00.475597 15579 rpcz_store.cc:276] 0709 13:07:58.625381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.639330 (+ 13949us) service_pool.cc:224] Handling call
0709 13:07:58.639643 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.639862 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:58.932792 (+292930us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.406091 (+1473299us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.437515 (+ 31424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.437585 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.437654 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.437742 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.437882 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261569,"prepare.queue_time_us":350958,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":629883,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":20705,"spinlock_wait_cycles":61127936,"thread_start_us":1407091,"threads_started":3,"wal-append.queue_time_us":908822}
I20260709 13:08:02.567309 19768 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:02.509439 19900 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.517282 19796 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:08:02.580550 19879 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:02.560478 15654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 1987) took 3424 ms (client timeout 3261 ms). Trace:
W20260709 13:08:05.274271 15654 rpcz_store.cc:269] 0709 13:07:59.135871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.256829 (+120958us) service_pool.cc:224] Handling call
0709 13:08:02.560038 (+3303209us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400419e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.560227 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782077312}
I20260709 13:08:02.611951 19921 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.633915 19900 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.647846 19903 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:02.704985 19928 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.276752 19928 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:02.715287 19916 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.184s	user 0.004s	sys 0.000s
I20260709 13:08:05.277976 19903 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:05.278057 16236 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.746s	user 0.006s	sys 0.026s
W20260709 13:08:02.717593 19915 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:08:02.730080 19930 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:05.279731 19928 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:05.279536 19930 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:05.280395 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1063) took 3045 ms. Trace:
I20260709 13:08:05.281894 19930 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:02.778476 19934 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:05.282665 19934 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.285364 19934 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.770010 19932 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.286229 16236 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.754s	user 0.008s	sys 0.026s
W20260709 13:08:05.286692 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 2.75507e+06us
I20260709 13:08:05.286473 19932 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:05.288168 16236 connection.cc:256] RPC call timeout handler was delayed by -2.7490705390000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:08:05.289016 19932 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.797746 19935 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:08:02.806645 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:02.659240 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 813) took 2024 ms. Trace:
I20260709 13:08:02.885229 19936 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.792438 15575 rpcz_store.cc:276] 0709 13:08:00.636530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.636668 (+   138us) service_pool.cc:224] Handling call
0709 13:08:02.191621 (+1554953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.200531 (+  8910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.654951 (+454420us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540026cd50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.659164 (+  4213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3575138176}
I20260709 13:08:05.792929 19936 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:03.537760 19944 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:03.571367 19912 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.148s	user 0.000s	sys 0.014s
W20260709 13:08:05.201777 19942 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 2.312s	user 0.005s	sys 0.012s
W20260709 13:08:02.751611 19922 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260709 13:08:05.348954 19935 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.128907 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:05.352006 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 2.54545e+06us
W20260709 13:08:05.180776 15545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.355s	user 0.006s	sys 0.033s
W20260709 13:08:05.805236 15545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.979s	user 0.009s	sys 0.034s
W20260709 13:08:05.077935 15546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.207s	user 0.010s	sys 0.016s
W20260709 13:08:05.807871 15546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.937s	user 0.011s	sys 0.016s
W20260709 13:08:05.027415 15601 debug-util.cc:398] Leaking SignalData structure 0x7b080010d180 after lost signal to thread 14477
W20260709 13:08:05.811262 15601 debug-util.cc:398] Leaking SignalData structure 0x7b08001acde0 after lost signal to thread 15512
W20260709 13:08:05.812659 15601 debug-util.cc:398] Leaking SignalData structure 0x7b0800107160 after lost signal to thread 15604
W20260709 13:08:05.812914 15601 debug-util.cc:398] Leaking SignalData structure 0x7b0800107140 after lost signal to thread 15605
W20260709 13:08:05.192329 15618 connection.cc:256] RPC call timeout handler was delayed by -2.544229454999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:08:05.367085 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.060899 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.766718 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2439) took 1487 ms. Trace:
I20260709 13:08:05.825328 19829 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:05.825654 15649 rpcz_store.cc:276] 0709 13:08:01.278757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.637472 (+358715us) service_pool.cc:224] Handling call
0709 13:08:02.766463 (+1128991us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002e2554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:02.766621 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604149504}
I20260709 13:08:03.580919 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 1990) took 2299 ms. Trace:
W20260709 13:08:04.787250 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08000cda00 after lost signal to thread 14477
W20260709 13:08:03.536798 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.002s
W20260709 13:08:05.834857 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.808s	user 0.008s	sys 0.002s
I20260709 13:08:05.302956 15647 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:02.787259 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 243398us
I20260709 13:08:02.730329 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:02.729396 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:05.847144 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2432) took 4572 ms. Trace:
W20260709 13:08:05.847574 15725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2493) took 3123 ms (client timeout 1642 ms). Trace:
I20260709 13:08:05.847543 15647 rpcz_store.cc:276] 0709 13:08:01.274827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.274984 (+   157us) service_pool.cc:224] Handling call
0709 13:08:02.562381 (+1287397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.840580 (+3278199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.844163 (+  3583us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400419e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:05.844898 (+   735us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400419e50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:05.847064 (+  2166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9261224192}
W20260709 13:08:05.848357 15725 rpcz_store.cc:269] 0709 13:08:02.724253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.728955 (+  4702us) service_pool.cc:224] Handling call
0709 13:08:05.847458 (+3118503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.732363 15728 raft_consensus.cc:1240] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.851655 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2496) took 3125 ms. Trace:
I20260709 13:08:05.852135 15728 rpcz_store.cc:276] 0709 13:08:02.726407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.731750 (+  5343us) service_pool.cc:224] Handling call
0709 13:08:02.732131 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.851271 (+3119140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.851545 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:05.372043 16235 connection.cc:256] RPC call timeout handler was delayed by -1.6022988589999159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:08:05.856158 16235 connection.cc:256] RPC call timeout handler was delayed by -1.485610248999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:08:05.856528 16235 connection.cc:256] RPC call timeout handler was delayed by -1.3169212560000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3294s for a response
W20260709 13:08:05.353346 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64534.8us
I20260709 13:08:05.363005 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:05.860268 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:05.861095 16271 raft_consensus.cc:2410] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:05.456561 16273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1080) took 3054 ms. Trace:
W20260709 13:08:03.514330 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.575587 16272 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:05.880138 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1078) took 3579 ms. Trace:
I20260709 13:08:05.880607 16272 rpcz_store.cc:276] 0709 13:08:02.301196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.505295 (+204099us) service_pool.cc:224] Handling call
0709 13:08:02.539700 (+ 34405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.879783 (+3340083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.880064 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.162086 16278 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:05.887493 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1323) took 3764 ms. Trace:
I20260709 13:08:05.888020 16278 rpcz_store.cc:276] 0709 13:08:02.123093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.161215 (+3038122us) service_pool.cc:224] Handling call
0709 13:08:05.161601 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.886904 (+725303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.887409 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.578485 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1079) took 1176 ms. Trace:
I20260709 13:08:02.781360 16276 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:05.319885 16275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.821s	user 0.024s	sys 0.026s
I20260709 13:08:05.323810 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:05.890625 16277 rpcz_store.cc:276] 0709 13:08:02.401761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.200211 (+798450us) service_pool.cc:224] Handling call
0709 13:08:03.200691 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.201079 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.201104 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.507642 (+306538us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.578110 (+ 70468us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:03.578156 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.578233 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.578280 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:03.578287 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.578405 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":334810,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":69959,"threads_started":1,"wal-append.queue_time_us":61246,"wal-append.run_cpu_time_us":1987,"wal-append.run_wall_time_us":1003411}
I20260709 13:08:05.904069 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1332) took 2324 ms. Trace:
I20260709 13:08:05.904430 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1333) took 2324 ms. Trace:
I20260709 13:08:05.904404 16277 rpcz_store.cc:276] 0709 13:08:03.579697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.903337 (+2323640us) service_pool.cc:224] Handling call
0709 13:08:05.903615 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.903776 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.903805 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.903842 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:05.903871 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.903917 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.904017 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.904955 16274 rpcz_store.cc:276] 0709 13:08:03.579983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.903532 (+2323549us) service_pool.cc:224] Handling call
0709 13:08:05.903826 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.904004 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.904030 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.904073 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:05.904104 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.904275 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.904376 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.280809 16270 rpcz_store.cc:276] 0709 13:08:02.235007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.237478 (+  2471us) service_pool.cc:224] Handling call
0709 13:08:02.275701 (+ 38223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.358160 (+ 82459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.358195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.358735 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.495345 (+136610us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:02.495387 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.495468 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.714543 (+219075us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:05.280035 (+2565492us) raft_consensus.cc:1685] finished
0709 13:08:05.280062 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.280310 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8581,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":166284160,"thread_start_us":88604,"threads_started":1,"wal-append.queue_time_us":171672}
I20260709 13:08:05.906857 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1331) took 3322 ms. Trace:
I20260709 13:08:05.907286 16278 rpcz_store.cc:276] 0709 13:08:02.584079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.893015 (+3308936us) service_pool.cc:224] Handling call
0709 13:08:05.906302 (+ 13287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.906551 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.906575 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.906631 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:05.906666 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.906717 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.906805 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.907936 16270 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:05.908573 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1335) took 2328 ms. Trace:
I20260709 13:08:05.908802 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1336) took 2328 ms. Trace:
I20260709 13:08:05.245862 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1310) took 4547 ms. Trace:
I20260709 13:08:05.909262 16278 rpcz_store.cc:276] 0709 13:08:03.580716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.908117 (+2327401us) service_pool.cc:224] Handling call
0709 13:08:05.908366 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.908526 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.908549 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.908585 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.908617 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.908666 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.908753 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.908905 16270 rpcz_store.cc:276] 0709 13:08:03.580478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.907325 (+2326847us) service_pool.cc:224] Handling call
0709 13:08:05.907601 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.908336 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.908520 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.792687 19301 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.773041 19510 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.936681 19575 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:05.939159 19575 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.261794 19605 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:05.942950 19605 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:02.755393 19652 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.950016 15478 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 10, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 10 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.801678 19723 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:02.518549 19757 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:05.941711 19575 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:03.647017 19761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.054s	sys 0.018s
W20260709 13:08:05.959008 19761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.451s	user 0.054s	sys 0.022s
I20260709 13:08:05.110730 19768 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:05.969884 19768 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.970412 19768 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:05.972726 19816 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.973321 19816 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:05.241210 19779 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.848603 19780 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.979061 19780 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:03.011858 19785 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:05.983067 19785 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.984268 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.985999 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.986264 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:02.809746 19793 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:05.988907 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.990543 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.991781 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.338478 19794 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.748342 19813 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.043349 19794 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.044021 19813 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:06.045327 19813 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.046440 19813 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.046578 19794 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:06.014797 15579 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:06.049321 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:02.800704 19839 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:02.516201 19845 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:08:03.578787 19858 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.049985 15579 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.635622 19879 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:05.631589 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.123s	user 0.029s	sys 0.033s
W20260709 13:08:06.060496 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.552s	user 0.029s	sys 0.034s
W20260709 13:08:06.060854 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 3.55175e+06us
W20260709 13:08:05.656191 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 3.10347e+06us
I20260709 13:08:05.696095 19340 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.016026 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.063710 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.064415 15578 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.796402 19944 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.008212 19768 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:06.007575 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48501us
I20260709 13:08:06.067688 19944 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:05.795717 19936 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:05.814108 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:06.054404 19858 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:06.070068 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 256082us
I20260709 13:08:06.070900 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:05.816838 15601 debug-util.cc:398] Leaking SignalData structure 0x7b080040eec0 after lost signal to thread 15679
I20260709 13:08:06.023028 15574 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:08:06.072364 15601 debug-util.cc:398] Leaking SignalData structure 0x7b080035a4c0 after lost signal to thread 15753
W20260709 13:08:06.073751 15601 debug-util.cc:398] Leaking SignalData structure 0x7b080036eaa0 after lost signal to thread 16302
W20260709 13:08:05.820637 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.074290 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.826010 19829 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.828835 19953 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:05.830811 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc3c0 after lost signal to thread 15512
I20260709 13:08:05.828637 15653 rpcz_store.cc:276] 0709 13:08:01.281701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.811493 (+529792us) service_pool.cc:224] Handling call
0709 13:08:02.245578 (+434085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.251060 (+  5482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.580716 (+1329656us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540017c850. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:03.580852 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972281600}
I20260709 13:08:06.015750 15573 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:05.833536 19951 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.084290 19829 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.084458 19951 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:05.814888 19954 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:05.835866 19935 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:05.846233 15723 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.858876 16236 connection.cc:256] RPC call timeout handler was delayed by -2.6920147420000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:08:06.087781 16236 connection.cc:256] RPC call timeout handler was delayed by -2.6887705390000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:08:06.088131 16236 connection.cc:256] RPC call timeout handler was delayed by -2.6794147420000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:08:06.088532 16236 connection.cc:256] RPC call timeout handler was delayed by -2.6299147420000963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:08:06.088822 16236 connection.cc:256] RPC call timeout handler was delayed by -2.6221705390000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:08:06.089130 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.089478 16236 connection.cc:256] RPC call timeout handler was delayed by -2.5543147420000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:08:06.089759 16236 connection.cc:256] RPC call timeout handler was delayed by -2.5543147420000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:08:05.864746 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1082) took 3360 ms. Trace:
I20260709 13:08:05.870723 19959 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:05.873204 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57827.8us
I20260709 13:08:05.884191 19960 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:05.875272 16273 rpcz_store.cc:276] 0709 13:08:02.402953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.434493 (+3031540us) service_pool.cc:224] Handling call
0709 13:08:05.434910 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.435333 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.435364 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.435897 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.437080 (+  1183us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:05.437120 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.437188 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.456182 (+ 18994us) raft_consensus.cc:1685] finished
0709 13:08:05.456217 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.456441 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":125,"thread_start_us":760,"threads_started":1,"wal-append.queue_time_us":15230}
I20260709 13:08:05.899003 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 817) took 3791 ms. Trace:
I20260709 13:08:05.900254 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1330) took 3316 ms. Trace:
I20260709 13:08:05.900460 19952 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:05.902558 16275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.405s	user 0.026s	sys 0.026s
I20260709 13:08:06.094832 16272 rpcz_store.cc:276] 0709 13:08:02.583722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.885744 (+3302022us) service_pool.cc:224] Handling call
0709 13:08:05.899772 (+ 14028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.899944 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.899968 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.900006 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:05.900035 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.900088 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.900185 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.710451 19456 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.142295 19858 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.142529 19456 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.144164 15721 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:06.145490 19456 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:02.600953 19612 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.146436 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2495) took 3421 ms. Trace:
I20260709 13:08:06.146809 15721 rpcz_store.cc:276] 0709 13:08:02.725486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.811155 (+ 85669us) service_pool.cc:224] Handling call
0709 13:08:02.811469 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.144509 (+3333040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.146215 (+  1706us) spinlock_profiling.cc:243] Waited 3.33 s on lock 0x7b540004a454. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:06.146380 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7663724928}
I20260709 13:08:05.909873 16269 rpcz_store.cc:276] 0709 13:08:00.698622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.700502 (+  1880us) service_pool.cc:224] Handling call
0709 13:08:00.700785 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.910306 (+209521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.910353 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.910409 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.910454 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.245353 (+4334899us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400690d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:05.245428 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.245651 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481330944}
I20260709 13:08:05.919310 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1334) took 2339 ms. Trace:
I20260709 13:08:06.150648 16277 rpcz_store.cc:276] 0709 13:08:03.580228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.905603 (+2325375us) service_pool.cc:224] Handling call
0709 13:08:05.905871 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.918310 (+ 12439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.918337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.919035 (+   698us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:05.919073 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.919130 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.919257 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.928174 16278 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:05.929302 19301 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:05.934468 19956 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:05.955754 19723 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:05.955935 19575 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:06.154636 19575 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.155782 19301 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.157331 19575 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:05.956370 19605 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:05.955842 19757 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.158490 19757 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:06.160552 15723 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
W20260709 13:08:06.161106 15723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2494) took 3436 ms (client timeout 1947 ms). Trace:
I20260709 13:08:06.161186 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:06.161448 15723 rpcz_store.cc:269] 0709 13:08:02.724984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.729955 (+  4971us) service_pool.cc:224] Handling call
0709 13:08:06.161039 (+3431084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:05.963496 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.163164 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.163806 15577 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:06.164634 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.963802 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.165644 19301 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:06.167172 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.168335 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.169371 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:05.963466 15478 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 3 to 5, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 5 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.967651 19761 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.968230 15693 connection.cc:256] RPC call timeout handler was delayed by -2.1295954729999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:08:05.962459 19962 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.986897 15572 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:05.981711 19780 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.006361 19958 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:06.024900 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:05.993070 19785 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.029500 19652 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.178915 19794 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.062101 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:06.179549 19794 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:06.180091 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 118151us
W20260709 13:08:06.075605 15601 debug-util.cc:398] Leaking SignalData structure 0x7b08003db400 after lost signal to thread 19612
I20260709 13:08:06.181761 19794 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:06.182286 15601 debug-util.cc:398] Leaking SignalData structure 0x7b08003a00a0 after lost signal to thread 19788
I20260709 13:08:06.181787 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:06.183022 15601 debug-util.cc:398] Leaking SignalData structure 0x7b0800350800 after lost signal to thread 19865
I20260709 13:08:06.183936 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:06.184808 19964 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.077042 15578 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:06.080476 15676 debug-util.cc:398] Leaking SignalData structure 0x7b0800373880 after lost signal to thread 15604
W20260709 13:08:06.186239 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08003701c0 after lost signal to thread 15605
I20260709 13:08:06.185904 19964 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:06.187381 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0f00 after lost signal to thread 15679
I20260709 13:08:06.051334 19816 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.187557 19575 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.083106 19955 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.083608 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:06.188192 19955 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:06.082270 15475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 370) took 21348 ms (client timeout 15000 ms). Trace:
I20260709 13:08:06.188634 19955 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.188755 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 105272us
I20260709 13:08:06.189143 19958 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.189709 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:06.191476 19958 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.090442 16271 rpcz_store.cc:276] 0709 13:08:02.504803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.861762 (+3356959us) service_pool.cc:224] Handling call
0709 13:08:05.864211 (+  2449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.864388 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.864412 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.864456 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:05.864492 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.864544 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.864680 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.192478 19761 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.192902 19936 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:06.092265 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.194367 19962 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:06.195048 15618 connection.cc:256] RPC call timeout handler was delayed by -2.4588678190000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:08:06.195425 15618 connection.cc:256] RPC call timeout handler was delayed by -2.4380294549999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:08:06.196170 15618 connection.cc:256] RPC call timeout handler was delayed by -2.2862995100000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:08:06.196671 15618 connection.cc:256] RPC call timeout handler was delayed by -2.1932294549999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:08:06.197103 15618 connection.cc:256] RPC call timeout handler was delayed by -1.9727294549999215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 13:08:06.095671 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1075) took 3795 ms. Trace:
I20260709 13:08:06.022311 19919 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.093953 16276 rpcz_store.cc:276] 0709 13:08:02.107570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.780644 (+673074us) service_pool.cc:224] Handling call
0709 13:08:02.781081 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.898637 (+3117556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.898925 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.098271 19965 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:06.100039 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.198217 19780 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:06.197898 19919 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.198314 19965 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.198942 19780 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.199339 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.200479 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.200683 19965 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.201041 19780 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.102623 15649 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:06.201581 19919 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.197229 19340 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:06.106106 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.202471 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.107242 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.103495 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.108637 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.203372 15654 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.203588 15651 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:06.204886 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.110046 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.206841 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.206643 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.207908 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.208552 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.112095 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.120206 19959 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.120085 19696 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.121361 19802 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:06.122200 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.122355 19951 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.197945 15571 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:06.210311 19340 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.211292 16275 rpcz_store.cc:276] 0709 13:08:02.300271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.355966 (+ 55695us) service_pool.cc:224] Handling call
0709 13:08:02.356259 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.362616 (+  6357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.362651 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.422797 (+ 60146us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.095190 (+3672393us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:06.095250 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.095370 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.095427 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:06.095444 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.095600 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4548,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":20353,"spinlock_wait_cycles":7424,"thread_start_us":3597599,"threads_started":1,"wal-append.queue_time_us":190066,"wal-append.run_cpu_time_us":2026,"wal-append.run_wall_time_us":1002146}
I20260709 13:08:06.119148 19829 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.122718 19879 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.213359 19829 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.213531 19879 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.123147 19839 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.215484 19839 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:06.215893 19839 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.210011 15651 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.218079 19696 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.218794 19761 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.124823 19822 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.202010 15475 rpcz_store.cc:269] 0709 13:07:44.734080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.734297 (+   217us) service_pool.cc:224] Handling call
0709 13:08:06.081946 (+21347649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:58.484489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:58.485154 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:58.485208 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:58.485233 (+    25us) tablet.cc:662] Decoding operations
0709 13:07:58.488076 (+  2843us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:58.488180 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:58.488223 (+    43us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:07:58.805485 (+317262us) tablet.cc:701] Row locks acquired
0709 13:07:58.805542 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:07:58.805755 (+   213us) write_op.cc:270] Start()
0709 13:07:58.805897 (+   142us) write_op.cc:276] Timestamp: P: 1783602478805664 usec, L: 0
0709 13:07:58.805922 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:58.883036 (+ 77114us) log.cc:844] Serialized 9925 byte log entry
0709 13:07:59.845197 (+962161us) op_driver.cc:464] REPLICATION: finished
0709 13:07:59.965353 (+120156us) write_op.cc:301] APPLY: starting
0709 13:07:59.965459 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:00.688738 (+723279us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:00.688900 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:01.307821 (+618921us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:01.308282 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:08:01.308329 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:01.308878 (+   549us) log.cc:844] Serialized 220 byte log entry
0709 13:08:01.390939 (+ 82061us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.391186 (+   247us) write_op.cc:454] Released schema lock
0709 13:08:01.391277 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:01.391824 (+   547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.391868 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":368,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":119824,"apply.run_cpu_time_us":62549,"apply.run_wall_time_us":1426411,"cfile_cache_hit":98,"cfile_cache_hit_bytes":102410,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":1,"lbm_read_time_us":887,"lbm_reads_lt_1ms":8,"num_ops":25,"prepare.queue_time_us":181755,"prepare.run_cpu_time_us":9211,"prepare.run_wall_time_us":398879,"replication_time_us":1039049,"thread_start_us":336956,"threads_started":3,"wal-append.queue_time_us":82136,"wal-append.run_cpu_time_us":1531,"wal-append.run_wall_time_us":1033806}]]}
I20260709 13:08:06.221257 19822 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:06.188548 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08003f40a0 after lost signal to thread 15753
I20260709 13:08:06.124960 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:06.223217 15676 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4b20 after lost signal to thread 16302
I20260709 13:08:06.125308 19949 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:06.224080 19949 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.225585 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:06.092046 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 133712us
I20260709 13:08:06.128840 19953 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.129515 19960 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.135583 19935 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.231215 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.136617 19967 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:06.232347 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.232903 15578 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:06.232725 19967 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.152428 19830 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.234333 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.234470 19830 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.169946 15575 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.235646 19822 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.236011 19960 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:06.236354 19696 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.236650 19829 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:06.174437 15693 connection.cc:256] RPC call timeout handler was delayed by -2.0998954730000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:08:06.238318 15693 connection.cc:256] RPC call timeout handler was delayed by -2.024295473000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
I20260709 13:08:06.238538 19949 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:06.238670 15693 connection.cc:256] RPC call timeout handler was delayed by -2.0116954730000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:08:06.239109 15693 connection.cc:256] RPC call timeout handler was delayed by -1.8478954729999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:08:06.239436 15693 connection.cc:256] RPC call timeout handler was delayed by -1.8064954730000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:08:06.239193 19949 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:06.239748 15693 connection.cc:256] RPC call timeout handler was delayed by -1.7236954730000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:08:06.240084 15693 connection.cc:256] RPC call timeout handler was delayed by -1.6849954730000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:08:06.240347 15693 connection.cc:256] RPC call timeout handler was delayed by -1.518996348000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 13:08:06.240904 19830 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:06.179145 16236 connection.cc:256] RPC call timeout handler was delayed by -2.3935705390000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:08:06.186249 19605 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.241302 19949 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:06.241604 16236 connection.cc:256] RPC call timeout handler was delayed by -2.3935705390000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:08:06.241734 19879 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.241967 19605 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:06.242017 16236 connection.cc:256] RPC call timeout handler was delayed by -2.3413705390000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:08:06.191511 19793 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:06.197302 19962 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.197736 19723 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:06.201267 15653 raft_consensus.cc:2410] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:06.101347 15647 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:06.202121 19919 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.204448 15478 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 5 to 7, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 7 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.111330 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.262748 15655 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.107985 15579 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:06.262655 15654 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:06.208971 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.120083 19954 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.211160 15574 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.223707 15676 debug-util.cc:398] Leaking SignalData structure 0x7b080034c600 after lost signal to thread 19612
W20260709 13:08:06.197453 15618 connection.cc:256] RPC call timeout handler was delayed by -1.7202162869999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:08:06.229627 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.230232 19858 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.268478 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.268791 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.269356 19858 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:06.269958 19858 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:06.270586 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.271004 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.270880 19858 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.271690 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.157768 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1337) took 2576 ms. Trace:
I20260709 13:08:06.272181 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.272763 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.273378 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:06.243613 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51865.1us
I20260709 13:08:06.253783 15648 raft_consensus.cc:2410] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:06.274516 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:06.274713 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:06.242770 16236 connection.cc:256] RPC call timeout handler was delayed by -2.3413705390000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:08:06.275419 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.253798 19967 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.275837 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.276245 15648 raft_consensus.cc:2410] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:06.276554 15652 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:06.276508 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:06.256218 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.277339 15648 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:06.253474 19605 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.279935 15574 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:06.281672 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.244041 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.258132 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.282181 15574 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.282492 15572 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.252933 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:06.272184 19858 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.283416 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.284053 15693 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:06.230347 19959 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.242671 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.242699 19761 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.288596 19761 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:06.288964 19761 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:06.289806 19761 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:06.265185 15676 debug-util.cc:398] Leaking SignalData structure 0x7b0800325f40 after lost signal to thread 19757
I20260709 13:08:06.264976 15575 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:06.296046 15676 debug-util.cc:398] Leaking SignalData structure 0x7b0800408540 after lost signal to thread 19845
I20260709 13:08:06.296741 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.266799 15651 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:06.264747 19301 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.267500 19723 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.269403 15647 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:06.273465 15573 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:06.272324 16274 rpcz_store.cc:276] 0709 13:08:03.580952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.915628 (+2334676us) service_pool.cc:224] Handling call
0709 13:08:05.916240 (+   612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.070378 (+154138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.070406 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.070903 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.128958 (+ 58055us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:06.129001 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.157233 (+ 28232us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400631ad4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:06.157318 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.157383 (+    65us) raft_consensus.cc:1685] finished
0709 13:08:06.157404 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.157690 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27610,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":138,"spinlock_wait_cycles":353674624,"thread_start_us":57706,"threads_started":1,"wal-append.queue_time_us":61383}
I20260709 13:08:06.081173 15619 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:06.234946 16275 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
W20260709 13:08:06.275513 16236 connection.cc:256] RPC call timeout handler was delayed by -2.3035705390000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:08:06.305773 16236 connection.cc:256] RPC call timeout handler was delayed by -2.2765705390000903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:08:06.252981 15649 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:06.280140 15648 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.280373 19954 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.188736 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:06.316087 16236 connection.cc:256] RPC call timeout handler was delayed by -1.8272861929999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:08:06.316602 16236 connection.cc:256] RPC call timeout handler was delayed by -1.6467181740000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:08:06.316886 16236 connection.cc:256] RPC call timeout handler was delayed by -1.62658619299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:08:06.317195 16236 connection.cc:256] RPC call timeout handler was delayed by -1.5767562199999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:08:06.317555 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4978861929999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:08:06.317873 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4978861929999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:08:06.318173 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4752891910000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:08:06.318449 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3808861930000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:08:06.318684 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3808861930000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:08:06.318921 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3634401440000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:08:06.319149 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3268790370001398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:08:06.319381 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3128058130000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:08:06.319607 16236 connection.cc:256] RPC call timeout handler was delayed by -1.2223023470000953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:08:06.319837 16236 connection.cc:256] RPC call timeout handler was delayed by -1.1906342880000693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23140000000000002s for a response
I20260709 13:08:06.230309 19953 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.269730 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.267431 19919 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.287137 19959 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.286705 15478 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 6 to 9, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 9 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.285939 19793 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:06.287835 19967 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.290961 15655 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:06.292032 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:06.264991 15618 connection.cc:256] RPC call timeout handler was delayed by -1.6381327959999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:08:06.333508 15618 connection.cc:256] RPC call timeout handler was delayed by -1.6232849069999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:08:06.333962 15618 connection.cc:256] RPC call timeout handler was delayed by -1.3089162869999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:08:06.333140 15478 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:06.334347 15618 connection.cc:256] RPC call timeout handler was delayed by -1.2932137650000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:08:06.334774 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1891995099999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29100000000000004s for a response
W20260709 13:08:06.335148 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1476097559999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:08:06.335500 15618 connection.cc:256] RPC call timeout handler was delayed by -1.1360995100000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2969s for a response
I20260709 13:08:06.277769 15652 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.287459 15544 leader_election.cc:400] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
I20260709 13:08:06.336148 15544 leader_election.cc:403] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.294874 15572 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:06.297866 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.299073 15654 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:06.264336 19955 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:06.310829 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 229718us
I20260709 13:08:06.311028 15651 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.311510 19757 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:06.312812 19723 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.364702 15575 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.313333 15650 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:06.314260 19612 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.315008 19761 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.277369 15653 raft_consensus.cc:606] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:06.368018 15653 raft_consensus.cc:614] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:06.368389 15646 raft_consensus.cc:2410] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:08:06.317221 15578 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:06.328326 15574 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:08:06.347568 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.351588 19340 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:06.354269 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 165607us
I20260709 13:08:06.354779 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.356765 19955 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.357239 15580 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:06.358891 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:06.362149 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78165.4us
I20260709 13:08:06.328898 19959 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.365114 15648 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:06.347230 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:06.329114 19970 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:06.336282 19960 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.381703 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.383481 15652 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:06.383896 15478 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.386376 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.382959 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.320452 19839 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.385353 19949 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.399572 19949 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:06.399679 15572 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.388113 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.388264 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.389257 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.402258 15575 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:06.388545 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:06.388782 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.389437 15655 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:06.389307 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 102098us
I20260709 13:08:06.390583 16271 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:06.388796 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:06.383087 19612 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:06.392473 19919 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.414513 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.392709 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.393682 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.393712 19967 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
I20260709 13:08:06.394518 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:06.394948 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.395612 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.395731 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.358927 19793 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.396919 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.416973 16277 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:06.397341 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:06.398312 19970 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.386632 15652 pending_rounds.cc:85] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 8
I20260709 13:08:06.419678 15652 pending_rounds.cc:107] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:06.419996 15652 raft_consensus.cc:2889] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.417922 15571 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.406663 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.416420 16278 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:06.418116 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.383296 19959 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.423059 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.433450 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.435914 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.436237 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:08:06.438616 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:06.439497 15653 raft_consensus.cc:606] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:06.432626 15478 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.414619 19723 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.442657 15728 raft_consensus.cc:1240] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.442576 19723 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:06.445626 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57148us
W20260709 13:08:06.463593 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.584409 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.595781 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:06.419317 19605 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:06.596673 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 207937us
I20260709 13:08:06.583742 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:06.580960 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 141153us
I20260709 13:08:06.584544 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.406410 19949 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.445487 19723 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.579841 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.585161 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:06.494092 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.606856 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.617242 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.617599 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.618062 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.438679 19965 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:06.617919 15575 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:06.612666 15725 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.614743 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.623448 15721 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.414934 19340 consensus_queue.cc:1059] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 13:08:06.611557 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:06.665161 15572 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:08:06.414405 19858 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.181s
I20260709 13:08:06.624673 15578 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:06.624599 15478 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 7, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:06.639570 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 245122us
I20260709 13:08:06.668535 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:06.662948 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.669669 15726 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.663653 15575 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.679291 15579 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.686165 15577 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:06.686663 15728 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:06.687057 15728 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:06.687477 15720 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.601847 19919 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.696071 15572 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:06.697218 15579 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:06.611487 19456 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.702200 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.705001 15729 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.623220 19965 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:06.610380 19956 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:08:06.702229 15728 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:06.718822 15576 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:06.719574 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51162.7us
I20260709 13:08:06.723141 15728 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:06.727231 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 114155us
W20260709 13:08:06.728252 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 113205us
I20260709 13:08:06.726295 15478 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 6 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.681138 19794 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:06.734192 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.707769 19965 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:06.777772 15653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:06.779130 15653 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:06.780227 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51169.1us
I20260709 13:08:06.781025 15478 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.734333 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:06.786748 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.787503 15655 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:06.788105 15727 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.788741 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.789299 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.789530 15650 raft_consensus.cc:2393] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:06.789901 15727 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 6.
I20260709 13:08:06.790567 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.790882 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.792212 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.792933 15727 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:06.793624 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.795173 19970 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:06.796121 19976 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:08:06.804554 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.805486 15652 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
W20260709 13:08:06.778717 19973 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:08:06.807363 19936 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:06.808108 19936 consensus_queue.cc:1243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:06.703091 19919 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.808682 19936 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:06.809037 19936 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:06.810496 19919 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:06.809875 19936 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.810748 19757 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:06.811401 19757 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:06.725528 19954 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:08:06.812431 19723 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:06.812309 19757 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:06.783644 19971 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:06.812848 19723 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:06.787418 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000db680 after lost signal to thread 14477
W20260709 13:08:06.815048 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc8a0 after lost signal to thread 15512
W20260709 13:08:06.816695 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800310680 after lost signal to thread 15604
W20260709 13:08:06.817049 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800308180 after lost signal to thread 15605
W20260709 13:08:06.817909 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000820a0 after lost signal to thread 15649
W20260709 13:08:06.820757 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800081b40 after lost signal to thread 15679
W20260709 13:08:06.821156 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1ee0 after lost signal to thread 15692
W20260709 13:08:06.821453 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800081e80 after lost signal to thread 15693
W20260709 13:08:06.821730 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800081e00 after lost signal to thread 15695
I20260709 13:08:06.822703 15571 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:06.738643 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:06.825610 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd600 after lost signal to thread 15723
W20260709 13:08:06.826014 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce8c0 after lost signal to thread 15725
W20260709 13:08:06.826377 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce540 after lost signal to thread 15728
W20260709 13:08:06.827047 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd260 after lost signal to thread 15753
I20260709 13:08:06.823930 15727 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:08:06.831197 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:06.833958 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa80 after lost signal to thread 16237
W20260709 13:08:06.836580 15544 connection.cc:256] RPC call timeout handler was delayed by -2.5804602549999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:08:06.837162 15544 connection.cc:256] RPC call timeout handler was delayed by -2.3059602549999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:08:06.841038 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800335300 after lost signal to thread 16272
W20260709 13:08:06.841533 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08004185a0 after lost signal to thread 16276
W20260709 13:08:06.841827 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080039af00 after lost signal to thread 16277
I20260709 13:08:06.843629 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:06.723366 19858 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:06.726917 19839 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:06.870792 15728 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:08:06.846359 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800361d00 after lost signal to thread 16302
I20260709 13:08:06.830739 19936 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.848472 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.881795 15651 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:06.849165 15478 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:06.871827 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003e99a0 after lost signal to thread 19301
W20260709 13:08:06.885744 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080030d0a0 after lost signal to thread 19456
W20260709 13:08:06.886071 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000a73e0 after lost signal to thread 19510
W20260709 13:08:06.886317 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800390060 after lost signal to thread 19575
W20260709 13:08:06.886605 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08001b46e0 after lost signal to thread 19612
W20260709 13:08:06.886917 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800320380 after lost signal to thread 19652
I20260709 13:08:06.715591 19612 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:06.891144 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.871384 15728 pending_rounds.cc:85] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:06.900548 15728 pending_rounds.cc:107] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:06.900995 15728 raft_consensus.cc:2889] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:06.893606 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1f80 after lost signal to thread 19723
I20260709 13:08:06.909500 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:06.903403 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.905416 15652 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:06.736685 19456 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:08:06.894197 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:06.928388 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080028f3c0 after lost signal to thread 19757
W20260709 13:08:06.945168 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2520 after lost signal to thread 19761
I20260709 13:08:06.843096 15580 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.945349 15648 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:06.857764 19858 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:06.942688 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.953958 15654 raft_consensus.cc:2368] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
I20260709 13:08:06.943979 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:06.954903 15655 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.945533 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003680c0 after lost signal to thread 19780
W20260709 13:08:06.956911 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1380 after lost signal to thread 19785
W20260709 13:08:06.957211 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080035f420 after lost signal to thread 19793
W20260709 13:08:06.957583 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9720 after lost signal to thread 19813
W20260709 13:08:06.957973 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1e00 after lost signal to thread 19839
W20260709 13:08:06.958274 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800339860 after lost signal to thread 19845
W20260709 13:08:06.958583 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800284b40 after lost signal to thread 19858
W20260709 13:08:06.958904 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080038d140 after lost signal to thread 19879
I20260709 13:08:06.963799 15478 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:06.965438 15720 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:06.969178 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.963244 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.970593 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.973490 15650 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:06.974371 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:06.975078 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:06.975975 15728 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:06.976626 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 133083us
I20260709 13:08:06.979012 15651 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:08:06.975096 15646 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:08:06.978124 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:07.009433 15655 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
W20260709 13:08:07.013144 15618 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.007s
W20260709 13:08:07.013904 15618 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.008s
W20260709 13:08:07.014400 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 599803us
I20260709 13:08:07.020198 15655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:07.020661 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.021368 15655 raft_consensus.cc:606] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.021919 15655 raft_consensus.cc:614] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.011731 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.021549 15727 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:07.029098 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.030452 15728 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
W20260709 13:08:07.039429 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.989594 19984 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:08:07.041917 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 63916.4us
I20260709 13:08:07.045179 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:07.051973 15478 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.070946 15478 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 1 to 4, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 4 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.075517 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.075946 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.011294 19879 consensus_queue.cc:1059] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:08:07.078944 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.051223 19935 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.051120 19813 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.080173 19987 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:07.080768 19793 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:07.090519 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.091857 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.096760 15726 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:07.076388 15727 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:07.119138 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:07.121448 16272 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:07.043820 19953 consensus_queue.cc:1059] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:08:07.129580 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:07.044183 19952 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:08:07.133383 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.135278 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.130301 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:07.137111 15653 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:07.144289 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.123420 19987 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.119059 19956 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:07.131067 19761 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.003s
W20260709 13:08:07.166621 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.120857 19960 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.153025 15652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:07.135080 19879 raft_consensus.cc:3055] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:07.174158 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.062881 19858 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.139220 19985 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:07.194576 15723 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:07.143407 19935 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:07.152400 19813 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.154982 19987 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:07.136431 19955 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:08:07.203305 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.185585 19879 raft_consensus.cc:740] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:07.216606 19952 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:07.222455 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.195984 19793 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.207702 19858 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.227486 15725 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:08:07.196319 19985 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:07.201874 19813 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.232637 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 392791us
W20260709 13:08:07.234913 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 500624us
I20260709 13:08:07.227609 19996 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.256829 15725 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
W20260709 13:08:07.254539 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 110289us
I20260709 13:08:07.208199 19761 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.288481 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 770) took 1156 ms. Trace:
I20260709 13:08:07.263556 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.275568 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.295442 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.226740 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 488135us
I20260709 13:08:07.253125 19839 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:07.253791 19959 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.004s
I20260709 13:08:07.287283 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:07.301548 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 436397us
I20260709 13:08:07.308691 19959 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.308843 19935 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.311177 19959 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:07.311872 19959 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.312413 19959 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.288996 15647 rpcz_store.cc:276] 0709 13:08:06.115502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.314111 (+198609us) service_pool.cc:224] Handling call
0709 13:08:06.314504 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.314857 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.314889 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.315391 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.609780 (+294389us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.059855 (+450075us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.271229 (+211374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.271319 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.271358 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:07.271368 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.271480 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":592881,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":69531,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":17177,"thread_start_us":900919,"threads_started":3,"wal-append.queue_time_us":406931}
I20260709 13:08:07.314852 19959 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:07.315537 19959 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.316782 15724 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:07.316700 19959 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.317268 19959 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:07.318720 19879 consensus_queue.cc:260] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.320097 19879 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:07.322636 19995 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:08:07.327440 19989 log.cc:927] Time spent T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.001s
I20260709 13:08:07.331077 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.318625 19959 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.317174 20000 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:07.285161 15721 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 13:08:07.345352 15721 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:07.284667 15729 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:08:07.306427 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:07.270817 19985 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:07.280910 19813 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.341452 15726 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:08:07.271384 19794 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:07.346292 15729 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:07.350464 16271 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:07.348465 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 306882us
I20260709 13:08:07.359380 15571 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.363929 15572 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.367514 15729 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:07.346001 19951 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:07.390698 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 94146.2us
I20260709 13:08:07.392283 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.398010 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 855) took 1134 ms. Trace:
I20260709 13:08:07.398491 15573 rpcz_store.cc:276] 0709 13:08:06.253996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.623878 (+369882us) service_pool.cc:224] Handling call
0709 13:08:06.685334 (+ 61456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.706933 (+ 21599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.706963 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.720728 (+ 13765us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.113077 (+392349us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.113127 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.113194 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.385731 (+272537us) raft_consensus.cc:1685] finished
0709 13:08:07.385754 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.388531 (+  2777us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107177,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":282243,"threads_started":1,"wal-append.queue_time_us":478532}
I20260709 13:08:07.364920 19794 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:07.345235 19998 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:07.301034 19996 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.443687 19998 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.448745 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1931) took 1436 ms. Trace:
I20260709 13:08:07.449312 15580 rpcz_store.cc:276] 0709 13:08:06.012689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.618820 (+606131us) service_pool.cc:224] Handling call
0709 13:08:06.696995 (+ 78175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.725902 (+ 28907us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:06.983461 (+257559us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.309303 (+325842us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.338965 (+ 29662us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.350217 (+ 11252us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.350366 (+   149us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.350400 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.350468 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.448488 (+ 98020us) raft_consensus.cc:1685] finished
0709 13:08:07.448509 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.448667 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37366,"prepare.queue_time_us":45098,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":90953,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":15433,"thread_start_us":264545,"threads_started":1,"wal-append.queue_time_us":383809}
I20260709 13:08:07.391455 19951 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.452203 19951 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:07.456147 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.404215 20003 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:07.374193 19723 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.460767 19723 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:07.464318 19996 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:07.400427 19955 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.465452 19955 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.478327 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72307us
I20260709 13:08:07.491508 15619 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:07.478081 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 92661.7us
I20260709 13:08:07.465946 19955 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:07.478789 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 147776us
I20260709 13:08:07.529186 15544 leader_election.cc:400] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
I20260709 13:08:07.529780 15544 leader_election.cc:403] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:08:07.516469 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.515834 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.427778 19959 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.538630 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.544205 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.545994 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 152583us
I20260709 13:08:07.546859 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:07.546690 19952 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:07.546125 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.401005 19605 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:08:07.506310 20003 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:07.562621 15727 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.563467 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.563963 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 232448us
W20260709 13:08:07.567107 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 269485us
I20260709 13:08:07.573107 19757 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.574277 19456 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:07.574129 20013 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:07.575024 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.575153 20013 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.575697 20013 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:07.576321 19757 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.576799 19757 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:07.577301 19757 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.580199 19956 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.580669 19956 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:07.582839 19992 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:07.584125 19992 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.585613 19992 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.543743 20012 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.549449 20000 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:07.595120 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.614352 15723 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:07.607653 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.615293 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.615702 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.570075 20005 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:07.574724 19456 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:07.548859 19612 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:08:07.568732 19998 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:08:07.592696 19996 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.631665 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.631088 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93571.6us
I20260709 13:08:07.671381 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.587234 19963 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:07.672964 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:07.675002 15721 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:08:07.595741 19952 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:07.678668 19936 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.777s	user 0.007s	sys 0.003s
I20260709 13:08:07.574126 19340 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:07.681902 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 118119us
I20260709 13:08:07.625177 20005 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.586004 19992 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:07.686569 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:07.596184 19953 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:08:07.693926 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.581588 19956 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.683754 19952 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:07.576607 20013 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.690093 20005 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:07.738529 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.739692 19612 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:07.742767 20018 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:08:07.744478 19970 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.605432 19794 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.680124 19963 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:07.687147 19996 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:07.731786 19340 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:07.750388 16236 leader_election.cc:336] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.548s (SENT)
I20260709 13:08:07.782692 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.778059 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.783412 15655 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:07.783743 15647 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:07.694417 20023 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:08:07.785014 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.758273 19612 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.805042 19612 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:07.806473 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.809244 19949 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.130s	user 0.008s	sys 0.002s
I20260709 13:08:07.814920 15652 raft_consensus.cc:606] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:07.815519 15652 raft_consensus.cc:614] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:07.816500 19858 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.000s
W20260709 13:08:07.819227 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.788792 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.791054 19990 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:07.825538 15653 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:08:07.791841 20001 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:08:07.791771 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2191) took 1084 ms. Trace:
W20260709 13:08:07.793049 20021 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:08:07.829170 15720 rpcz_store.cc:276] 0709 13:08:06.707510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.288890 (+581380us) service_pool.cc:224] Handling call
0709 13:08:07.347076 (+ 58186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.374016 (+ 26940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.374202 (+   186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.374849 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.539917 (+165068us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.539963 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.540032 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.791512 (+251480us) raft_consensus.cc:1685] finished
0709 13:08:07.791534 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.791697 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11224,"raft.queue_time_us":26686,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":5316,"thread_start_us":85521,"threads_started":1,"wal-append.queue_time_us":319692}
I20260709 13:08:07.786782 19952 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.797644 19794 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.797533 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.843374 15646 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:07.785580 19956 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.785712 20028 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.759918 19301 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:08:07.733299 20003 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.774204 19970 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:07.779409 20000 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:07.826745 15722 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:07.778219 20013 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.837883 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.809695 19949 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.844470 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.731127 19456 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.787707 19340 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:07.835187 20018 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:07.852110 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:07.852370 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2501) took 1065 ms. Trace:
W20260709 13:08:07.852666 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 167869us
I20260709 13:08:07.844008 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:07.825929 19990 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:07.815667 19757 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:07.853835 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:07.849218 20028 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.856047 15723 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:08:07.866075 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.868544 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 258594us
I20260709 13:08:07.870810 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:07.867558 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:07.874902 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:07.875526 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.876085 15722 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:08:07.876132 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.782151 19992 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.884598 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 857) took 1581 ms. Trace:
I20260709 13:08:07.884883 15578 rpcz_store.cc:276] 0709 13:08:06.302860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.666979 (+364119us) service_pool.cc:224] Handling call
0709 13:08:06.667400 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.839305 (+171905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.839352 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.849850 (+ 10498us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.249649 (+399799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:07.249699 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.249779 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.884451 (+634672us) raft_consensus.cc:1685] finished
0709 13:08:07.884465 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.884552 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23298,"raft.queue_time_us":112379,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3789,"thread_start_us":412520,"threads_started":2,"wal-append.queue_time_us":445550}
I20260709 13:08:07.891067 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.891775 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:07.894879 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 208377us
W20260709 13:08:07.895015 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.880182 19985 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:08:07.897846 15619 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.874401 20028 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.905036 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.886533 19456 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.917605 15654 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.911593 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.888911 19954 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.919214 20027 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.939393 20027 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:07.939860 20027 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.919155 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.919529 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.943269 15652 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:08:07.906272 19955 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.920257 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:07.918439 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:07.875798 20033 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:07.877552 20032 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:07.924896 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 192673us
I20260709 13:08:07.930243 19761 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.931159 20012 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12.
W20260709 13:08:07.932224 19965 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.088s	user 0.004s	sys 0.008s
W20260709 13:08:07.935061 20015 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:08:07.938781 19987 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.710s	user 0.003s	sys 0.007s
I20260709 13:08:07.926899 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:07.941782 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2457) took 1102 ms. Trace:
I20260709 13:08:07.913870 15721 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:08.002992 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.004264 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.004917 15721 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:08.005923 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.006361 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:08.007058 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.007508 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.861181 15725 rpcz_store.cc:276] 0709 13:08:06.787377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.299337 (+511960us) service_pool.cc:224] Handling call
0709 13:08:07.299705 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.299953 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:07.306091 (+  6138us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.730512 (+424421us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b1800365da0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:08:07.851452 (+120940us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.852004 (+   552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.852054 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:07.852100 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.852167 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.852299 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5829,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":2908,"raft.queue_time_us":3813,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4530,"spinlock_wait_cycles":88664192,"thread_start_us":117799,"threads_started":1}
I20260709 13:08:08.008213 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.008636 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.008926 15721 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:08.009227 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.950217 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.009851 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.010418 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.010768 15721 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:08.011080 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:07.959527 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:08.012244 15729 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:08:08.012825 15729 pending_rounds.cc:85] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
I20260709 13:08:08.013132 15729 pending_rounds.cc:107] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:08:08.013456 15729 raft_consensus.cc:2889] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.999097 15572 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:08:07.999465 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.023711 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.991411 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.024626 19992 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:07.999899 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75475.6us
I20260709 13:08:07.945662 19757 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:08.000589 20030 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.960778 15649 rpcz_store.cc:276] 0709 13:08:06.839786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.848475 (+  8689us) service_pool.cc:224] Handling call
0709 13:08:06.901946 (+ 53471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.902386 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:07.229593 (+327207us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.403272 (+173679us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.573747 (+170475us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b18003c0dc0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:07.772975 (+199228us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.784594 (+ 11619us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.785839 (+  1245us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.786146 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.788054 (+  1908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.824617 (+ 36563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.941498 (+116881us) raft_consensus.cc:1685] finished
0709 13:08:07.941539 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.941710 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16281,"prepare.queue_time_us":357453,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":148,"raft.queue_time_us":258773,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":48807,"spinlock_wait_cycles":17777792,"thread_start_us":680855,"threads_started":3,"wal-append.queue_time_us":274166}
I20260709 13:08:08.025873 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:07.971483 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.996403 15723 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:08:08.004774 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.039146 19992 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:08.040096 19992 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:08.040443 19992 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:08.042168 15720 raft_consensus.cc:1217] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
W20260709 13:08:07.996135 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84733.1us
I20260709 13:08:08.046959 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:08.009789 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.050414 15728 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:08.054291 15720 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:08.062871 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:08.062965 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 179194us
I20260709 13:08:07.881872 19996 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:07.904067 19985 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.066735 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 154493us
W20260709 13:08:08.067386 16236 leader_election.cc:336] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.615s (SENT)
I20260709 13:08:08.067950 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:08.070185 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.073165 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.074038 15572 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.074270 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.077179 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.077919 15728 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:07.876279 19963 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.076756 16272 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:08.051245 19919 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.953598 19301 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:07.909945 19970 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.095425 15578 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:08.075282 20016 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:08:08.069530 20011 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.995749 19965 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.147204 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:08.052591 19959 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:08.071168 19936 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.145674 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.146179 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.147204 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:08.097105 19951 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 13:08:07.953035 19340 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.067284 19992 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.043386 19990 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.164305 15572 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:08.045167 19987 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.176880 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.205027 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.165102 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.178472 16270 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:08.207233 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 181448us
I20260709 13:08:08.217929 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.218822 19955 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:08.221277 19987 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:08.222169 20024 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 13:08:08.234433 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 187549us
I20260709 13:08:08.235157 15619 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.222497 19612 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.222939 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.228663 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.187872 19949 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:08.177080 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 131031us
I20260709 13:08:08.244112 15578 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:08.242328 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68306.1us
I20260709 13:08:08.148974 20012 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:08:08.223989 20033 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.152145 20014 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:08.248632 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 99911.4us
W20260709 13:08:08.304687 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.337508 15650 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:08.359935 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.374402 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 119626us
I20260709 13:08:08.373555 15650 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:08.382177 15651 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:08.247139 19992 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.375379 15543 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:08.213673 19936 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.214193 19951 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.421571 15649 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:08.387115 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:08.389576 16236 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.689s (SENT)
I20260709 13:08:08.424547 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.153015 20011 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:08.421077 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47850us
I20260709 13:08:08.435029 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.248867 20030 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:08.442309 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.447558 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.385460 20046 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:08.461385 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.274358 20006 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.443982 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 68729.1us
I20260709 13:08:08.437214 20000 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.470775 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:08.471539 15727 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.473042 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:08.462702 19301 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.474241 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:08.474561 19301 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.474893 15647 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.475147 19301 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.476181 20011 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:08.479609 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:08.457962 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.480664 15578 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:08.440538 20014 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.383244 20045 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.446322 15650 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.422374 19949 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:08.457958 19985 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:08.467857 20005 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.002s
I20260709 13:08:08.459122 20033 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:08.485438 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.496567 15650 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:08.528716 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 277256us
I20260709 13:08:08.529958 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:08.531884 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45237.6us
I20260709 13:08:08.483877 20046 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:08.534803 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.484668 20000 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:08.544617 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45181.3us
I20260709 13:08:08.495407 19955 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.500494 19949 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:08.497359 19965 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:08.558804 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:08.557945 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:08.510326 20033 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:08.559674 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.531234 20036 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:08.571534 15647 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
W20260709 13:08:08.555193 19813 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.173s	user 0.011s	sys 0.002s
I20260709 13:08:08.562542 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.576480 15578 raft_consensus.cc:2410] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:08:08.578881 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.579698 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.480683 20006 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.574144 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:08.584569 16269 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:08.556367 19949 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:08.498915 20005 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.581729 19956 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.001s
I20260709 13:08:08.599247 15728 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:08.600569 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.600634 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 372087us
I20260709 13:08:08.605743 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.609624 15723 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:08.611908 19984 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.013s	sys 0.031s
W20260709 13:08:08.612355 19984 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.013s	sys 0.031s
I20260709 13:08:08.557502 19955 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.621073 15580 raft_consensus.cc:2410] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:08.621582 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:08.628814 15722 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:08.629788 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.631209 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.635221 15654 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 7: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:08.602512 19612 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:08.585700 19813 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.652518 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.655776 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.634473 20036 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.622236 20048 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:08.645669 20033 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.560868 20030 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.642019 19936 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:08.650130 20045 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.642508 20046 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.672616 19951 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:08.703547 15653 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:08.704233 16272 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:08.710253 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54592.3us
I20260709 13:08:08.710458 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.735163 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:08.736665 15572 raft_consensus.cc:1217] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:08:08.737772 15572 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:08:08.679523 20013 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.821s	user 0.002s	sys 0.009s
I20260709 13:08:08.643843 20047 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.250s
I20260709 13:08:08.742997 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.743945 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:08.677139 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 121488us
I20260709 13:08:08.751803 15579 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:08.745837 15722 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:08.686978 20042 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
I20260709 13:08:08.748485 15729 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:08.674077 19879 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:08:08.680899 20058 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:08:08.679774 20057 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:08:08.690423 20054 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:08:08.757402 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:08.758934 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.692735 19990 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.708078 19956 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.679778 20055 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:08.671761 19949 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.692319 19955 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:08.680127 20065 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.692909 19612 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.708562 19952 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.768823 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.709640 20045 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.772944 15724 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:08.773285 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:08.683809 20005 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:08.769546 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.777448 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.808274 15578 raft_consensus.cc:2376] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13. Re-sending same reply.
I20260709 13:08:08.781725 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:08.644054 20000 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:08.783262 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.769047 20011 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.787714 20069 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.888161 20051 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.888718 20066 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.796386 15577 raft_consensus.cc:2376] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11. Re-sending same reply.
I20260709 13:08:08.809717 16270 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
W20260709 13:08:08.782184 20027 consensus_meta.cc:287] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.001s
I20260709 13:08:08.916440 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:08.890470 19456 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.965s	user 0.008s	sys 0.003s
W20260709 13:08:08.925463 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.932360 15727 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:08.933823 20060 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.947515 20060 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.947872 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 568921us
W20260709 13:08:08.948549 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.750s (SENT) [suppressed 26 similar messages]
I20260709 13:08:08.935231 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:08.950186 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:08.937961 20056 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 13:08:08.938740 20059 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:08:08.939205 20061 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.938650 20051 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:08.942579 20028 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 1.017s	user 0.009s	sys 0.002s
I20260709 13:08:08.920795 20069 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.977039 20028 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.928239 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 145438us
I20260709 13:08:08.956302 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.978498 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.979269 15577 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:08.917830 19757 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:08.957840 15650 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:08.921115 20066 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.970597 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.990244 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:08.917233 20011 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.973657 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:08.966352 19456 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:09.031939 19456 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.032744 19456 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.033428 19456 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.705085 20048 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:09.035359 20067 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:08:09.037703 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.038518 15652 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:09.039582 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.040282 15652 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:09.040940 15573 raft_consensus.cc:2410] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:08:09.043864 15574 raft_consensus.cc:2376] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12. Re-sending same reply.
I20260709 13:08:09.045250 20051 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:08.976517 15578 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.949725 20013 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:08.981248 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:08.982612 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.781306 19956 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:08.913926 19612 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:09.010663 19794 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.161s	user 0.008s	sys 0.004s
I20260709 13:08:09.016038 20028 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.066184 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.018265 19962 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:09.020706 20011 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.021507 19813 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.022096 19757 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:08.971210 20044 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:08:09.025422 20036 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.968503 20062 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.981431 20006 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:09.026623 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48056.6us
W20260709 13:08:09.030232 19301 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.004s
I20260709 13:08:09.004065 20066 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:09.046402 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 43698.6us
I20260709 13:08:08.891106 20045 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.054746 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.053854 16269 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:09.075711 19963 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.076264 19956 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:09.076876 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 86693.9us
I20260709 13:08:09.091046 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 790) took 1256 ms. Trace:
I20260709 13:08:09.100580 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 820) took 1094 ms. Trace:
I20260709 13:08:09.152222 15729 rpcz_store.cc:276] 0709 13:08:08.051483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.062583 (+ 11100us) service_pool.cc:224] Handling call
0709 13:08:09.100265 (+1037682us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400113d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:09.100450 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574692224}
I20260709 13:08:09.101652 19919 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:09.105581 19987 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.155074 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:09.112411 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.183037 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.114828 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.115420 20043 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:09.116778 15580 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.784735 20055 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:09.136556 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.139528 15575 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:08:09.140851 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.192453 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.889999 20065 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.197598 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.199754 20065 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.059930 20013 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.202195 20013 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.154081 15652 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:09.155195 19987 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:09.107620 15571 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:09.138579 19962 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.155593 19985 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:09.165241 19612 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.165498 15720 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:09.151477 19935 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:09.153790 19919 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.149838 19301 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.168630 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.168720 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:09.170912 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.171727 15544 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:09.240962 15651 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:09.172438 20051 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:09.173127 19996 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:09.177541 19949 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.147024 20062 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.249972 15577 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:09.250684 20062 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.250888 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.180678 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.251412 15728 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:09.186611 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:09.251732 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71180.2us
W20260709 13:08:09.252439 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 65936.5us
I20260709 13:08:09.252521 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:09.252874 15728 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:09.253238 20006 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:09.245443 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.152159 15653 rpcz_store.cc:276] 0709 13:08:07.834771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.834906 (+   135us) service_pool.cc:224] Handling call
0709 13:08:07.835236 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.732866 (+897630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.090646 (+357780us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002490d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:09.090948 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996159360}
I20260709 13:08:08.955659 20027 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:09.254534 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.255254 19990 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.255671 20027 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.256006 19990 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.256464 19990 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:09.256880 19990 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.257318 20048 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.258563 15648 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.197619 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.259491 15580 raft_consensus.cc:2376] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12. Re-sending same reply.
W20260709 13:08:09.260510 20083 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.222s	user 0.000s	sys 0.003s
I20260709 13:08:09.260650 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.211905 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.261463 15575 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.262499 20045 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.264561 20045 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.155685 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.212802 20023 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:08:09.266866 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 111253us
I20260709 13:08:09.268081 15543 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.269515 20051 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.270052 20051 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.270498 20051 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.215581 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:09.271274 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55751.1us
I20260709 13:08:09.189631 20043 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.272579 20043 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.273432 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:09.273767 20043 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.202725 20070 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.172185 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.242105 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:09.275216 15572 raft_consensus.cc:2376] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10. Re-sending same reply.
I20260709 13:08:09.275409 15729 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:09.275264 20070 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:09.276036 20070 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.276227 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.243512 19301 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.277174 15572 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:08:09.243976 19951 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:09.247066 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:09.293402 15722 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.247445 19962 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.247694 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:09.178949 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.296988 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.251456 15646 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:09.253147 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:09.142370 20060 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.253787 20006 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.189548 15650 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:09.254415 20079 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.195086 20055 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.196895 19757 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.267840 20066 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.276296 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.246352 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.313038 15727 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:09.277994 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:09.241382 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 69749.3us
W20260709 13:08:09.239961 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 291400us
I20260709 13:08:09.314922 15572 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:09.286173 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.291761 15575 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:09.293968 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.315985 16270 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.301522 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.296437 20023 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:09.341305 20020 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.341357 20023 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.296797 19959 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.342137 20023 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.344345 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.308936 15651 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:08:09.306037 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.357002 16274 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:09.302769 19605 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.357366 16273 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:09.278460 19985 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:09.367425 19985 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:09.368362 19985 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.311079 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:09.316609 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63524.3us
I20260709 13:08:09.303922 19951 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:09.374567 19951 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:09.375954 20089 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.317s	user 0.000s	sys 0.008s
I20260709 13:08:09.353950 20055 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.298852 20048 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:08:09.356930 15651 pending_rounds.cc:85] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 9
W20260709 13:08:09.310351 20073 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 13:08:09.346294 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:09.350294 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:09.350929 20081 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.273s	user 0.002s	sys 0.002s
I20260709 13:08:09.307716 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.303172 20011 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.310585 19794 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.310406 19998 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.354179 16271 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.362576 20028 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:09.342545 19987 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.354655 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.342342 20070 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.355674 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:09.358444 15722 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:09.362301 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:09.363922 19959 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.364244 19605 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.360767 20020 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.365594 20066 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.365733 15647 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.366576 20040 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:09.388240 15651 pending_rounds.cc:107] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:08:09.306394 20068 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:09.390172 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:09.392416 16236 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.773s (SENT)
I20260709 13:08:09.405676 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.354070 19757 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.354276 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:09.402974 20076 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:08:09.416249 15721 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:09.419353 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 63802.4us
I20260709 13:08:09.447907 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.448889 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:09.423487 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61319us
I20260709 13:08:09.424263 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:09.404253 19953 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:09.431146 15651 raft_consensus.cc:2889] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.436375 16272 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:08:09.440208 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.452493 20000 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:09.460397 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.383457 20055 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.425979 20037 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:09.456722 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 102540us
I20260709 13:08:09.462945 15721 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:09.435366 16270 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:09.341857 20006 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.430687 20028 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.312413 20079 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.422889 20069 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.430555 20032 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.457509 20053 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.461356 20060 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:09.435743 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.444905 20068 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:09.467761 20037 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:09.472225 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 82129.2us
I20260709 13:08:09.415246 19794 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.448557 19987 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.456051 19970 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.487576 15729 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:09.470288 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.489035 19959 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.490464 15543 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.408826 20011 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.495347 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.491750 15619 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:09.460964 20084 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.260s	user 0.004s	sys 0.000s
I20260709 13:08:09.423633 19998 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.464738 20080 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:09.464226 19953 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.506292 16271 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:09.502483 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.510284 15721 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:09.537441 16278 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.515218 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:09.513906 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 121516us
I20260709 13:08:09.524968 15726 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:09.510126 15572 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:09.520076 16270 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:09.543135 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.522607 16272 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:09.530509 16275 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:09.538429 15728 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:09.569761 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.526347 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:09.572425 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46174.7us
I20260709 13:08:09.568576 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:09.571866 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:09.586670 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.528537 20090 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:08:09.591784 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.592885 16271 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:09.529750 20036 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.598979 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.643767 16272 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:09.514781 20088 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:08:09.577121 20072 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:09.572477 20054 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:09.530383 19985 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:09.517464 20037 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.598827 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.623425 20033 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:09.585507 20043 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:09.635304 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55348.7us
I20260709 13:08:09.511113 20065 consensus_queue.cc:1059] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:08:09.574369 20000 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:09.594592 20012 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.638528 16278 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:09.681470 20012 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.682133 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.683631 20012 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.683755 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:09.684511 16278 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.685334 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.685818 19998 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:09.686053 20094 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:09.686580 20049 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:08:09.688223 20080 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.688283 20000 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.688828 20080 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.690478 20000 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.690868 20080 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:09.691354 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.693903 16278 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:09.705919 16278 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:09.600869 20092 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:09.624315 20020 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.646168 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2479) took 1308 ms. Trace:
I20260709 13:08:09.717357 15655 rpcz_store.cc:276] 0709 13:08:08.337398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.337534 (+   136us) service_pool.cc:224] Handling call
0709 13:08:08.337943 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.752832 (+414889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.752884 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.753573 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.987546 (+233973us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.987606 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.987698 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.268191 (+280493us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:09.639765 (+371574us) raft_consensus.cc:1685] finished
0709 13:08:09.639789 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.646103 (+  6314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127449,"raft.queue_time_us":220693,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":15418,"spinlock_wait_cycles":232974720,"thread_start_us":366973,"threads_started":2,"wal-append.queue_time_us":284826}
I20260709 13:08:09.647221 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2520) took 1492 ms. Trace:
I20260709 13:08:09.719177 15720 rpcz_store.cc:276] 0709 13:08:08.154661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.155571 (+   910us) service_pool.cc:224] Handling call
0709 13:08:08.180049 (+ 24478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.238540 (+1058491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.646998 (+408458us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b540011a8d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:09.647162 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265360512}
I20260709 13:08:09.508649 20023 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.517352 20060 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.725973 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:09.668663 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.728415 16276 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:09.672529 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:09.643481 20036 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.637295 20028 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.696520 19990 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:09.697382 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.759119 15723 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.758416 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:09.795725 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.707192 20090 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:09.708496 20011 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.595078 20068 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.732764 20036 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:09.710669 20098 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:09.710981 19794 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.711928 20055 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:09.721449 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.721271 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 43906.8us
I20260709 13:08:09.737113 20000 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.748032 19605 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.642122 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.638773 16273 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:08:09.730198 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.701370 20051 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.734294 16272 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:09.731434 20049 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:09.769663 20079 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.739897 19953 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.748221 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.855830 15580 raft_consensus.cc:2376] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10. Re-sending same reply.
W20260709 13:08:09.758004 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.773654 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.745178 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.758561 15576 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:09.784162 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.754510 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2474) took 1497 ms. Trace:
I20260709 13:08:09.727963 20033 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.757123 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1883) took 1373 ms. Trace:
I20260709 13:08:09.755192 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 1969) took 1004 ms. Trace:
I20260709 13:08:09.797820 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:09.799829 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 69856.4us
I20260709 13:08:09.871395 15728 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:09.800038 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 138018us
I20260709 13:08:09.720759 20043 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:09.675498 19985 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:09.741009 20086 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.666s	user 0.004s	sys 0.008s
I20260709 13:08:09.650682 19962 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:09.836974 15727 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.730742 20048 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:08:09.747787 20023 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.847220 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.889158 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:09.851938 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.889938 15580 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:08:09.890594 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.853175 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 211873us
I20260709 13:08:09.853922 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.871464 15573 rpcz_store.cc:276] 0709 13:08:08.384019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.384872 (+   853us) service_pool.cc:224] Handling call
0709 13:08:09.756873 (+1372001us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54000c71d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:09.757054 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390929280}
W20260709 13:08:09.872725 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.870978 15574 rpcz_store.cc:276] 0709 13:08:08.750762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.751395 (+   633us) service_pool.cc:224] Handling call
0709 13:08:09.754998 (+1003603us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003f93d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:09.755128 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574717312}
I20260709 13:08:09.751643 20037 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:09.902762 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2204) took 1315 ms. Trace:
I20260709 13:08:09.872282 15648 rpcz_store.cc:276] 0709 13:08:08.256864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.256973 (+   109us) service_pool.cc:224] Handling call
0709 13:08:08.379052 (+122079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.258968 (+879916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.754241 (+495273us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400419954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:09.754440 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022265600}
I20260709 13:08:09.878408 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.879006 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.882472 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.848559 20068 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:09.916013 19962 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.917191 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.917938 15722 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:09.918375 19962 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.918614 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.919269 15573 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:09.920426 20037 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:09.920509 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.920773 19990 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:09.921461 15573 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:09.921629 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.922250 15571 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:09.922286 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.923062 15579 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:09.923264 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.923902 15720 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:09.750837 19919 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.740751 20060 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.888371 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.893756 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:09.900499 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.888393 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.935454 15654 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:09.869846 19301 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.909327 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.911882 20045 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.909394 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.938199 15574 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:09.939126 15578 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:09.940173 15575 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:09.881722 20043 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:09.883909 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:09.944643 15573 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:09.844559 20066 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:09.917822 15728 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:09.928504 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.903291 15725 rpcz_store.cc:276] 0709 13:08:08.586886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.589051 (+  2165us) service_pool.cc:224] Handling call
0709 13:08:08.607746 (+ 18695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.622894 (+ 15148us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:08.912591 (+289697us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.216248 (+303657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.216967 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.217115 (+   148us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.217160 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.217244 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.902568 (+685324us) raft_consensus.cc:1685] finished
0709 13:08:09.902586 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.902695 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18335,"prepare.queue_time_us":414400,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":87081,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21705,"thread_start_us":433565,"threads_started":2,"wal-append.queue_time_us":317837}
I20260709 13:08:09.935716 15651 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:09.942462 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:09.912781 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:09.919171 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:09.946133 15574 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:09.946211 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.948235 15646 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:09.948349 20080 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:09.946233 20045 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.188318 20045 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:09.937647 19301 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.189626 19301 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.943584 20011 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:09.950409 20104 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:08:09.958226 20088 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.190235 20011 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.190836 20011 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.191063 20088 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:10.191633 20088 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:09.960925 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:10.138633 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.194674 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.194613 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 233765us
I20260709 13:08:10.199795 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:10.200555 15574 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.090505 20082 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.004s	sys 0.022s
I20260709 13:08:10.183746 15576 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:09.994809 19985 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:10.149158 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 187719us
I20260709 13:08:09.945883 20033 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:09.946995 20003 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
W20260709 13:08:10.152614 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.958779 20065 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:10.230495 15619 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:10.154632 20066 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.169124 15575 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:10.171723 15578 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:10.170531 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1982) took 1026 ms. Trace:
W20260709 13:08:10.165529 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 237037us
I20260709 13:08:10.172961 20000 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:10.225272 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 649423us
W20260709 13:08:10.214608 19970 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.006s
I20260709 13:08:10.229897 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:09.978411 19953 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.235251 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.252641 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:10.254472 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.236806 15572 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:08:10.220660 20082 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.005s	sys 0.022s
I20260709 13:08:10.220713 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:10.238785 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.260303 16275 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:08:10.240995 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.261407 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.262115 16235 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:10.253391 16273 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:10.257946 15574 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:10.241582 15573 rpcz_store.cc:276] 0709 13:08:09.144042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.925946 (+781904us) service_pool.cc:224] Handling call
0709 13:08:09.944408 (+ 18462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.976645 (+ 32237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.170444 (+193799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.249656 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:10.229983 19605 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:10.265419 16269 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:10.265794 16277 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:10.240842 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:10.269227 15571 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.267418 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:10.270853 15575 raft_consensus.cc:1240] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:08:10.273121 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 398541us
I20260709 13:08:10.285061 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:10.249183 20000 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.259382 20020 raft_consensus.cc:2764] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:10.276017 20109 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:10.272135 19962 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.272414 19998 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.282095 19996 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.331020 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:10.272866 19605 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.293313 20006 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:10.314375 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.275840 20113 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.265208 19953 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:10.320494 20065 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.322041 20109 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.322358 20070 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:10.326188 20107 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:08:10.297094 19970 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:08:10.326910 19992 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:10.328706 20036 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.332952 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.295625 20000 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.276077 19967 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:10.275741 20069 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:08:10.304742 20048 consensus_queue.cc:1243] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:10.310873 19813 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:10.366870 16273 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:10.348239 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:10.376205 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:10.335105 19996 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.389889 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1401) took 1104 ms. Trace:
I20260709 13:08:10.478703 16269 rpcz_store.cc:276] 0709 13:08:09.285242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.286769 (+  1527us) service_pool.cc:224] Handling call
0709 13:08:09.302471 (+ 15702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.265867 (+963396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.389559 (+123692us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54004a9054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:10.389809 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200034688}
I20260709 13:08:10.402618 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:10.411536 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.420289 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:10.480906 16276 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.344786 20051 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:10.366736 20065 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.336017 19605 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.338608 19794 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:10.364480 20120 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:10.475988 16271 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11.
I20260709 13:08:10.343604 20113 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:10.338203 19998 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.364594 19953 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:10.480193 15723 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:10.430740 19612 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.330574 20055 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:08:10.492935 20113 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:10.497123 19987 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.979s	user 0.017s	sys 0.002s
I20260709 13:08:10.497849 19813 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:10.500303 16277 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:10.535866 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.535539 19813 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.537096 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.500938 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.538921 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.539995 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.541065 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:10.502489 20135 raft_consensus.cc:3055] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:10.502380 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.473848 20109 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.504957 20011 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:10.343848 19301 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:10.519781 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.520198 16276 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:10.493108 20043 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:10.522823 16271 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:10.523590 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.520448 19612 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:10.486469 19996 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.482818 20070 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:10.542415 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.488636 19794 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:10.565477 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.490953 20065 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.561853 16269 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:10.565390 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.558439 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2222) took 1171 ms. Trace:
I20260709 13:08:10.547359 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:10.572319 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 301785us
I20260709 13:08:10.573074 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:10.573980 16275 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:10.575426 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.576472 16274 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:10.577837 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.578668 16278 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:08:10.579809 20069 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:10.580253 20069 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.580662 20069 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.547531 20135 raft_consensus.cc:740] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:10.590334 15728 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:10.514451 20087 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.568315 15724 rpcz_store.cc:276] 0709 13:08:09.387167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.432130 (+ 44963us) service_pool.cc:224] Handling call
0709 13:08:09.432543 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.456402 (+ 23859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.456446 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.467524 (+ 11078us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.796703 (+329179us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:09.796753 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.800413 (+  3660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.558215 (+757802us) raft_consensus.cc:1685] finished
0709 13:08:10.558236 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.558378 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15405,"raft.queue_time_us":23537,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5653,"thread_start_us":277853,"threads_started":1,"wal-append.queue_time_us":425223}
I20260709 13:08:10.591463 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.595036 15727 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:08:10.585783 16276 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:08:10.599603 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 292396us
I20260709 13:08:10.570978 19794 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.602586 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.604650 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:10.605387 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:10.574543 20066 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:10.612445 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:10.617130 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:10.621174 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:10.567878 20043 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.637404 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.639876 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:10.645177 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.646610 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.648923 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.630417 19992 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.650570 19992 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:10.651099 19992 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.651274 20070 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:10.654604 20127 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:08:10.663209 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.664964 15652 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:10.671238 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.624286 19970 raft_consensus.cc:2764] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:10.672695 19970 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:10.673833 16277 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.676429 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.677201 15651 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:10.681197 19953 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:10.681718 19953 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:10.682134 19953 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:10.624569 20114 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.603375 20087 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:10.641757 20055 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:08:10.698431 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 413032us
W20260709 13:08:10.691238 20118 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:08:10.699177 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:10.707387 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.689828 20036 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:10.753118 15654 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:10.763453 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.764556 15650 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:10.766472 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:10.767175 20087 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:10.767609 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:10.770128 20121 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:08:10.667411 20135 consensus_queue.cc:260] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:10.783000 15648 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:10.790221 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.790920 15648 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:10.795225 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.796144 15646 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.785807 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.803673 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.819742 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.778321 20011 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:10.828658 15652 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:10.783046 19301 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:10.834753 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.826488 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 186706us
I20260709 13:08:10.835378 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:10.822950 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 201517us
I20260709 13:08:10.842422 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:10.843216 15724 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.847707 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:10.807931 20109 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:10.852847 15652 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:08:10.819103 19612 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:10.826594 20135 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.785509 20113 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:10.837244 20117 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:08:10.879731 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2225) took 1083 ms. Trace:
W20260709 13:08:10.884869 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.854178 20043 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:10.890784 15721 rpcz_store.cc:276] 0709 13:08:09.796726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.796856 (+   130us) service_pool.cc:224] Handling call
0709 13:08:09.797241 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.797644 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.797691 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.804062 (+  6371us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.273532 (+469470us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.274280 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.274350 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.879099 (+604749us) raft_consensus.cc:1685] finished
0709 13:08:10.879130 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.879648 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":27715,"thread_start_us":416784,"threads_started":1,"wal-append.queue_time_us":569072}
I20260709 13:08:10.903632 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.904673 15721 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:10.909111 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.911854 16270 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:10.913002 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.914558 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.915266 15728 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:10.916311 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.850980 19793 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:08:10.893831 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.928045 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 228930us
I20260709 13:08:10.929167 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:10.929813 15724 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:10.930359 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:10.925526 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2029) took 1048 ms. Trace:
I20260709 13:08:10.930891 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.930490 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2030) took 1053 ms. Trace:
I20260709 13:08:10.929912 20126 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.936573 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.942770 16278 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:10.931135 15649 rpcz_store.cc:276] 0709 13:08:09.876828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.877004 (+   176us) service_pool.cc:224] Handling call
0709 13:08:09.901993 (+ 24989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.902602 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:10.246517 (+343915us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.688691 (+442174us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.924871 (+236180us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18003673c0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d95a0b060 00007f2d95a1d716 00007f2d95a2e287 00007f2d95a2e208
0709 13:08:10.925079 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.925145 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:10.925204 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.925301 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.925450 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125481,"prepare.queue_time_us":780090,"prepare.run_wall_time_us":1227,"raft.queue_time_us":322857,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"spinlock_wait_cycles":11016192,"thread_start_us":653387,"threads_started":2,"wal-append.queue_time_us":513301}
W20260709 13:08:10.940099 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.933521 15655 rpcz_store.cc:276] 0709 13:08:09.877230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.877372 (+   142us) service_pool.cc:224] Handling call
0709 13:08:09.888594 (+ 11222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.888794 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:10.332397 (+443603us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.930176 (+597779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.930222 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:10.930272 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.930333 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.930438 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242527,"prepare.queue_time_us":778382,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":200931,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"spinlock_wait_cycles":577280,"thread_start_us":791393,"threads_started":2,"wal-append.queue_time_us":502059}
I20260709 13:08:10.943941 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.934633 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:10.938304 15728 raft_consensus.cc:2393] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:10.856787 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:10.946002 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 89307.9us
I20260709 13:08:10.946923 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:10.948799 16275 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:10.949182 15577 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.954011 15573 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:10.954567 15573 pending_rounds.cc:85] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 7
I20260709 13:08:10.954849 15573 pending_rounds.cc:107] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:10.955158 15573 raft_consensus.cc:2889] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:10.931156 20141 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.957152 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:10.958314 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:10.960501 20139 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:08:10.961982 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:10.962658 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.962718 16271 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:10.964517 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:10.940655 20126 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.966548 20126 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.921928 20065 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:10.973029 20006 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.973208 20065 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:10.974231 20128 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:10.976552 19793 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.955855 19301 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.978305 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:10.979204 16273 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:10.978386 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:10.983970 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:10.985298 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:10.986127 15576 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:10.987329 15576 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.004278 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.005712 15649 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:10.965891 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.008989 20141 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.973800 20006 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:10.909269 20123 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:08:11.021085 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2226) took 1224 ms. Trace:
W20260709 13:08:11.021720 19605 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:08:11.022330 19605 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.024935 19605 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:11.026388 15578 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:11.069169 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 1983) took 1923 ms. Trace:
I20260709 13:08:11.069789 15571 rpcz_store.cc:276] 0709 13:08:09.145709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.224966 (+1079257us) service_pool.cc:224] Handling call
0709 13:08:10.268997 (+ 44031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.269716 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.068874 (+799158us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b540026c850. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:11.069087 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38139136}
I20260709 13:08:11.021570 15729 rpcz_store.cc:276] 0709 13:08:09.797111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.798094 (+   983us) service_pool.cc:224] Handling call
0709 13:08:09.798427 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.829901 (+ 31474us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:09.846781 (+ 16880us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.251934 (+405153us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:10.283144 (+ 31210us) log.cc:844] Serialized 52 byte log entry
0709 13:08:10.283710 (+   566us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:10.288216 (+  4506us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.568679 (+280463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.568750 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.020796 (+452046us) raft_consensus.cc:1685] finished
0709 13:08:11.020825 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.021009 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3738,"prepare.queue_time_us":16997,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":296760,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":20948,"thread_start_us":655070,"threads_started":2,"wal-append.queue_time_us":734127}
I20260709 13:08:11.067531 19967 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:11.104696 19967 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.105250 19967 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:11.081563 20109 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.106839 20109 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.120843 20068 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.121497 20068 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:11.139822 20149 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.140667 20149 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.142762 20088 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.144273 20088 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.147181 20068 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.112957 19967 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:11.285214 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.285799 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.287501 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:11.288046 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 322213us
I20260709 13:08:11.289093 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.291183 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:11.291697 15576 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:11.296620 16273 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
W20260709 13:08:11.297201 15647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.016s
W20260709 13:08:11.296667 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 340116us
W20260709 13:08:11.297698 15647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.016s
I20260709 13:08:11.299606 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:11.304711 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.305652 15653 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:11.305907 15646 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:11.310042 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:11.313107 15653 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.313606 15653 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:11.283480 20070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.076s	sys 0.105s
I20260709 13:08:11.280915 19967 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.320945 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.325377 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.328249 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.328560 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.329008 15729 raft_consensus.cc:2393] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:11.331187 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.332003 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.323550 15653 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.334481 15653 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.326846 20068 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.315673 20125 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:11.327924 20145 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.420s	user 0.004s	sys 0.001s
W20260709 13:08:11.343742 15648 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.001s
I20260709 13:08:11.346338 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:11.348078 15648 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:11.348420 15722 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.347185 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:11.314230 20148 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.349972 15653 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:11.313961 20028 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.347641 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:11.352053 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.318279 19919 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.353436 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.359638 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:11.339768 20114 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
W20260709 13:08:11.358834 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.358647 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.360448 15724 raft_consensus.cc:2368] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
W20260709 13:08:11.340953 19794 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.719s	user 0.014s	sys 0.006s
I20260709 13:08:11.356613 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.361132 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.361145 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.364676 15728 raft_consensus.cc:2368] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:11.337776 20141 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.362474 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:11.365566 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.327812 20144 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:11.363396 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.342458 20109 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:11.368710 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.364882 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.371206 15729 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:11.356292 20070 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.356137 20124 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:11.379228 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.396972 15722 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:11.357831 20125 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:11.353067 20020 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:11.364471 20114 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.398296 19936 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:11.361402 20147 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.369295 19793 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.365612 19301 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:11.398334 20046 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.368785 20122 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.385752 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.421865 16271 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:11.456243 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 70626.9us
W20260709 13:08:11.401101 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.357208 20148 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.368352 20006 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:11.462545 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 152592us
I20260709 13:08:11.463491 20125 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.480400 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:11.373888 19953 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.007s
I20260709 13:08:11.369429 20144 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.389693 20003 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:08:11.398799 20109 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:11.466769 19992 consensus_meta.cc:287] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.815s	user 0.033s	sys 0.025s
I20260709 13:08:11.466918 20033 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:11.467751 20062 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:08:11.468281 19998 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:11.474388 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 108343us
I20260709 13:08:11.497916 19998 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:11.498342 19998 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.498716 19998 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:11.498921 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:11.480320 20080 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.501119 20146 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:11.501652 20146 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:11.389751 20065 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.367726 20088 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:08:11.463671 20046 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.503002 20088 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.503364 20088 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:11.504127 20088 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.504964 20046 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:11.505285 20088 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.421455 20149 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:11.483171 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 104020us
I20260709 13:08:11.507102 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.508184 20046 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.508780 20046 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:11.457428 20155 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:08:11.510010 20046 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:11.467798 20153 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:11.465620 19990 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.369761 19794 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.458732 19301 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:11.512179 19301 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.512460 16272 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.493845 19992 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:11.515470 20115 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.828s	user 0.003s	sys 0.002s
I20260709 13:08:11.515580 19992 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:11.496814 20154 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:08:11.516911 20156 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:08:11.517203 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2543) took 1986 ms. Trace:
I20260709 13:08:11.517751 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:11.518388 16271 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.518472 15654 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:11.494005 20033 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:11.502524 20146 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.513651 19794 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:11.374254 20049 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.479686 20070 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:11.490379 19996 consensus_meta.cc:287] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.918s	user 0.018s	sys 0.003s
I20260709 13:08:11.509780 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:11.491552 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.517575 15726 rpcz_store.cc:276] 0709 13:08:09.531072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.599055 (+ 67983us) service_pool.cc:224] Handling call
0709 13:08:09.626412 (+ 27357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.626771 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.626820 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.635855 (+  9035us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.931201 (+295346us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.931257 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.931361 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.514923 (+1583562us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:11.516915 (+  1992us) raft_consensus.cc:1685] finished
0709 13:08:11.516938 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.517144 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2703,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4825,"spinlock_wait_cycles":2292992,"thread_start_us":261810,"threads_started":1,"wal-append.queue_time_us":1012306}
W20260709 13:08:11.524792 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.483989 20122 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:11.528523 15647 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:11.528489 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.529193 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:11.528040 15653 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:11.528839 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:11.536185 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.555352 15648 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
W20260709 13:08:11.555536 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45834us
I20260709 13:08:11.557446 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.486778 20144 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.526218 20069 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.945s	user 0.039s	sys 0.018s
I20260709 13:08:11.491173 20109 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.564364 19794 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:11.564682 20062 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.565337 20003 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:11.587096 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:11.587531 20003 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.588143 20003 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.588711 20068 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.565817 20080 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.566222 20028 raft_consensus.cc:2764] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:08:11.566728 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 75252us
I20260709 13:08:11.491338 19953 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.578732 15576 pending_rounds.cc:85] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 5
I20260709 13:08:11.615720 15576 pending_rounds.cc:107] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:08:11.616098 15576 raft_consensus.cc:2889] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.536780 20065 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.579433 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:11.617338 15577 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.580912 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.585827 16271 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:11.618944 16278 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:11.621037 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:11.592537 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 135535us
I20260709 13:08:11.600864 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:11.532064 20126 consensus_meta.cc:287] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.565s	user 0.016s	sys 0.005s
I20260709 13:08:11.606904 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:11.643358 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:11.608757 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:11.562484 20000 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 1.081s	user 0.013s	sys 0.009s
I20260709 13:08:11.592286 20109 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.644328 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:11.653165 16269 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:11.653326 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44704.8us
I20260709 13:08:11.645735 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.646664 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.627218 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:11.655448 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.654150 15726 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:08:11.647171 20162 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.661100 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.661494 15572 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:11.601418 19794 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:11.666392 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:11.564463 20141 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:08:11.667901 15651 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:11.610522 19605 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.669849 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.670544 15580 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:11.667716 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:11.555397 19996 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.672282 20162 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.676899 20162 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:11.589210 20068 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.683800 15727 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:11.661896 20051 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.616706 20006 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:08:11.616201 20070 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:11.661927 20114 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:11.611517 20069 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.620038 19992 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:08:11.643136 20023 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:11.669682 20149 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:11.692267 20135 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.809s	user 0.019s	sys 0.024s
I20260709 13:08:11.644065 20065 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.705040 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:11.797752 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 143388us
I20260709 13:08:11.706267 20148 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:11.708387 19996 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:11.710016 20068 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:11.686411 19605 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.703428 20051 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:11.813222 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:11.651932 20126 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.670984 20062 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:11.652697 20000 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.692819 20080 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:11.693264 20162 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:11.705245 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 115142us
I20260709 13:08:11.816815 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:11.817205 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:11.693995 20164 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
W20260709 13:08:11.814420 20157 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:08:11.874017 15727 raft_consensus.cc:2410] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:11.691087 20122 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.884697 15649 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:11.810750 20023 consensus_queue.cc:1243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:08:11.890290 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 263035us
I20260709 13:08:11.891623 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:11.812841 20114 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.822464 20062 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:11.832547 19813 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.830801 20149 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.901515 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:11.871261 15721 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.905315 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:11.801101 19794 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.822760 20148 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.881841 20170 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.898119 20173 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.905625 19813 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.923197 20162 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:11.940544 20172 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.946847 20169 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:11.946745 20172 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.948184 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 874) took 1257 ms. Trace:
I20260709 13:08:11.940624 20170 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.874109 20080 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.948590 15579 rpcz_store.cc:276] 0709 13:08:10.690810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.694851 (+  4041us) service_pool.cc:224] Handling call
0709 13:08:10.703901 (+  9050us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:10.704377 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.704417 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:10.753899 (+ 49482us) log.cc:844] Serialized 52 byte log entry
0709 13:08:10.893147 (+139248us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b1800383920. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:11.358049 (+464902us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.358096 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.358203 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.943762 (+585559us) raft_consensus.cc:1685] finished
0709 13:08:11.943783 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.948118 (+  4335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3285,"raft.queue_time_us":289,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7804,"spinlock_wait_cycles":20765824,"thread_start_us":464361,"threads_started":1,"wal-append.queue_time_us":615221}
W20260709 13:08:11.950357 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.960484 15721 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:11.961990 15544 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:11.944732 20168 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:08:11.926189 20135 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:11.983204 20171 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.986143 20171 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:11.925478 20148 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.987080 20171 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.988226 20148 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:11.988632 16270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 823) took 1613 ms (client timeout 1711 ms). Trace:
I20260709 13:08:11.943785 20162 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.945940 19813 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:11.989085 16270 rpcz_store.cc:269] 0709 13:08:10.374900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.375885 (+   985us) service_pool.cc:224] Handling call
0709 13:08:11.988424 (+1612539us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002d5d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:11.988569 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001870080}
I20260709 13:08:11.945106 20126 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:11.990132 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.990599 20162 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:11.983402 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:11.991475 20069 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:11.992506 20160 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
I20260709 13:08:11.983456 20172 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:11.993615 20172 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.993983 20172 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.994324 20172 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.995069 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2036) took 1200 ms. Trace:
I20260709 13:08:11.995452 15652 rpcz_store.cc:276] 0709 13:08:10.794949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.853559 (+ 58610us) service_pool.cc:224] Handling call
0709 13:08:10.853834 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.011277 (+157443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.011321 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.012016 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.354153 (+342137us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.354195 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.354288 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.991892 (+637604us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:11.994762 (+  2870us) raft_consensus.cc:1685] finished
0709 13:08:11.994784 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.995010 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156790,"raft.queue_time_us":156942,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":41945344,"thread_start_us":341699,"threads_started":1,"wal-append.queue_time_us":469375}
I20260709 13:08:11.991709 15579 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.944928 19953 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:11.913400 20149 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:11.910641 19998 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.006271 15577 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
W20260709 13:08:11.991521 20158 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.494s	user 0.001s	sys 0.000s
I20260709 13:08:11.991571 19951 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:11.919965 20051 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:12.023656 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 318685us
I20260709 13:08:12.012082 20003 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.017791 15579 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:12.033784 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.026499 20173 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:11.997440 20144 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.015810 19951 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:12.040113 19992 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.047124 20065 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:12.047744 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2000) took 1111 ms. Trace:
I20260709 13:08:12.047889 20003 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:12.049000 20177 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:12.048180 15578 rpcz_store.cc:276] 0709 13:08:10.936525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.082106 (+145581us) service_pool.cc:224] Handling call
0709 13:08:11.109765 (+ 27659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.114406 (+  4641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.114449 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.114506 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.114551 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.047514 (+932963us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b5400292a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:12.047557 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.047675 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9763,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":1515,"spinlock_wait_cycles":9629568}
I20260709 13:08:12.050994 15727 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.045878 19951 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.058846 20164 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.059394 20164 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:12.059754 15571 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:12.060248 20164 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.060864 20144 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:12.058674 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:12.045096 20167 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:12.069518 15720 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:12.000433 20062 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.070562 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:12.071341 15723 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.072772 15721 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.074090 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:12.074762 15721 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:12.076148 15721 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:12.079344 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:12.061501 20124 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:12.061584 20164 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:12.082882 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 121028us
I20260709 13:08:12.086124 15722 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:12.089143 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 197614us
I20260709 13:08:12.064044 20143 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:12.095548 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61876.7us
I20260709 13:08:12.071110 20000 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:12.096908 15619 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:12.113683 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:12.085678 20124 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.080029 19793 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.146492 15722 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:12.150723 15729 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.094676 20003 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:12.116878 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.146394 15723 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:12.097563 20062 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.153129 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:12.153152 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 251171us
I20260709 13:08:12.152220 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:12.116899 20143 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.097815 20070 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:12.155364 20000 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.155531 20171 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.158944 20143 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.165408 20170 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.171118 20170 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.171618 20170 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.165143 20181 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:12.174315 20181 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.173816 20170 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.163560 20113 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:12.183492 20109 consensus_meta.cc:287] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.004s
I20260709 13:08:12.167044 20080 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.170336 20149 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:12.183413 20088 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 13:08:12.184116 20109 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.186928 20109 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:12.176653 20171 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.189255 20171 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.190600 20173 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:12.185632 20124 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.190701 20181 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:12.181555 20172 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.189706 20143 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.194044 20172 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:12.230687 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 134337us
I20260709 13:08:12.234140 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.237926 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:12.238204 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 145173us
I20260709 13:08:12.240200 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.241786 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.242296 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.242772 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.243916 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.244215 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.245043 15579 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:12.246438 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.248898 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.249671 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.251331 15652 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:12.252101 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.254185 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:12.256850 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.263375 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:12.266105 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 149123us
I20260709 13:08:12.268345 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.268823 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.273353 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.276330 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.277205 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.277539 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.279295 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:12.279577 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.280680 15651 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:12.281544 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.282521 15652 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:12.285276 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:12.291347 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 873) took 1600 ms. Trace:
I20260709 13:08:12.292017 15572 rpcz_store.cc:276] 0709 13:08:10.690449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.690593 (+   144us) service_pool.cc:224] Handling call
0709 13:08:10.691290 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.661922 (+970632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.290720 (+628798us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400054954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:12.291082 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230798080}
I20260709 13:08:12.263382 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.335669 20149 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.337210 20162 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.338436 20162 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.338924 20162 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.339262 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 63189.2us
I20260709 13:08:12.337904 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.341928 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 824) took 1799 ms. Trace:
I20260709 13:08:12.342533 16272 rpcz_store.cc:276] 0709 13:08:10.482528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.482667 (+   139us) service_pool.cc:224] Handling call
0709 13:08:10.487673 (+  5006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.512878 (+1025205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.281461 (+768583us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540053a054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:12.281817 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356387584}
I20260709 13:08:12.343240 20164 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:12.344223 20164 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:12.340689 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.339385 20162 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.353354 20164 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.358707 20147 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.362728 20062 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.359210 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:12.154279 19793 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.194044 20143 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:12.415019 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 74557.1us
W20260709 13:08:12.419754 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 156695us
I20260709 13:08:12.431654 20006 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:12.432417 20006 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.432935 20006 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:12.434449 19967 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.105s	user 0.012s	sys 0.000s
I20260709 13:08:12.435155 20000 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:12.436558 20203 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:08:12.439229 20060 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:12.441450 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.442849 20181 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.442915 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.444330 15571 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:12.434171 20028 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:08:12.417371 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:12.157485 20003 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.462391 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.463835 15572 raft_consensus.cc:2410] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:12.398156 19992 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:12.357796 20146 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:12.398612 20197 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.469708 20197 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:12.471685 20197 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.473613 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 843) took 1116 ms. Trace:
I20260709 13:08:12.397959 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:12.450366 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.453301 19962 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.453964 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 1904) took 3112 ms. Trace:
I20260709 13:08:12.493997 20109 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:12.496660 20109 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:12.497304 20109 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:12.457818 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.401796 20080 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:12.499198 15723 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:12.499765 20080 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.496935 15728 rpcz_store.cc:276] 0709 13:08:11.357250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.368000 (+ 10750us) service_pool.cc:224] Handling call
0709 13:08:11.368322 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.368647 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.368679 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.369113 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.569162 (+200049us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b180032ac40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:11.794972 (+225810us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.146330 (+351358us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.472796 (+326466us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b54000aab20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598e733 00007f2d95a13dbf 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c
0709 13:08:12.472888 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.473046 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.473131 (+    85us) raft_consensus.cc:1685] finished
0709 13:08:12.473144 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.473420 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":374738,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":36,"raft.queue_time_us":34190,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":24014,"spinlock_wait_cycles":23867520,"thread_start_us":497498,"threads_started":2,"wal-append.queue_time_us":523060}
W20260709 13:08:12.475131 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.456934 19793 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:12.444352 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.510751 15721 pending_rounds.cc:85] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 10
I20260709 13:08:12.511234 15721 pending_rounds.cc:107] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:12.511317 20128 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:12.511605 15721 raft_consensus.cc:2889] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.511938 20128 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:12.499809 20033 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.513602 20128 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.515407 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:12.516347 20128 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.517745 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:12.498054 19962 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:12.519999 20182 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.520551 20182 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.520951 20182 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.521099 19962 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:12.484690 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.486282 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.492981 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 791) took 1727 ms. Trace:
I20260709 13:08:12.403749 20124 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.495175 15580 rpcz_store.cc:276] 0709 13:08:09.281900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.179496 (+897596us) service_pool.cc:224] Handling call
0709 13:08:10.236320 (+ 56824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.670970 (+1434650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.327528 (+656558us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400109d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:12.394376 (+ 66848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3297861888}
I20260709 13:08:12.491542 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.514566 20033 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.553433 20109 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.555110 20109 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:12.532243 15654 rpcz_store.cc:276] 0709 13:08:10.765332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.849954 (+ 84622us) service_pool.cc:224] Handling call
0709 13:08:11.518287 (+668333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.526671 (+  8384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.420941 (+894270us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002e2f50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:12.492703 (+ 71762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524668800}
I20260709 13:08:12.563889 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:12.565886 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.566542 15579 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:12.567826 20003 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.565913 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.573619 19998 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:12.575765 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.580011 20066 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.581490 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:12.582340 15653 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.584115 20006 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:12.590772 15692 leader_election.cc:336] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.546s (SENT)
I20260709 13:08:12.591452 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:12.593063 15692 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.625s (SENT)
W20260709 13:08:12.595697 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.595795 20000 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:12.596707 19794 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:12.596918 20172 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:12.597489 19794 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.600631 19794 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:12.587538 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.604538 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:12.628415 19301 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.116s	user 0.020s	sys 0.000s
I20260709 13:08:12.629258 19301 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.632050 15723 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.593608 20162 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.652740 15653 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:12.659044 15723 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:12.665868 20003 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.672462 15648 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:12.662287 19301 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:12.686981 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 99557.9us
W20260709 13:08:12.687891 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 94912.5us
I20260709 13:08:12.690729 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.687377 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:12.700790 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:12.702901 15724 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:12.749935 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 89455.7us
I20260709 13:08:12.751116 15619 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:12.751502 20033 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.752064 20033 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.752413 20033 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.753866 20141 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.701694 16275 raft_consensus.cc:1217] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 13:08:12.757887 16275 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:08:12.766765 15692 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.678s (SENT)
I20260709 13:08:12.764750 20006 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:12.774062 20080 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:12.777558 20159 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 1.277s	user 0.002s	sys 0.000s
I20260709 13:08:12.782263 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1121) took 1178 ms. Trace:
I20260709 13:08:12.782902 16275 rpcz_store.cc:276] 0709 13:08:11.603859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.607484 (+  3625us) service_pool.cc:224] Handling call
0709 13:08:11.643185 (+ 35701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.701370 (+1058185us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b5400091da0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598adc0 00007f2d95a151c0 00007f2d95a16231 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c
0709 13:08:12.768219 (+ 66849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.782188 (+ 13969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138977664}
W20260709 13:08:12.784401 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 96043.6us
W20260709 13:08:12.774376 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 288396us
I20260709 13:08:12.759819 20141 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:12.791057 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.775074 20162 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:12.801996 20209 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:12.803122 15723 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:12.803619 15723 pending_rounds.cc:85] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:12.803946 15723 pending_rounds.cc:107] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:12.804246 15723 raft_consensus.cc:2889] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.809684 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:12.812516 15723 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:12.813112 15723 pending_rounds.cc:85] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
I20260709 13:08:12.813447 15723 pending_rounds.cc:107] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:12.813766 15723 raft_consensus.cc:2889] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:12.829641 20207 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
W20260709 13:08:12.840399 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 76851.9us
I20260709 13:08:12.768658 20164 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:12.846148 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 59522.2us
I20260709 13:08:12.798555 20128 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:12.861083 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:12.843003 20172 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:12.861912 15725 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
W20260709 13:08:12.873509 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.870795 16236 leader_election.cc:400] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
I20260709 13:08:12.874495 16236 leader_election.cc:403] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.873107 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2037) took 2077 ms. Trace:
I20260709 13:08:12.876297 15649 rpcz_store.cc:276] 0709 13:08:10.795227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.052908 (+257681us) service_pool.cc:224] Handling call
0709 13:08:11.189483 (+136575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.888207 (+698724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.870102 (+981895us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54002698d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:12.872930 (+  2828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598295296}
I20260709 13:08:12.878409 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:12.883602 16275 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:12.854545 20141 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:12.890865 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 127583us
W20260709 13:08:12.885977 20125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.326s	user 0.018s	sys 0.037s
I20260709 13:08:12.899412 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:12.900007 15579 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.902683 15580 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.905414 16276 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:08:12.910249 15578 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:12.895540 20162 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9.
W20260709 13:08:12.902973 20125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.019s	sys 0.037s
W20260709 13:08:12.914742 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.914363 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.924340 15692 leader_election.cc:336] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.711s (SENT)
I20260709 13:08:12.929639 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:12.926908 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:12.930939 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:12.935853 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:12.936244 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.937258 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:12.939404 20146 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:12.948673 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.945041 20033 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:12.965631 20172 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:12.969475 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57633.3us
I20260709 13:08:12.962797 16278 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.963299 20069 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:12.977905 20218 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:12.975155 20182 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.990304 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:12.991043 15646 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:12.992003 20182 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:12.994899 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:12.995550 15650 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.998968 20069 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:12.999657 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:13.001243 20069 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:13.001381 15652 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:13.009971 20068 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:13.010882 20038 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.010658 20068 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.011488 20038 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.012959 20068 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.013530 20038 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:13.016181 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 170188us
I20260709 13:08:13.016933 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:13.017083 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:13.017904 15725 raft_consensus.cc:2410] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:13.018671 16236 leader_election.cc:400] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:13.019013 16236 leader_election.cc:403] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.019392 19794 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.019578 19998 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:13.020352 19794 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:13.020213 19998 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.021255 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.009979 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.021842 15647 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:13.022682 19998 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:13.020692 20144 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.025410 20144 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.024035 20162 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:13.026412 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.027559 20144 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.024554 20149 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:13.029301 20149 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:13.029677 20149 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:13.031776 20161 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:13.030951 20149 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.032501 20161 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.034250 20149 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.038134 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.039125 20125 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.053119 20147 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.020246 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:13.055737 15572 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
W20260709 13:08:13.065574 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 103389us
I20260709 13:08:13.054697 20146 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:13.075421 16278 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:13.076905 15579 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:13.001886 19605 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:13.091269 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 169714us
I20260709 13:08:13.107071 16273 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:13.123420 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:13.124183 15723 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.126061 20200 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:13.126647 20200 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:13.128984 20200 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:13.130740 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 110655us
I20260709 13:08:13.131659 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.130867 20000 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.131994 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:13.132633 20000 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.079044 20146 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:13.135366 20147 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:13.136058 15692 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.723s (SENT)
I20260709 13:08:13.143924 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:13.137271 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.137893 20161 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.133193 16236 leader_election.cc:400] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:13.144836 16236 leader_election.cc:403] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.134438 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:13.138772 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.141690 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.148492 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:13.150839 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:13.151463 15653 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.154088 15649 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.154101 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:13.154637 15651 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:08:13.155005 15651 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:08:13.160422 16278 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:13.146485 20147 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.163640 15728 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.164872 15651 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:08:13.159176 20162 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.192572 20162 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:13.190842 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57776.3us
I20260709 13:08:13.193643 20162 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:13.195564 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.201702 15650 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
W20260709 13:08:13.171293 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.191066 15725 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.202539 15651 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.168291 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.183866 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96662.4us
W20260709 13:08:13.200762 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 66415.1us
I20260709 13:08:13.165537 15655 raft_consensus.cc:2410] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:13.204327 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.205013 15654 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:08:13.205139 16269 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:13.205904 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.206548 15654 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:13.207995 15727 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:13.199884 20172 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:08:13.210950 20225 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:13.211072 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:13.212190 20033 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.212822 20146 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.214548 20146 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:13.220794 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.221483 16272 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:13.221629 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.222291 16276 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:13.222600 16270 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:13.151242 19605 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:08:13.223532 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.225142 20212 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.463s	user 0.003s	sys 0.001s
I20260709 13:08:13.226297 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:13.226958 15723 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.230628 19612 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.231252 19612 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.233637 19612 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.194934 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:13.235397 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.236334 19794 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:13.236719 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:13.236968 19794 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:13.237959 20109 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:13.238394 20109 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:13.238173 19794 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.240808 19951 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:13.241341 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:13.242460 19951 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.242863 19951 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.243204 19951 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.246217 19962 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.246752 19301 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:13.238827 20109 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:13.252806 15543 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:13.262423 20000 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:13.263136 20000 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:13.158624 20182 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.152299 20124 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:08:13.162576 20161 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.259974 20038 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:13.274886 16272 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:13.289534 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.275189 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.275450 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.279222 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 143186us
I20260709 13:08:13.279836 15729 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:13.280105 19612 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.280295 20198 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.280733 20113 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:13.281000 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.281613 20033 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.157631 20164 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:08:13.318810 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.285773 16274 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:13.302974 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:13.202101 20147 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:13.289927 20197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.035s
I20260709 13:08:13.284740 19605 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.321967 15578 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:13.312938 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.282335 20141 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:13.327550 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.324980 15543 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:13.334177 16277 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.334406 15575 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 13:08:13.342010 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:13.353556 15571 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.317548 20135 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.317931 20069 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.357398 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.363121 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.333842 20197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.011s	sys 0.035s
I20260709 13:08:13.366344 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.368606 16270 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:13.373006 16276 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.318686 20124 consensus_queue.cc:1243] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:13.347859 19605 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:13.386392 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:13.280615 20000 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.391938 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.367893 20069 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.393725 15650 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:13.392673 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
W20260709 13:08:13.397099 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.397921 15650 pending_rounds.cc:85] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 9
I20260709 13:08:13.398204 15650 pending_rounds.cc:107] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:13.398437 15650 raft_consensus.cc:2889] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.392027 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:13.413069 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.421528 16270 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:13.428800 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 135965us
I20260709 13:08:13.367472 15723 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:13.419351 20069 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.370409 20135 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.365151 20198 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:13.382738 19612 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:13.374310 20161 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:13.463482 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.378805 20033 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.480010 16270 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:13.482584 16273 raft_consensus.cc:2410] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:13.486529 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.449335 20068 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:13.493440 15653 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:13.506556 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:13.484342 20208 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.719s	user 0.000s	sys 0.004s
W20260709 13:08:13.511518 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 122709us
I20260709 13:08:13.483217 20161 consensus_queue.cc:1243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:13.518244 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:13.518975 15576 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.483650 20141 consensus_queue.cc:1243] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:13.555920 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 126397us
I20260709 13:08:13.559404 16270 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:13.582158 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.525717 19985 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:13.513230 20068 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:13.680114 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 196949us
I20260709 13:08:13.717069 15574 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:13.718479 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.720736 20182 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:13.722143 20210 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.721s	user 0.003s	sys 0.000s
I20260709 13:08:13.826771 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2255) took 1322 ms. Trace:
I20260709 13:08:13.827140 15722 rpcz_store.cc:276] 0709 13:08:12.504109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.504424 (+   315us) service_pool.cc:224] Handling call
0709 13:08:12.505196 (+   772us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:12.506089 (+   893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.506145 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.507186 (+  1041us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.644300 (+137114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:12.644338 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.644405 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.285469 (+641064us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:13.826317 (+540848us) raft_consensus.cc:1685] finished
0709 13:08:13.826336 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.826584 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2902,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":207,"spinlock_wait_cycles":4699904,"thread_start_us":136300,"threads_started":1,"wal-append.queue_time_us":181256}
I20260709 13:08:13.532538 16273 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:13.727607 15653 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:08:13.730713 20228 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:08:13.734686 20109 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.831018 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.833218 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.740154 15651 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.838116 15651 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:13.839166 15651 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:13.839733 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.840590 15651 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.747203 19612 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:13.747555 19996 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:13.748600 20231 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:13.753386 20232 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:08:13.846676 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.847528 15573 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:13.847931 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:13.848670 15580 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:08:13.758805 20230 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:08:13.758944 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.774246 20124 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:13.780386 20135 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:13.849377 20068 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.781839 20033 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:13.787633 19951 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260709 13:08:13.850626 19951 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:13.852635 19951 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:13.818094 15725 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 13:08:13.853615 15725 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:13.738189 20046 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.822106 16276 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:13.821966 16277 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:13.832530 20109 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:13.833027 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:13.841342 20248 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.841958 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.741714 19605 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.725025 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.824302 20182 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:13.820842 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.862906 15572 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.884275 15618 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:13.890869 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.894762 16277 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11.
I20260709 13:08:13.891206 16270 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:13.870378 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.905968 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.907995 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 182331us
I20260709 13:08:13.916716 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.910239 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 435109us
I20260709 13:08:13.921165 15576 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:13.923791 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.924656 16273 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:13.927266 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.927161 19605 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.931926 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.934176 16277 raft_consensus.cc:2368] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11.
I20260709 13:08:13.870569 19985 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:13.944105 20240 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:13.944312 19985 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.944938 20240 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.935531 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.936280 20161 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:13.909106 20135 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.886487 20128 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:08:13.948266 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64095.7us
I20260709 13:08:13.958669 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:13.931141 20141 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.969108 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.971681 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.958941 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:13.960284 20146 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.004s
I20260709 13:08:13.882135 20046 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:13.975653 16275 raft_consensus.cc:2368] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:13.977500 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.980859 15652 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:13.984563 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.981349 15652 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:13.986399 16273 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:13.959020 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.007815 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.010780 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:13.992491 20033 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:14.010795 20060 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:14.050541 20197 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:14.051455 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.051760 15651 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:14.052088 16269 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:14.006311 20146 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:14.053341 16269 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:14.053376 20245 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:14.054797 20245 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:14.055202 20245 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:14.056135 20245 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:14.057075 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45704.3us
I20260709 13:08:14.057178 20135 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.057891 15692 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:14.058475 20033 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.058851 20033 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:14.059196 20135 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.059759 20033 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.060499 15692 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.977s (SENT)
I20260709 13:08:14.047876 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:14.061033 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.041198 20240 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:14.048427 20069 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.575s	user 0.002s	sys 0.005s
I20260709 13:08:14.062330 20172 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:14.062417 20069 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.063256 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:14.063561 20234 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:08:14.063651 20125 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:14.061153 20033 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.052143 15651 pending_rounds.cc:85] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:08:14.065371 15651 pending_rounds.cc:107] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:14.065626 15651 raft_consensus.cc:2889] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.048352 16277 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:13.986251 20109 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.067693 16270 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
W20260709 13:08:14.039288 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.004509 15618 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:14.070534 15651 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.070603 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.045996 15652 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:14.041400 20147 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.004s
W20260709 13:08:14.044248 20247 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:14.086531 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.064090 20125 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:14.090556 15651 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:14.041822 20046 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:14.059777 20135 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:14.113664 20239 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.114719 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:14.076754 19967 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.075192 20197 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:14.124872 15692 leader_election.cc:336] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.033s (SENT)
I20260709 13:08:14.118212 20020 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:14.127991 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.128911 15653 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:14.040424 19919 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:08:14.130815 20069 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:14.110536 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.132256 20125 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.132766 15648 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:14.122175 19951 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:14.133482 20125 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.133675 20135 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.134375 20037 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:08:14.076540 20147 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.133725 19951 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.137496 20147 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:14.104617 20144 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.138198 20144 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:14.138621 20144 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.140697 19951 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:14.141968 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:14.142560 16272 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:08:14.146620 20253 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:14.120318 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.128057 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.145202 16277 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:14.153023 16272 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:14.153672 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:14.155270 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.113788 16236 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:13.996294 20182 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.099802 20109 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.177012 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.177650 15650 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.154264 20046 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.196067 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.197203 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:14.200989 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 196567us
I20260709 13:08:14.202127 15648 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.170849 20146 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:14.197343 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:14.205971 15575 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:14.201694 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:14.208509 15578 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:14.208890 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.209429 15648 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.210477 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.210574 20172 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.212872 20109 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:14.215204 15543 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:14.215307 19985 consensus_queue.cc:1059] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.216948 19985 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.217476 19985 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:14.219147 19301 raft_consensus.cc:3055] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:14.219540 19301 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:14.220417 19301 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.126801 20239 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.222378 16274 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:14.223062 20239 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:14.223240 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 109583us
W20260709 13:08:14.224126 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.224066 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.204035 19967 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.225304 20109 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.203789 20248 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.226507 20248 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.206911 19998 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:14.227638 19998 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.228868 20248 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:14.231134 15653 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 5
I20260709 13:08:14.231443 15653 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:08:14.231752 15653 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.232170 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.221789 19301 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:14.205965 20240 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.229668 19998 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:14.236930 15650 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
W20260709 13:08:14.399617 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 197973us
W20260709 13:08:14.296396 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61077.6us
I20260709 13:08:14.400519 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:14.401472 15648 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:14.198246 20245 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.230149 20146 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.205070 20046 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:14.165055 20197 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.238783 20182 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.418570 16271 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:14.418852 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.423058 16269 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:14.424163 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 314464us
W20260709 13:08:14.424851 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 198831us
I20260709 13:08:14.399682 20124 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:14.431900 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.404881 20239 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:14.450752 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.524755 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.424356 19612 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:14.527163 15605 heartbeater.cc:646] Failed to heartbeat to 127.14.34.190:46799 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.34.190:46799 timed out after 15.000s (SENT)
I20260709 13:08:14.543311 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2269) took 1256 ms. Trace:
I20260709 13:08:14.543735 15721 rpcz_store.cc:276] 0709 13:08:13.287195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.542457 (+1255262us) service_pool.cc:224] Handling call
0709 13:08:14.542817 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.542994 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.543018 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:14.543055 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:14.543082 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.543129 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.543242 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:14.546391 20046 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.567464 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 115441us
I20260709 13:08:14.527359 20051 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
W20260709 13:08:14.231519 20003 consensus_queue.cc:1175] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "680390d3f0884c91bf1f22ba914b438a" responder_term: 12 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:14.528263 20144 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.530546 20237 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.850s	user 0.004s	sys 0.009s
I20260709 13:08:14.530733 20197 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:14.532213 20146 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:14.534415 15692 leader_election.cc:336] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.113s (SENT)
I20260709 13:08:14.454903 20124 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:14.538671 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.541760 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.582836 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:14.590399 19953 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.583786 19962 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:14.590839 20033 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 13:08:14.591061 19953 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:14.591727 15646 raft_consensus.cc:2410] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:14.591275 19962 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.592056 19953 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.593577 19962 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:14.603581 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 144073us
W20260709 13:08:14.609198 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 84525.3us
W20260709 13:08:14.636500 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 438334us
W20260709 13:08:14.637365 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 56204.6us
I20260709 13:08:14.639029 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.640022 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:14.602967 20256 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:14.593880 19953 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.645488 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:14.609081 20250 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.617s	user 0.008s	sys 0.005s
I20260709 13:08:14.598675 20144 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:14.601933 19996 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:14.668063 20109 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.647710 20135 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:14.649011 20240 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:14.674439 15692 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.149s (SENT)
I20260709 13:08:14.675506 19967 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.675320 20124 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.679406 20242 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:14.603142 20068 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:08:14.679898 20248 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:14.682500 20141 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:14.683413 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:14.522521 19985 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.691649 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51697.9us
W20260709 13:08:14.692291 20231 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 13:08:14.648842 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.629249 20006 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.629631 19612 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:14.604386 20197 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:14.738196 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.705196 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2544) took 1334 ms. Trace:
I20260709 13:08:14.706725 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:14.704725 20135 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.746627 15652 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.668882 20125 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.726907 15726 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:14.728109 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44776.3us
I20260709 13:08:14.714248 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:14.728791 15728 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:14.730363 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.753882 15721 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:14.703209 19996 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.702852 20109 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:14.761588 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 112835us
W20260709 13:08:14.774175 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43883.9us
I20260709 13:08:14.739176 15649 rpcz_store.cc:276] 0709 13:08:13.370870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.452691 (+ 81821us) service_pool.cc:224] Handling call
0709 13:08:13.472966 (+ 20275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.523272 (+ 50306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.523317 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.523924 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.825013 (+301089us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:13.825057 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.825124 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.551797 (+726673us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:14.700821 (+149024us) raft_consensus.cc:1685] finished
0709 13:08:14.700843 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.705112 (+  4269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21945,"raft.queue_time_us":51020,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":135277,"spinlock_wait_cycles":4612480,"thread_start_us":320581,"threads_started":2,"wal-append.queue_time_us":401238}
W20260709 13:08:14.791282 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.791882 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.760836 20125 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.769192 20109 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.769781 20240 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.769544 20128 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.816205 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:14.729053 20141 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.713127 20242 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.785446 20245 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.827425 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 179308us
I20260709 13:08:14.795274 19605 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.791580 20003 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:14.812326 20125 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.834192 20251 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:14.834638 20246 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.018s	sys 0.035s
I20260709 13:08:14.820210 19998 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.792217 19919 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:14.842000 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.844009 20198 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:14.845890 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.760651 20248 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.649375 20172 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:14.837984 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:14.862826 15692 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.159s (SENT)
I20260709 13:08:14.863091 15728 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:14.858419 16272 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:14.784849 20238 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:08:14.857234 20240 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.887271 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:14.888445 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72314.2us
W20260709 13:08:14.856616 20246 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.019s	sys 0.036s
I20260709 13:08:14.899219 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.899816 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.902305 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:14.902724 15726 raft_consensus.cc:1275] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:14.899917 15646 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:14.904065 15650 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.907505 15655 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:14.863518 20251 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:14.849293 20245 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.913314 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 344829us
I20260709 13:08:14.920686 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.963245 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.858446 20003 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.964659 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.906347 19605 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.887630 19998 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:14.972786 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:14.972913 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:14.973731 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.968425 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:14.985966 15646 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.853345 19612 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:14.982450 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 61219.1us
I20260709 13:08:14.994486 16236 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:14.888357 20172 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:14.971138 20264 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:15.008828 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 160206us
I20260709 13:08:15.009519 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:15.007416 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:15.019322 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.999079 19919 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.029937 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:15.045096 15720 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.981853 20146 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:08:15.046993 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:14.983435 20263 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:15.049383 15654 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:14.996021 20240 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:15.056348 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:15.060731 15692 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.170s (SENT)
I20260709 13:08:15.041088 20239 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:15.063513 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 248340us
I20260709 13:08:15.044437 20135 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.069470 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:15.056030 20038 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.080018 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.066906 20239 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.042454 20264 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.049696 19919 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:15.084694 20268 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:08:15.062649 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 223343us
I20260709 13:08:15.077473 19605 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:15.083200 20242 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:15.121232 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 110327us
W20260709 13:08:15.118599 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 123811us
W20260709 13:08:15.123515 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.138273 15651 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.127481 15728 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.137919 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:15.156292 20003 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:15.156996 20264 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.158299 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.159871 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.105312 20239 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.103204 20274 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.061343 20251 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.116132 20248 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.128118 20270 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.182770 15720 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
W20260709 13:08:15.184300 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 135527us
I20260709 13:08:15.163483 20037 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.181696 19998 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:15.153674 20245 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.189231 15654 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:15.190920 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:15.200100 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2603) took 1094 ms. Trace:
I20260709 13:08:15.200747 15722 rpcz_store.cc:276] 0709 13:08:14.105955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.116182 (+ 10227us) service_pool.cc:224] Handling call
0709 13:08:14.142644 (+ 26462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.143007 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.143035 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.143471 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.449824 (+306353us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:14.449880 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.449991 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.199900 (+749909us) raft_consensus.cc:1685] finished
0709 13:08:15.199919 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.200040 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1028,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":305929,"threads_started":1,"wal-append.queue_time_us":626029}
I20260709 13:08:15.208781 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:15.210191 15692 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.223s (SENT)
I20260709 13:08:15.210731 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:15.211766 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.200505 20275 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:08:15.215941 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.187813 20238 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.202431 20264 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:08:15.221295 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.221729 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:15.225346 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 223677us
I20260709 13:08:15.229712 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.230073 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.235765 15724 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:08:15.201941 20276 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.201817 20135 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.236260 15724 pending_rounds.cc:85] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 10
I20260709 13:08:15.176787 20297 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:15.244320 15724 pending_rounds.cc:107] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:15.244740 15724 raft_consensus.cc:2889] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.243206 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.249702 15720 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:15.218541 20270 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.218151 20172 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:15.225584 20291 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.220724 20182 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.257148 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:15.243466 20280 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:08:15.220582 20164 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.176995 20274 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.232465 20263 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:15.283423 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56265.3us
I20260709 13:08:15.239415 15652 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:15.240232 20242 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:15.213425 19998 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:15.241943 20276 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:15.258212 20200 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:15.252826 19605 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:15.284415 15652 pending_rounds.cc:85] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 6
I20260709 13:08:15.308950 15652 pending_rounds.cc:107] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:15.309271 15652 raft_consensus.cc:2889] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.291518 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:15.306080 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 99996.5us
W20260709 13:08:15.285586 20285 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:08:15.312794 15646 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:15.313714 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:15.234970 20238 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.314699 16275 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:15.366537 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2057) took 2177 ms. Trace:
W20260709 13:08:15.369107 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 43919.8us
I20260709 13:08:15.286298 20242 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.367133 15652 rpcz_store.cc:276] 0709 13:08:13.139361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.139579 (+   218us) service_pool.cc:224] Handling call
0709 13:08:13.157128 (+ 17549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.980724 (+823596us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000bbe20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9598adc0 00007f2d95a151c0 00007f2d95a16231 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c
0709 13:08:14.045467 (+ 64743us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4c003ff6c0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d93cdfa20 00007f2d93cf0a29 00007f2d93cb6644 00007f2d93cddf2d 00007f2d93cddb93 00007f2d95a0e18b 00007f2d95a0ecb5 00007f2d95a09f30 00007f2d95a0b7de 00007f2d95a15b49 00007f2d95a16416
0709 13:08:14.746419 (+700952us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b58006bb1d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9596f0aa 00007f2d959f1447 00007f2d95a09fe7 00007f2d95a0b7de 00007f2d95a15b49 00007f2d95a16416 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4
0709 13:08:15.316590 (+570171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.316812 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641371392}
W20260709 13:08:15.375077 15692 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.240s (SENT)
I20260709 13:08:15.375592 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:15.370162 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:15.377265 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2549) took 1177 ms. Trace:
I20260709 13:08:15.300920 20299 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.265144 20290 consensus_queue.cc:1048] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:08:15.280021 20182 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.261149 20135 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.377748 15653 rpcz_store.cc:276] 0709 13:08:14.199557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.211531 (+ 11974us) service_pool.cc:224] Handling call
0709 13:08:14.211838 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:14.239674 (+ 27836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.239706 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:14.397072 (+157366us) log.cc:844] Serialized 52 byte log entry
0709 13:08:14.775647 (+378575us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:14.775700 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.825069 (+ 49369us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b540017d754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:14.825125 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.372769 (+547644us) raft_consensus.cc:1685] finished
0709 13:08:15.372798 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.377199 (+  4401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18064,"raft.queue_time_us":7441,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8554,"spinlock_wait_cycles":43926272,"thread_start_us":337975,"threads_started":1,"wal-append.queue_time_us":593184}
I20260709 13:08:15.309988 20028 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:08:15.282904 20164 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.375942 20242 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.371487 20000 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:15.371049 19985 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.317521 19605 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.324352 20200 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.265508 20291 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.393404 20003 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:15.406618 20294 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:08:15.407109 20281 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:08:15.407960 20292 log.cc:927] Time spent T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:08:15.408756 20301 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:08:15.409106 20282 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:08:15.409452 20277 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
W20260709 13:08:15.410130 20023 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:08:15.410290 20298 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:08:15.377441 20146 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:15.395144 20299 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.454648 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.399144 20000 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:15.440364 15654 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:15.445144 15575 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:15.456754 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 81746.3us
I20260709 13:08:15.456583 20299 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:15.457551 15692 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.267s (SENT)
I20260709 13:08:15.457978 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:15.459141 20299 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:15.459317 15692 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.375s (SENT)
I20260709 13:08:15.459787 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:15.460691 20308 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.461900 15579 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.463243 15576 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:15.465746 20141 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.383486 20276 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.448767 15578 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:08:15.483471 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.449303 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46306.8us
I20260709 13:08:15.484330 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:15.485659 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.494566 20317 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:15.495512 20317 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:15.498840 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.501s (SENT) [suppressed 35 similar messages]
I20260709 13:08:15.509205 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1144) took 1089 ms. Trace:
I20260709 13:08:15.511727 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.486192 20003 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:15.514653 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55399.4us
I20260709 13:08:15.482376 20038 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.515167 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:15.516613 15575 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:15.517598 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1143) took 1099 ms. Trace:
I20260709 13:08:15.485611 20270 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.520745 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.518854 16277 rpcz_store.cc:276] 0709 13:08:14.417373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.417509 (+   136us) service_pool.cc:224] Handling call
0709 13:08:14.417923 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.418374 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.418415 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.557677 (+139262us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b2c00012c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:14.567290 (+  9613us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.962345 (+395055us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:15.308200 (+345855us) log.cc:844] Serialized 14 byte log entry
0709 13:08:15.516192 (+207992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.516264 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.516301 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:15.516388 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.516501 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19307,"prepare.queue_time_us":376363,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":84717,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":13481,"spinlock_wait_cycles":4985984,"thread_start_us":835678,"threads_started":3,"wal-append.queue_time_us":495050}
I20260709 13:08:15.517719 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.508790 20020 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.532788 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.503670 20308 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:15.529220 15729 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:15.543460 20278 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.544250 20278 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.544803 20278 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.558817 20141 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.559405 20141 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.561560 20141 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.561357 20278 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.565546 20278 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.565604 20314 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.566447 20314 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:15.569247 20286 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.362s	user 0.001s	sys 0.001s
I20260709 13:08:15.572283 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2602) took 1466 ms. Trace:
I20260709 13:08:15.572696 15725 rpcz_store.cc:276] 0709 13:08:14.105678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.114919 (+  9241us) service_pool.cc:224] Handling call
0709 13:08:14.115201 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.115528 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.115571 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.116089 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.555074 (+438985us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800413fe0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:14.964042 (+408968us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:14.964088 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.964152 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.537545 (+573393us) raft_consensus.cc:1685] finished
0709 13:08:15.537566 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.572219 (+ 34653us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6246,"spinlock_wait_cycles":24001280,"thread_start_us":408343,"threads_started":1,"wal-append.queue_time_us":952836}
I20260709 13:08:15.581736 16275 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:08:15.582857 15692 leader_election.cc:336] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.442s (SENT)
I20260709 13:08:15.584251 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:15.585582 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.592294 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.581751 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.595075 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:15.592934 15575 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:15.590325 20316 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:15.599146 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.605877 15579 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:15.601076 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.602272 15646 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:08:15.566522 20000 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.614830 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:15.622807 16275 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.615578 20006 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.616173 20289 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.616447 20248 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:15.617319 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.618698 20287 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.643205 20287 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.576938 20028 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.646595 20128 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.630980 20326 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:15.647274 20326 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.647125 20128 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.647725 20326 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.647581 20248 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.649266 20128 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.649751 20248 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.657867 16275 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:15.631975 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.632416 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:15.659366 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:15.661125 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:15.638106 20321 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 13:08:15.638936 20135 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:15.639442 20323 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:15.640450 20300 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:15.640924 20308 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.646332 20028 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.526669 20038 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.636129 20000 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.667389 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:15.610621 20314 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:15.627861 19996 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.002s
I20260709 13:08:15.645799 20287 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.679316 20317 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:15.680456 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.623301 20238 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.681102 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.682344 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.684641 20038 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:15.662169 20109 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.004s
I20260709 13:08:15.685796 20164 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.685755 20109 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.680413 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.689081 20109 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:15.666826 20033 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.690171 20326 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.691516 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.692953 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.690217 16272 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.649886 19605 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.694897 15579 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:15.696573 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.701889 15721 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:15.655580 20006 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.704044 19919 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.705040 20006 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.672582 20128 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:15.711160 20128 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.711870 20128 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.713232 20274 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
W20260709 13:08:15.715374 20304 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:08:15.654428 20182 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.697746 20200 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.661412 20289 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.729269 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.721752 20296 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.676880 20124 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:15.731791 20124 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.731544 20296 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.732348 20124 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.667768 20060 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:15.700405 20028 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.660254 20278 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:15.735597 20278 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:15.659389 15574 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:15.681758 15580 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:15.700709 20125 consensus_meta.cc:287] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.844s	user 0.007s	sys 0.003s
I20260709 13:08:15.650983 20291 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.725302 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.727661 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:15.768707 15648 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.727962 15651 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:15.769253 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.785066 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:15.736743 20006 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:15.805042 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.807684 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:15.808405 15721 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:15.777207 20000 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.867872 16269 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:15.731572 20289 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.870260 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:15.702116 19996 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.803386 20291 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:15.805320 20239 consensus_meta.cc:287] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 13:08:15.876219 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:15.876895 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 377804us
I20260709 13:08:15.885370 15648 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:15.774420 20125 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.896937 15576 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:15.896498 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.898671 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.901320 15648 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:15.882272 20291 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.918166 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.886103 20242 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:15.923584 15649 raft_consensus.cc:2393] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:15.926517 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:15.928085 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:15.929096 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:15.930938 15648 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:15.868584 20006 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.782760 20278 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.921113 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:15.948040 16274 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:15.874086 20000 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.897567 20326 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:15.896521 20296 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:15.924459 20291 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.891004 20239 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:15.971577 16274 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:15.932240 20316 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:16.012113 16276 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:15.978245 20258 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.024049 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 111745us
I20260709 13:08:16.027261 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.042970 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:16.047609 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.057015 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.057734 15571 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.047955 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2617) took 1062 ms. Trace:
I20260709 13:08:16.060366 15728 rpcz_store.cc:276] 0709 13:08:14.985994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.139368 (+153374us) service_pool.cc:224] Handling call
0709 13:08:15.170203 (+ 30835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.207960 (+ 37757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.207987 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:15.208026 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:15.208054 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.047748 (+839694us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400003054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:16.047792 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.047904 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80729344}
I20260709 13:08:16.048271 16274 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:16.064761 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.078511 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:16.083113 20332 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:16.088254 20328 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:16.090829 20006 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:16.091602 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.092283 19793 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:16.046192 20313 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.095032 20313 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.098429 19996 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.102384 19953 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.103102 15723 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:16.104936 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.105583 20109 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:16.028595 20258 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.106777 19996 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.108016 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.108613 20258 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.109194 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.102950 19953 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.111243 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.111747 19953 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.114485 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.010278 20316 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.115027 20109 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.105132 20033 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.111929 16276 raft_consensus.cc:2368] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:08:16.117667 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.097823 20313 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:16.131192 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.131888 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:16.132143 20109 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.121840 20033 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.132836 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.133478 20033 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.134873 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:16.135030 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.062268 20274 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.121817 15571 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.135962 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.136204 20242 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.137040 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.138753 20239 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:16.139525 16269 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:16.139624 20125 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.118328 15580 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.141947 20316 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.146934 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.149520 15618 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.135924 20274 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.071652 20289 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.160072 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.117249 20000 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.165123 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.163398 16269 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:16.165992 16269 pending_rounds.cc:85] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 8
I20260709 13:08:16.167260 16269 pending_rounds.cc:107] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:16.167574 16269 raft_consensus.cc:2889] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.169526 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.155510 20006 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.162499 20141 raft_consensus.cc:2804] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.176406 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.145447 20341 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:16.165968 20242 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.176406 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.181996 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:16.182827 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.157883 20125 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:16.170596 20314 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:16.196539 15726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.009s
I20260709 13:08:16.191468 20291 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.192196 20274 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:16.193540 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.197257 15726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.009s
I20260709 13:08:16.157591 20289 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.201077 20289 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.203508 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.196216 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.154572 20128 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.208014 15618 leader_election.cc:400] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:08:16.209550 15618 leader_election.cc:403] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.178568 20028 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.196702 20242 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.217978 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.217628 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.219017 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.219441 20296 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10.
I20260709 13:08:16.206766 20141 raft_consensus.cc:697] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.221311 20141 consensus_queue.cc:237] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.219887 20258 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.509694 16270 rpcz_store.cc:276] 0709 13:08:14.419730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.420252 (+   522us) service_pool.cc:224] Handling call
0709 13:08:14.437847 (+ 17595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:14.457760 (+ 19913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:14.523695 (+ 65935us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:14.695131 (+171436us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c00012c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:14.695721 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 13:08:14.961683 (+265962us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:15.303078 (+341395us) log.cc:844] Serialized 14 byte log entry
0709 13:08:15.498871 (+195793us) log.cc:844] Serialized 14 byte log entry
0709 13:08:15.499069 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.499139 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.508197 (+  9058us) raft_consensus.cc:1685] finished
0709 13:08:15.508216 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:15.509135 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10075,"prepare.queue_time_us":380163,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":99452,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":75270,"spinlock_wait_cycles":5001344,"thread_start_us":782193,"threads_started":3,"wal-append.queue_time_us":364377}
I20260709 13:08:16.224157 20258 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.216101 20349 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.225771 20258 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.208802 20252 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:16.229912 20252 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:16.230302 20291 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.231184 20252 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.232259 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:16.232966 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.233283 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.234393 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.235670 20028 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.236140 20028 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.236330 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.236524 20028 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.236989 15722 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:16.238598 20046 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.239048 20046 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.239259 15723 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:16.239445 20046 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.212100 20274 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.241139 20274 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.243196 15728 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:16.243356 20274 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.243582 20296 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:16.244262 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.244875 15723 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.247897 15475 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 9, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:16.249070 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.251000 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.251606 15728 raft_consensus.cc:3060] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.249475 15475 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 11, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:16.258143 20124 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
I20260709 13:08:16.258292 19919 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:16.260113 20006 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:16.263562 20314 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.277364 20314 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.280854 20028 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.282188 20296 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.256189 20242 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.287292 20028 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.265331 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.265846 15728 raft_consensus.cc:2468] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.264941 15655 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:16.270780 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.290131 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:16.271935 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57569.4us
W20260709 13:08:16.291157 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 221510us
I20260709 13:08:16.292412 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.293257 20283 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.293686 20283 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.293779 20343 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:16.294109 20283 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.298484 20251 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.301648 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.304118 20028 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.307233 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:16.308156 20276 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.320883 15653 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:16.330420 20128 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.289695 20124 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.332878 20124 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.333475 15652 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:16.327137 20308 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.334620 20308 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.296285 20046 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:16.355952 15649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 2064) took 1515 ms (client timeout 1527 ms). Trace:
I20260709 13:08:16.356240 20314 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:16.356449 15649 rpcz_store.cc:269] 0709 13:08:14.840754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.845524 (+  4770us) service_pool.cc:224] Handling call
0709 13:08:16.355727 (+1510203us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400085f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:16.355860 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409687936}
I20260709 13:08:16.359405 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.360396 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.360965 15722 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.361281 20242 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.362039 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.362619 15579 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.363394 16274 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.369364 15722 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:16.370769 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.371498 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.372463 15728 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:16.374581 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.380273 15579 raft_consensus.cc:2468] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.381485 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.382141 15578 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:16.384800 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:16.386261 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:16.386849 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.387773 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.391772 15654 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:16.392170 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.392565 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.386601 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.394307 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.423499 15578 raft_consensus.cc:2368] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11.
I20260709 13:08:16.399658 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:16.424767 16270 raft_consensus.cc:2393] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:16.403187 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.396193 15618 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:08:16.430702 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.432520 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:16.405347 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.392140 20316 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:16.383117 19998 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:16.436543 20023 raft_consensus.cc:2804] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.424868 20279 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.425542 20239 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.427558 20006 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.430907 20238 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.398412 20128 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.392182 19919 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:16.395354 20274 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:08:16.445020 15618 leader_election.cc:400] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11.
I20260709 13:08:16.453950 15576 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:16.467491 15618 leader_election.cc:403] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.450767 20314 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:16.471871 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 66612us
I20260709 13:08:16.454921 20006 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.474887 20279 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.460587 20238 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.459800 20023 raft_consensus.cc:697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.482439 16276 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:16.483033 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:16.483569 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.483618 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:16.485533 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.473923 20128 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.472576 20239 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.475868 20308 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.499511 19612 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.500113 19612 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:16.500453 20355 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:16.501137 19612 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.502480 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.503037 15724 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.503822 20289 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.453927 19998 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.455526 20316 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:16.498291 20351 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:08:16.501583 20242 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.476866 20028 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:16.509822 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.515494 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 944430us
I20260709 13:08:16.494741 20274 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:16.497639 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.468999 19919 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.489251 20238 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.505901 20289 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.521418 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.481936 20006 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.523790 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.544258 15579 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.544368 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.494266 20239 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.491142 16273 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 6.
I20260709 13:08:16.506735 20299 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.488449 20324 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.506623 20046 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.533062 15646 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:16.534407 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.563916 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:16.540683 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2623) took 1033 ms. Trace:
I20260709 13:08:16.564563 16277 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.545039 15576 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:16.551808 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.555016 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.515085 20327 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:08:16.525763 20274 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:16.567060 15728 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.572400 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.544926 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.569478 20003 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:16.585467 20003 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.587162 19998 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.587668 20003 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.588610 20128 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.588744 20274 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.574630 15578 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:16.590063 20274 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:16.591150 20046 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:16.591691 20046 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.593755 20046 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.597604 19605 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.598168 19605 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.576051 20182 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.599135 20182 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.600152 19605 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:16.601495 20182 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.603305 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.603900 15727 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.573905 20023 consensus_queue.cc:237] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:16.575789 15692 connection.cc:256] RPC call timeout handler was delayed by -2.42568389500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:08:16.608955 16278 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:16.611123 20125 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:16.611572 20316 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.617154 15579 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.617249 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.618111 15572 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:16.618404 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.551345 20239 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.564719 15726 rpcz_store.cc:276] 0709 13:08:15.507396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.507502 (+   106us) service_pool.cc:224] Handling call
0709 13:08:15.518491 (+ 10989us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:15.608821 (+ 90330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.608852 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:15.618692 (+  9840us) log.cc:844] Serialized 78 byte log entry
0709 13:08:16.200782 (+582090us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.213677 (+ 12895us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.540220 (+326543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.540335 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.540390 (+    55us) raft_consensus.cc:1685] finished
0709 13:08:16.540410 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.540606 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1184488,"prepare.queue_time_us":12703,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":387982,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":25227,"thread_start_us":661692,"threads_started":2,"wal-append.queue_time_us":691262}
I20260709 13:08:16.629254 16277 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:16.627345 20125 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.630338 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.630973 15573 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:16.631191 20164 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.633852 20125 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.635957 20252 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:16.637902 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.658360 15724 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:16.638451 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.670600 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.670826 15722 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.639184 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.671234 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:16.612736 20357 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:16.642379 15728 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:16.674083 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.570448 20279 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.637753 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.639187 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.680024 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:16.593683 20283 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.584676 20172 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.693682 20172 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.696094 20172 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.668128 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.697110 15726 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 5.
I20260709 13:08:16.688141 15728 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:16.701170 15727 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:16.702478 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:16.703336 20296 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.703866 20296 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:16.703966 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 268456us
I20260709 13:08:16.704916 20296 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.709796 15726 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:16.713407 15728 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:16.717923 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.718427 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.689069 15576 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:16.686743 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1495) took 1385 ms. Trace:
I20260709 13:08:16.735780 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:16.737468 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:16.740764 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 89832.2us
I20260709 13:08:16.720083 16271 rpcz_store.cc:276] 0709 13:08:15.301809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.302054 (+   245us) service_pool.cc:224] Handling call
0709 13:08:15.302434 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.507257 (+204823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.507289 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.507910 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.896781 (+388871us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:15.896813 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.651263 (+754450us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b54006392d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:16.651312 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.651355 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:16.651368 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.686669 (+ 35301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83081,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10488,"spinlock_wait_cycles":17651584,"thread_start_us":546722,"threads_started":2,"wal-append.queue_time_us":623475}
I20260709 13:08:16.745293 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.676419 20258 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:16.689421 20124 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.758776 15579 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.765424 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:16.786077 20124 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:16.787096 20124 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.788177 19919 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:16.789608 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.789140 20125 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.777474 20308 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:16.794504 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 185923us
I20260709 13:08:16.794697 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.798878 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:16.807188 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:16.810891 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:16.651625 20337 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:08:16.668320 20164 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.821319 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.821492 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.823487 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:16.826807 20264 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.827841 20283 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.828030 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:16.831975 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2289) took 1273 ms. Trace:
I20260709 13:08:16.817687 20038 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.832419 15721 rpcz_store.cc:276] 0709 13:08:15.558172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.809053 (+250881us) service_pool.cc:224] Handling call
0709 13:08:15.887032 (+ 77979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.507252 (+620220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.507284 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.510706 (+  3422us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.670837 (+160131us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:16.670887 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.670970 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.831755 (+160785us) raft_consensus.cc:1685] finished
0709 13:08:16.831773 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.831911 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692141,"raft.queue_time_us":628009,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":18408,"thread_start_us":129759,"threads_started":1,"wal-append.queue_time_us":312235}
W20260709 13:08:16.833665 15692 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.942s (SENT)
I20260709 13:08:16.834224 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.835016 20172 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:16.835294 15692 connection.cc:256] RPC call timeout handler was delayed by -2.1540261619999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:08:16.835806 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.836225 15692 connection.cc:256] RPC call timeout handler was delayed by -1.6322695650000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:08:16.836621 15692 connection.cc:256] RPC call timeout handler was delayed by -1.3577695650000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 13:08:16.836951 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2603261619999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32170000000000004s for a response
W20260709 13:08:16.837255 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1667261620000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33210000000000006s for a response
I20260709 13:08:16.844807 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 823) took 1377 ms. Trace:
I20260709 13:08:16.845249 15650 rpcz_store.cc:276] 0709 13:08:15.467751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.487350 (+ 19599us) service_pool.cc:224] Handling call
0709 13:08:15.487753 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.511248 (+ 23495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.511279 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.516970 (+  5691us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.898404 (+381434us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:15.974651 (+ 76247us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.031602 (+ 56951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.031662 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.842560 (+810898us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800324e20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:16.844487 (+  1927us) raft_consensus.cc:1685] finished
0709 13:08:16.844591 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.844716 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23869,"prepare.queue_time_us":26384,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":67029,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8423,"spinlock_wait_cycles":5414144,"thread_start_us":381052,"threads_started":1,"wal-append.queue_time_us":529463}
I20260709 13:08:16.847529 19951 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:16.848131 19951 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:16.849016 19951 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.850901 15652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2566) took 1130 ms. Trace:
I20260709 13:08:16.851305 15652 rpcz_store.cc:276] 0709 13:08:15.720894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.721927 (+  1033us) service_pool.cc:224] Handling call
0709 13:08:16.850727 (+1128800us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400368154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:16.850846 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388080000}
W20260709 13:08:16.837553 15692 connection.cc:256] RPC call timeout handler was delayed by -1.1185420430000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:08:16.855338 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.867556 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.818858 20033 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.856194 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:16.887679 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1486) took 1976 ms. Trace:
I20260709 13:08:16.888188 16272 rpcz_store.cc:276] 0709 13:08:14.910951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.911869 (+   918us) service_pool.cc:224] Handling call
0709 13:08:14.912235 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:15.694471 (+782236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.887375 (+1192904us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54002d50d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:16.887602 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788754816}
W20260709 13:08:16.889411 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 258597us
I20260709 13:08:16.791276 20258 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.900538 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.902164 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.885808 20337 raft_consensus.cc:2764] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:16.881702 20276 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.908373 15693 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:16.890756 20341 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:16.871721 20172 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:16.864799 20238 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.911084 20362 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.922057 20362 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.924607 20362 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:16.927919 20258 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.929054 20337 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.929849 20337 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.930670 20337 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:16.935532 20164 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:16.936090 20239 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:16.915771 20341 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.938387 20341 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:16.906762 20331 consensus_queue.cc:1059] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:16.940214 20331 raft_consensus.cc:3055] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.940587 20331 raft_consensus.cc:740] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:16.896886 20003 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:16.946089 20028 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11.
I20260709 13:08:16.941455 20331 consensus_queue.cc:260] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.947559 20254 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:16.963512 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:16.973353 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:16.975097 15572 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.975219 15652 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:16.972379 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:16.981865 15653 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:16.957624 20254 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:16.965348 20331 raft_consensus.cc:3060] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.989234 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:16.962157 20239 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:16.954612 20308 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:16.952098 20279 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:16.950335 20006 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:16.982476 20309 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.045028 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.978999 20327 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:17.057772 15575 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:17.069833 15655 raft_consensus.cc:1240] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:08:17.053234 20352 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:17.046618 20242 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:08:17.082712 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 177168us
I20260709 13:08:16.998520 20278 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:08:17.067945 20348 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:17.086483 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:17.087628 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:17.088538 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:17.092423 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 349103us
I20260709 13:08:17.095698 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.096452 16276 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:17.111106 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 202842us
I20260709 13:08:17.111466 15648 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.084991 20238 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:17.116598 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:17.121950 15654 raft_consensus.cc:1240] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:17.122999 15653 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:17.123826 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 221701us
I20260709 13:08:17.129297 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:17.089877 20242 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.071767 20254 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:17.145388 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.149042 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.150128 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 152885us
I20260709 13:08:17.157275 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.161758 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:17.164629 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:17.167119 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:17.167840 20003 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.168430 20003 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:17.168897 20003 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.170465 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:17.171275 20392 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:17.171689 20392 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:17.172052 20392 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:17.167959 20391 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:17.176227 20373 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:17.176519 20391 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:17.176846 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.177057 20391 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.178447 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:17.182053 20392 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.182753 15721 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:17.184791 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:17.186534 20369 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:17.186897 20372 log.cc:927] Time spent T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:17.187788 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:17.188297 20371 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:08:17.188588 20369 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.189003 20369 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:17.189422 20369 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.189826 20365 log.cc:927] Time spent T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:17.191563 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2288) took 1633 ms. Trace:
I20260709 13:08:17.191923 15729 rpcz_store.cc:276] 0709 13:08:15.557881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.581251 (+ 23370us) service_pool.cc:224] Handling call
0709 13:08:15.605588 (+ 24337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.486420 (+880832us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:16.507035 (+ 20615us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.954233 (+447198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.978754 (+ 24521us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.979069 (+   315us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:16.979115 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.979286 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.191355 (+212069us) raft_consensus.cc:1685] finished
0709 13:08:17.191378 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.191504 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":944842,"prepare.queue_time_us":24224,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":891761,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":1238,"thread_start_us":409945,"threads_started":1,"wal-append.queue_time_us":566906}
I20260709 13:08:17.138865 20135 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:17.205087 20340 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:08:17.219643 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 58073.4us
I20260709 13:08:17.220779 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:17.201593 20254 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.197027 20369 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:17.282706 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45419us
I20260709 13:08:17.291093 20242 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.297122 15475 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 5, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 5 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:17.298830 15475 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 8, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.300848 15475 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 10, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 10 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:16.926318 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:17.293155 15478 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 253) took 32504 ms (client timeout 15000 ms). Trace:
I20260709 13:08:17.322906 15572 raft_consensus.cc:2468] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:17.244622 20172 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:17.337793 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 103368us
I20260709 13:08:17.332399 15475 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 10, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 10 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:17.359575 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:17.365628 16273 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:17.327277 20242 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.326939 20392 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.418481 15475 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 8, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 8 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:17.425838 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 66356.1us
I20260709 13:08:17.426831 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:17.413669 20313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.010s	sys 0.007s
I20260709 13:08:17.427735 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:17.430840 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:17.407668 20340 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:08:17.306847 15478 rpcz_store.cc:269] 0709 13:07:44.788345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.788547 (+   202us) service_pool.cc:224] Handling call
0709 13:08:17.292902 (+32504355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:07.717515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:07.790537 (+ 73022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:07.790585 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:07.790602 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:07.849558 (+ 58956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:07.863809 (+ 14251us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:07.865931 (+  2122us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:07.921872 (+ 55941us) tablet.cc:701] Row locks acquired
0709 13:08:07.921922 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:08:07.922126 (+   204us) write_op.cc:270] Start()
0709 13:08:07.922298 (+   172us) write_op.cc:276] Timestamp: P: 1783602487922053 usec, L: 0
0709 13:08:07.922333 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:08:08.028688 (+106355us) log.cc:844] Serialized 5512 byte log entry
0709 13:08:09.042801 (+1014113us) op_driver.cc:464] REPLICATION: finished
0709 13:08:09.720374 (+677573us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d929090ac 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d99449ef0
0709 13:08:10.528566 (+808192us) write_op.cc:301] APPLY: starting
0709 13:08:10.528685 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:10.656943 (+128258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:10.656985 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:11.156970 (+499985us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:11.206750 (+ 49780us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:08:11.206845 (+    95us) write_op.cc:312] APPLY: finished
0709 13:08:11.207443 (+   598us) log.cc:844] Serialized 129 byte log entry
0709 13:08:11.371924 (+164481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:11.417160 (+ 45236us) write_op.cc:454] Released schema lock
0709 13:08:11.455826 (+ 38666us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:11.517445 (+ 61619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:11.517476 (+    31us) write_op.cc:454] Released schema lock
0709 13:08:12.776603 (+1259127us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
Metrics: {"mutex_wait_us":10582,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":1444842,"apply.run_cpu_time_us":35205,"apply.run_wall_time_us":958971,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":146590,"prepare.run_cpu_time_us":24751,"prepare.run_wall_time_us":528715,"raft.queue_time_us":288674,"raft.run_cpu_time_us":28118,"raft.run_wall_time_us":1227914,"replication_time_us":1120298,"spinlock_wait_cycles":265875072,"thread_start_us":1515472,"threads_started":5,"wal-append.queue_time_us":432822,"wal-append.run_cpu_time_us":11078,"wal-append.run_wall_time_us":3880830}]]}
I20260709 13:08:17.361209 20341 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.433324 15475 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:17.406822 20385 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.423399 20006 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:17.436746 20313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.012s	sys 0.008s
I20260709 13:08:17.432287 20392 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:17.523479 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.449594 20046 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.454249 20172 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.530150 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.532918 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:17.533216 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.534402 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:17.534740 20391 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:17.538599 20393 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:17.416180 20242 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:17.548070 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 110137us
W20260709 13:08:17.548906 16236 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.501s (SENT)
I20260709 13:08:17.556838 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:17.550464 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:17.558249 15729 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:17.552233 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.552927 15721 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:17.579031 15728 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:17.572764 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.553154 15475 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.561581 20239 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:17.592558 20242 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.551637 20386 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.598778 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:17.541488 20046 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.603549 15475 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.601579 15729 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:17.600565 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.607931 15722 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:17.609421 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.554927 20006 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.621789 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:17.612836 15475 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:17.615919 20384 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:08:17.617293 20033 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.000s
I20260709 13:08:17.629439 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.610627 20046 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.627787 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.563066 20003 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.636873 16273 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:17.633034 15729 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 15: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:17.633670 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:17.638357 16276 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:17.634938 15475 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 9, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:17.637111 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.620944 20124 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.622802 20239 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:17.641724 15647 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:17.640913 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.646195 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.644207 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:17.628499 20238 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.629248 20006 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.651237 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:17.652294 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:17.653051 16274 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:17.644980 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:17.656621 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:17.658648 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.662698 15729 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:17.656888 15475 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 8, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 8 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:17.651036 20124 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:17.666170 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.678614 20252 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:17.678373 16235 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:17.664994 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.714536 15729 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:17.715376 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.677786 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:17.675787 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:17.674269 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 677471us
I20260709 13:08:17.661478 20392 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.720570 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:17.723913 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.724084 16273 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:17.668437 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 112078us
W20260709 13:08:17.670050 20331 consensus_meta.cc:287] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
W20260709 13:08:17.726469 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 58878us
I20260709 13:08:17.677024 20003 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.679780 20326 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.675264 20391 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.675549 20341 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.679595 20309 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.736249 15575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 910) took 1385 ms (client timeout 1702 ms). Trace:
I20260709 13:08:18.113773 20125 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.727399 20238 raft_consensus.cc:2804] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:18.200501 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:17.869377 20124 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:17.956585 20411 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.845314 20279 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.357s
I20260709 13:08:18.203032 20279 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:18.202783 20411 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:17.831779 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106609us
I20260709 13:08:18.201684 20331 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:17.679991 20327 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.007979 20046 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.722743 20252 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.237247 20327 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:17.735419 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.042183 20392 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:18.203797 20003 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.238579 20392 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:18.201238 15575 rpcz_store.cc:269] 0709 13:08:16.350766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.370512 (+ 19746us) service_pool.cc:224] Handling call
0709 13:08:17.735976 (+1365464us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54003fa7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:17.736151 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567321856}
I20260709 13:08:18.239135 20252 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.214536 20369 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.835314 20405 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.846665 19962 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.395s
I20260709 13:08:18.240752 20392 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.205263 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:17.779911 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.242136 20326 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.221961 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:17.957897 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 238486us
I20260709 13:08:18.243943 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:18.239565 20003 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:17.862924 20296 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:17.819494 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.246767 20296 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.247529 20419 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.223135 20264 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:18.248211 20419 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.248553 20264 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.250017 20420 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.241822 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:18.250576 20264 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.002351 20006 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:17.970418 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.250784 20327 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.240640 20405 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.283231 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.283228 20327 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.284456 20405 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.271440 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.287300 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.287932 15575 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:18.291421 20416 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.292409 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2072) took 1907 ms. Trace:
I20260709 13:08:18.292872 15655 rpcz_store.cc:276] 0709 13:08:16.384619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.386497 (+  1878us) service_pool.cc:224] Handling call
0709 13:08:16.427177 (+ 40680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.073332 (+646155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.292107 (+1218775us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400419954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:18.292293 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459046272}
I20260709 13:08:18.295140 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:18.295647 20390 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.769s	user 0.006s	sys 0.005s
I20260709 13:08:18.295822 15727 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:18.296761 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:18.297273 15727 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:18.298432 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.298966 20424 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.299615 20424 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.300653 15575 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.301185 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:18.301956 20424 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:18.247622 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.316401 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.317068 15576 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:18.319988 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:18.320271 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2645) took 1521 ms. Trace:
I20260709 13:08:18.248883 20296 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:17.947503 20383 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:18.201387 20125 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.203454 20279 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:18.241276 20392 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:17.909904 16273 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:18.254484 20238 raft_consensus.cc:697] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:18.255666 20379 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.971s	user 0.006s	sys 0.006s
I20260709 13:08:18.251530 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.257421 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.258714 20420 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.251904 20003 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.220201 20324 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:18.259093 20419 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:18.263203 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2594) took 1289 ms. Trace:
I20260709 13:08:17.861956 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:17.725777 20239 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:17.953094 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 107475us
I20260709 13:08:18.103250 20313 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.267268 20386 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:18.205452 20337 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.368840 19301 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:17.825461 15475 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:17.863195 20408 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:18.274260 20331 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:18.275127 15649 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.848330 20410 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.407s
I20260709 13:08:18.278980 20161 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.241341 19962 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:18.281147 20046 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.201254 20309 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.238715 15729 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:18.292068 20416 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.244961 20326 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:18.407570 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 149222us
I20260709 13:08:18.305653 20411 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.306532 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:18.307313 20403 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.771s	user 0.006s	sys 0.006s
I20260709 13:08:18.307538 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:18.307832 20109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.770s	user 0.012s	sys 0.020s
I20260709 13:08:18.308089 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.308447 20316 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:18.309792 15579 raft_consensus.cc:1275] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:18.326473 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.327270 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:18.326793 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.338984 15580 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:18.320640 15724 rpcz_store.cc:276] 0709 13:08:16.798386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.800321 (+  1935us) service_pool.cc:224] Handling call
0709 13:08:16.800605 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.800803 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:16.816926 (+ 16123us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.271051 (+1454125us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18003e3ce0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b323a 00007f2d95a1da2a
0709 13:08:18.319807 (+ 48756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.320010 (+   203us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:18.320058 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.320128 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.320225 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21760,"prepare.queue_time_us":6010,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":2971008,"thread_start_us":48545,"threads_started":1}
I20260709 13:08:18.371441 20239 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.425920 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.426975 15724 raft_consensus.cc:2410] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:18.346060 16277 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:18.423933 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:18.348695 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.348217 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.357983 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:18.405982 20289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.023s	sys 0.036s
I20260709 13:08:18.358937 15648 rpcz_store.cc:276] 0709 13:08:16.974130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.981492 (+  7362us) service_pool.cc:224] Handling call
0709 13:08:16.981729 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.111901 (+130172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.262894 (+1150993us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540035c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:18.263126 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297948928}
W20260709 13:08:18.419675 20109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.885s	user 0.013s	sys 0.020s
I20260709 13:08:18.370375 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.405386 19962 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:18.438704 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:18.337457 20398 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.340996 20252 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:18.348222 19967 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.405092 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 103965us
I20260709 13:08:18.472443 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:18.473948 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:18.406513 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.474941 15729 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:18.358158 20383 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.406744 15543 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:18.369166 20386 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.369349 20337 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:18.361810 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:18.373303 20248 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.377023 20405 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.362856 20392 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.406648 20324 raft_consensus.cc:3055] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.363309 15727 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:18.431185 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.551827 15724 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:18.553095 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.432093 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.433897 15574 raft_consensus.cc:2368] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 6. Current term is 7.
I20260709 13:08:18.432560 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.555482 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:18.556676 15579 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:18.431803 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.433736 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:18.559497 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.560760 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.432327 15475 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 11, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:18.430819 20289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.023s	sys 0.041s
I20260709 13:08:18.432024 20279 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.447818 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.408218 20161 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.428140 20369 consensus_queue.cc:1059] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:18.422991 20316 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.451913 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.455983 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.468245 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:08:18.619985 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 151831us
I20260709 13:08:18.440696 15722 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:18.245378 20341 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:18.475984 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:18.626050 15571 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:18.477574 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:18.371795 20313 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.484345 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.429513 20239 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:18.485634 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 78952us
I20260709 13:08:18.405457 20331 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:18.544906 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71030.1us
W20260709 13:08:18.483129 20426 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:18.563738 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:18.648478 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 84858.3us
I20260709 13:08:18.567574 15475 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:18.569147 15724 raft_consensus.cc:2410] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:08:18.561200 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.476668 20003 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.595709 16277 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:18.607745 15723 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:18.480813 20428 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.483438 20419 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.475904 20398 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.478267 20046 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.623051 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.627230 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 876) took 1034 ms. Trace:
I20260709 13:08:18.665104 15722 rpcz_store.cc:276] 0709 13:08:17.592377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.349203 (+756826us) service_pool.cc:224] Handling call
0709 13:08:18.627154 (+277951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.663038 15475 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 9, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.572477 20283 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:18.666512 20283 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:18.629631 15729 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:18.666904 15475 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.667757 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.668301 15729 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:18.668331 15475 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:18.669203 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:18.669888 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 2341) took 1106 ms. Trace:
I20260709 13:08:18.670241 15729 rpcz_store.cc:276] 0709 13:08:17.563866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.668984 (+1105118us) service_pool.cc:224] Handling call
0709 13:08:18.669837 (+   853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.631311 20410 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.643564 15573 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:18.479789 20252 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.644646 20279 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.565430 20324 raft_consensus.cc:740] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:18.650527 16272 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:18.480583 19967 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:18.647099 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 285384us
I20260709 13:08:18.653378 15575 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:08:18.653455 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.653456 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:18.773075 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 119712us
I20260709 13:08:18.774009 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:18.775347 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:18.657589 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 880) took 1012 ms. Trace:
I20260709 13:08:18.776473 15724 rpcz_store.cc:276] 0709 13:08:17.645417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.552747 (+907330us) service_pool.cc:224] Handling call
0709 13:08:18.657504 (+104757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.777671 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.480232 20424 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.624166 20316 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:18.674635 20410 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:18.671195 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.960184 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:18.960871 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 854) took 1425 ms. Trace:
I20260709 13:08:18.961226 15729 rpcz_store.cc:276] 0709 13:08:17.535904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.670991 (+1135087us) service_pool.cc:224] Handling call
0709 13:08:18.960812 (+289821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.663367 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.962603 15727 raft_consensus.cc:2410] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:18.962433 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.963053 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 860) took 1425 ms. Trace:
I20260709 13:08:18.963398 15727 rpcz_store.cc:276] 0709 13:08:17.537511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.625082 (+1087571us) service_pool.cc:224] Handling call
0709 13:08:18.962994 (+337912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.964330 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.964591 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.965183 15727 raft_consensus.cc:2410] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:18.965229 16278 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:18.965750 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 869) took 1425 ms. Trace:
I20260709 13:08:18.663995 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.669606 15475 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:18.672390 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:18.979034 15722 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:18.675422 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.675882 15721 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:18.557708 20248 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.631503 20369 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:18.648038 20245 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.004078 20245 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.004594 20245 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.767472 20283 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.004238 20369 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.009218 20369 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.709837 20324 consensus_queue.cc:260] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.705410 19967 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.696949 15648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:19.010169 20369 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:18.660113 20239 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.010788 20369 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.011771 20239 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.012537 20239 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.662413 20428 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.708986 20161 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.706609 20252 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:18.714411 20423 log.cc:927] Time spent T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:08:18.573352 20405 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.713714 20392 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.659966 20003 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.715898 20313 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.707512 20398 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.659583 20420 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:18.721618 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.695907 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.678864 20006 consensus_queue.cc:1059] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:18.703814 20309 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.651042 20337 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:18.679524 20046 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.704875 20421 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.043915 16272 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.785269 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 872) took 1194 ms. Trace:
I20260709 13:08:18.475167 20238 consensus_queue.cc:237] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:18.929071 20418 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:18.630385 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 152942us
I20260709 13:08:18.966389 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:18.975318 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.125982 15729 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:19.126569 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 879) took 1482 ms. Trace:
I20260709 13:08:19.127023 15729 rpcz_store.cc:276] 0709 13:08:17.644668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.974878 (+1330210us) service_pool.cc:224] Handling call
0709 13:08:19.126509 (+151631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.130491 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 164196us
W20260709 13:08:19.131384 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.981456 15727 rpcz_store.cc:276] 0709 13:08:17.540033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.964066 (+1424033us) service_pool.cc:224] Handling call
0709 13:08:18.965698 (+  1632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.984791 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:18.985306 20416 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:18.985379 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:18.987553 20124 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:18.989670 20424 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:19.047358 20028 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.093632 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.084154 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.101987 15724 rpcz_store.cc:276] 0709 13:08:17.591189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.777340 (+1186151us) service_pool.cc:224] Handling call
0709 13:08:18.785178 (+  7838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.102865 15578 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
W20260709 13:08:19.111231 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.111662 15722 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 15. Ops: []
I20260709 13:08:19.079120 15475 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.674927 19962 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.132865 15571 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:19.178578 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 857) took 1641 ms. Trace:
W20260709 13:08:19.178774 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 403470us
I20260709 13:08:19.134173 16278 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:19.181107 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.100857 16277 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:19.136754 15729 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:19.015483 20369 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.185998 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 858) took 1649 ms. Trace:
I20260709 13:08:19.186465 15729 rpcz_store.cc:276] 0709 13:08:17.536973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.135785 (+1598812us) service_pool.cc:224] Handling call
0709 13:08:19.136141 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.185703 (+ 49562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.185910 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.154630 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.187742 15646 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:19.188223 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2337) took 1642 ms. Trace:
I20260709 13:08:19.188669 15729 rpcz_store.cc:276] 0709 13:08:17.545494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.187495 (+1642001us) service_pool.cc:224] Handling call
0709 13:08:19.187782 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.187941 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.187967 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.188009 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:19.188041 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.188094 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.188177 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.016120 20428 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.143046 15580 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:19.044176 20109 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.076668 20331 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:18.994467 20437 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.151669 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 478484us
I20260709 13:08:19.132253 20337 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:19.178797 15647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 840) took 2414 ms (client timeout 2218 ms). Trace:
I20260709 13:08:19.182070 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2336) took 1637 ms. Trace:
W20260709 13:08:19.181190 16273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.015s
I20260709 13:08:19.181968 15722 rpcz_store.cc:276] 0709 13:08:17.536686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.049196 (+1512510us) service_pool.cc:224] Handling call
0709 13:08:19.111403 (+ 62207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.178327 (+ 66924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.178522 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.958525 20435 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:19.128471 20418 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.192487 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:19.219791 15647 rpcz_store.cc:269] 0709 13:08:16.735118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.737114 (+  1996us) service_pool.cc:224] Handling call
0709 13:08:19.149336 (+2412222us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400156154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.149499 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077612416}
W20260709 13:08:19.213629 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.010s	sys 0.009s
W20260709 13:08:19.153467 20370 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 2.153s	user 0.013s	sys 0.027s
I20260709 13:08:19.144730 20309 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:19.240031 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.027s
I20260709 13:08:18.969033 20410 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.132332 20392 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.131783 20436 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:19.132098 20429 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:08:19.222968 16273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.008s	sys 0.016s
I20260709 13:08:19.223086 15475 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:19.223069 15724 rpcz_store.cc:276] 0709 13:08:17.544791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.178083 (+1633292us) service_pool.cc:224] Handling call
0709 13:08:19.181562 (+  3479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.181751 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.181776 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.181819 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.181849 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.181901 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.182000 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.219296 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:19.198179 20289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.027s	sys 0.028s
I20260709 13:08:19.228832 20435 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:19.269351 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50098us
I20260709 13:08:19.270515 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.272176 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.273525 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:19.237164 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.011s	sys 0.009s
I20260709 13:08:19.231299 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:19.240442 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.002s	sys 0.028s
I20260709 13:08:19.138126 20398 raft_consensus.cc:3055] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:19.242306 15722 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:19.214718 20109 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.243067 20309 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.285076 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2339) took 1738 ms. Trace:
I20260709 13:08:19.289846 15722 rpcz_store.cc:276] 0709 13:08:17.546839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.222739 (+1675900us) service_pool.cc:224] Handling call
0709 13:08:19.242154 (+ 19415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.280154 (+ 38000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.285021 (+  4867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.279783 15646 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:19.192773 20028 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.236464 20418 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:19.128962 20421 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.259913 15475 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 8, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 8 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:19.261368 20289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.031s	sys 0.028s
I20260709 13:08:19.301797 15475 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.252966 20383 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:19.304175 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.305184 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.253031 20442 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.153328 20124 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.221158 20411 consensus_queue.cc:1048] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:19.221421 20296 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:08:19.291069 15723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 851) took 1726 ms (client timeout 1588 ms). Trace:
I20260709 13:08:19.290706 20439 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.308899 15648 raft_consensus.cc:606] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:19.326154 15652 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:19.326318 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2331) took 2147 ms. Trace:
I20260709 13:08:19.310679 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.311081 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:19.313964 15475 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 4 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:19.286379 20436 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:19.320914 20389 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 2.027s	user 0.011s	sys 0.029s
I20260709 13:08:19.287914 20109 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.319168 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.295257 20309 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.323127 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.295033 20313 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.285431 20435 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.293673 20239 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.222396 20437 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.327425 15646 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:08:19.326670 15728 rpcz_store.cc:276] 0709 13:08:17.172847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.180379 (+  7532us) service_pool.cc:224] Handling call
0709 13:08:17.180699 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.579599 (+398900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.320387 (+1740788us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540011b2d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.320584 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915637632}
I20260709 13:08:19.253984 20392 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.284848 20398 raft_consensus.cc:740] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:19.345232 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.345323 15728 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:19.346417 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2342) took 1748 ms. Trace:
W20260709 13:08:19.323937 15723 rpcz_store.cc:269] 0709 13:08:17.535093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.861658 (+326565us) service_pool.cc:224] Handling call
0709 13:08:19.261710 (+1400052us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400003554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.261865 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570617216}
I20260709 13:08:19.329355 20424 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.320631 20383 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.346804 15728 rpcz_store.cc:276] 0709 13:08:17.598469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.344797 (+1746328us) service_pool.cc:224] Handling call
0709 13:08:19.345034 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.346098 (+  1064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.346351 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.351531 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 79438.3us
I20260709 13:08:19.351692 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.331540 20451 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.352387 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.333200 20252 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:19.333348 20428 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.355063 20383 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.363214 20245 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.326649 20442 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.358489 15724 raft_consensus.cc:1275] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:08:19.366436 15724 pending_rounds.cc:85] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 6
I20260709 13:08:19.366700 15724 pending_rounds.cc:107] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:08:19.367010 15724 raft_consensus.cc:2889] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.368767 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:19.355155 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.374878 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.384737 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.386274 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.388931 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2315) took 3030 ms. Trace:
I20260709 13:08:19.365357 20245 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.350939 20424 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.394532 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:19.365275 20441 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:08:19.354475 20444 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.361176 20252 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.389508 15720 rpcz_store.cc:276] 0709 13:08:16.358258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.362112 (+  3854us) service_pool.cc:224] Handling call
0709 13:08:16.362406 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.631816 (+269410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.631852 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.634349 (+  2497us) log.cc:844] Serialized 52 byte log entry
0709 13:08:16.883020 (+248671us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:16.911193 (+ 28173us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.128734 (+217541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.128995 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.123083 (+1994088us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:19.370123 (+247040us) raft_consensus.cc:1685] finished
0709 13:08:19.388711 (+ 18588us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.388857 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":275635,"prepare.queue_time_us":31882,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":327214,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5459,"spinlock_wait_cycles":7018752,"thread_start_us":465390,"threads_started":2,"wal-append.queue_time_us":331226}
I20260709 13:08:19.366489 20046 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.408280 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:19.360441 20369 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.339294 20038 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:08:19.413504 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 193613us
I20260709 13:08:19.392465 20326 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.368891 20443 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.385957 20003 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.398264 20439 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.400419 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.362270 20428 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.423127 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.412098 20252 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.415300 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:19.396117 20248 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.392983 20313 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.411003 20245 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:19.468040 20245 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.468498 20245 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.399169 20239 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.397229 20424 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.362432 20451 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.395541 20450 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.438284 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.423283 20457 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.477761 15723 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:19.408107 20449 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.443681 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2345) took 1617 ms. Trace:
I20260709 13:08:19.427018 20326 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.433593 20124 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:19.452919 20419 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.000s
I20260709 13:08:19.440132 20411 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:19.454368 20386 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.000s
I20260709 13:08:19.455449 20392 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.457412 20455 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:19.458658 20182 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.461962 20428 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.429855 20369 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.436074 20443 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.480119 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.434077 20003 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.482101 15720 rpcz_store.cc:276] 0709 13:08:17.826424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.442145 (+1615721us) service_pool.cc:224] Handling call
0709 13:08:19.442757 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.443080 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.443118 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.443220 (+   102us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.443294 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.443411 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.443614 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.495152 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2340) took 1934 ms. Trace:
W20260709 13:08:19.490561 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 863) took 1952 ms (client timeout 1501 ms). Trace:
W20260709 13:08:19.581080 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101069us
I20260709 13:08:19.585404 15724 rpcz_store.cc:276] 0709 13:08:17.561262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.253731 (+1692469us) service_pool.cc:224] Handling call
0709 13:08:19.260897 (+  7166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.367635 (+106738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.494848 (+127213us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b5400114254. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.495077 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223551872}
I20260709 13:08:19.587495 15724 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:19.588284 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2349) took 1573 ms. Trace:
I20260709 13:08:19.588675 15724 rpcz_store.cc:276] 0709 13:08:18.015089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.586897 (+1571808us) service_pool.cc:224] Handling call
0709 13:08:19.587273 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.587981 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.588222 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.591885 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2350) took 1575 ms. Trace:
I20260709 13:08:19.522135 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.414124 20398 consensus_queue.cc:260] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:19.581777 15726 rpcz_store.cc:269] 0709 13:08:17.538400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.490355 (+1951955us) service_pool.cc:211] Skipping call since client already timed out
0709 13:08:19.490475 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:08:19.595806 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 73826.2us
I20260709 13:08:19.597288 19967 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.486394 20419 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.489859 20125 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.592499 15724 rpcz_store.cc:276] 0709 13:08:18.016025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.589583 (+1573558us) service_pool.cc:224] Handling call
0709 13:08:19.589975 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.591461 (+  1486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.591500 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.591558 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:19.591613 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.591686 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.591822 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.492062 20452 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:08:19.492731 20446 log.cc:927] Time spent T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:19.497407 20326 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.596642 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2351) took 1445 ms. Trace:
I20260709 13:08:19.619129 15726 rpcz_store.cc:276] 0709 13:08:18.151150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.595653 (+1444503us) service_pool.cc:224] Handling call
0709 13:08:19.596003 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.596207 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.596243 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.596297 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.596342 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.596409 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.596565 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.597556 15546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.022s	sys 0.036s
I20260709 13:08:19.599212 15727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2335) took 2055 ms. Trace:
I20260709 13:08:19.486334 20450 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.414754 20444 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:19.592749 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 192404us
I20260709 13:08:19.593921 20461 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.485826 20458 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.491345 20451 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.607807 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2651) took 1349 ms. Trace:
I20260709 13:08:19.642933 15724 rpcz_store.cc:276] 0709 13:08:18.258275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.607016 (+1348741us) service_pool.cc:224] Handling call
0709 13:08:19.607309 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.607515 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.607537 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.607579 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.607609 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.607661 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.607758 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.645453 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2352) took 1384 ms. Trace:
I20260709 13:08:19.484563 20449 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.484970 20405 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.591053 20258 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.646360 20449 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:19.620759 15546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.022s	sys 0.036s
I20260709 13:08:19.624137 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:19.579558 20182 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.626534 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.493939 20455 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:19.652539 20455 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.653342 20182 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.653818 20455 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.653340 20258 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.655514 20258 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:19.655827 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.655925 20258 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:19.493598 20386 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.657197 15654 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.658339 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2092) took 1235 ms. Trace:
I20260709 13:08:19.629556 16271 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:19.658679 15654 rpcz_store.cc:276] 0709 13:08:18.423438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.432408 (+  8970us) service_pool.cc:224] Handling call
0709 13:08:18.432669 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.657555 (+1224886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.658128 (+   573us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400156b54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.658281 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815771904}
I20260709 13:08:19.659560 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1187) took 1408 ms. Trace:
I20260709 13:08:19.659873 16271 rpcz_store.cc:276] 0709 13:08:18.251171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.251964 (+   793us) service_pool.cc:224] Handling call
0709 13:08:18.254322 (+  2358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.658823 (+1404501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.659353 (+   530us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400692654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.659512 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162247936}
I20260709 13:08:19.658365 20386 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.664248 20258 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.645916 15724 rpcz_store.cc:276] 0709 13:08:18.261352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.644340 (+1382988us) service_pool.cc:224] Handling call
0709 13:08:19.644732 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.644989 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.645027 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.645087 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.645134 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.645204 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.645381 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.667717 20258 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.593698 20003 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.485116 20457 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.612378 20398 raft_consensus.cc:3060] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.638346 20467 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.678692 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 52234.1us
I20260709 13:08:19.616390 20437 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.687822 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.688812 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2338) took 2142 ms. Trace:
W20260709 13:08:19.692198 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.676339 20003 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:19.630920 20395 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 2.099s	user 0.012s	sys 0.030s
W20260709 13:08:19.711189 20316 consensus_meta.cc:287] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:08:19.711606 20316 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.712642 16273 raft_consensus.cc:1240] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:19.713649 20316 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.714092 20238 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.714623 20238 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.716604 20238 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.720057 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:19.720985 20003 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.722281 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.706784 20331 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.726291 20331 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.693590 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2346) took 1745 ms. Trace:
I20260709 13:08:19.699470 15580 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.702798 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.704280 15579 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:19.705171 20038 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.729696 20392 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:19.731081 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.731457 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:19.731150 20038 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.732630 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.733417 20038 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.705680 20419 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:19.733623 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:19.686890 20450 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.730216 15577 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:19.695537 15729 rpcz_store.cc:276] 0709 13:08:17.546278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.190382 (+1644104us) service_pool.cc:224] Handling call
0709 13:08:19.190756 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.190994 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:19.509165 (+318171us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.688424 (+179259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.688490 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.688537 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.688623 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.688751 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27809,"prepare.queue_time_us":263776,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":24,"raft.queue_time_us":19061,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":43229,"thread_start_us":421140,"threads_started":3,"wal-append.queue_time_us":144841}
W20260709 13:08:19.707342 16236 connection.cc:256] RPC call timeout handler was delayed by -1.541961778999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 13:08:19.709108 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.735565 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.707055 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2334) took 2164 ms. Trace:
I20260709 13:08:19.729183 15720 rpcz_store.cc:276] 0709 13:08:17.948041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.582430 (+1634389us) service_pool.cc:224] Handling call
0709 13:08:19.582805 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.583045 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:19.590452 (+  7407us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.692866 (+102414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.692919 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.692963 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.693028 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.693151 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":5209,"raft.queue_time_us":19858,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":101808,"threads_started":2}
I20260709 13:08:19.747584 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.749142 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.750878 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.760607 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.746680 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.678859 20461 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.783327 15578 raft_consensus.cc:1240] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:19.784154 15720 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:19.784602 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.786978 20444 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.787863 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.786989 15578 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:19.790287 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.734612 20146 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.741487 20449 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:19.793612 20337 consensus_meta.cc:287] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 13:08:19.794305 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:19.794423 20410 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
I20260709 13:08:19.794514 20450 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.795064 20449 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.684643 20309 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.795279 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.790895 16277 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:19.801064 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.746068 15725 rpcz_store.cc:276] 0709 13:08:17.543192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.142477 (+1599285us) service_pool.cc:224] Handling call
0709 13:08:19.180097 (+ 37620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.180306 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:19.423142 (+242836us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.706562 (+283420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.706620 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:19.706661 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.706875 (+   214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.707003 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266524,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":30412,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":522823,"threads_started":3,"wal-append.queue_time_us":309648}
I20260709 13:08:19.796802 15722 raft_consensus.cc:2410] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:19.794938 20410 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.801721 16277 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:19.734139 20419 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.802944 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.804435 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.804620 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.805187 15729 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:19.806000 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.813791 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:19.805045 16277 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:19.727313 20252 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.818653 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.818801 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.749027 20124 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.819562 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:19.743616 20442 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.806557 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:19.796559 20238 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.825302 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.827714 15725 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 5.
I20260709 13:08:19.828125 15649 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:19.794405 20313 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.821018 19951 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:19.795210 20450 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.831326 19951 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.832916 20450 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.833298 20252 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.833534 19951 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.834301 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.834923 16273 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 5.
I20260709 13:08:19.799731 20146 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:19.835645 16271 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:19.836143 20394 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 2.199s	user 0.013s	sys 0.011s
W20260709 13:08:19.837108 20418 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.520s	user 0.001s	sys 0.007s
I20260709 13:08:19.838749 20146 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.829823 20461 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.840230 20331 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.842947 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38248 (request call id 33) took 1172 ms. Trace:
I20260709 13:08:19.843369 15648 rpcz_store.cc:276] 0709 13:08:18.670560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.670998 (+   438us) service_pool.cc:224] Handling call
0709 13:08:19.842751 (+1171753us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54002698d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0d853 00007f2d9a9db60a 00007f2d93f617d4 00007f2d93f61762 00007f2d93f61691 00007f2d93f6160c 00007f2d93f608c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.842842 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685877504}
W20260709 13:08:19.847091 15721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 870) took 2306 ms (client timeout 2189 ms). Trace:
W20260709 13:08:19.847576 15721 rpcz_store.cc:269] 0709 13:08:17.540316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.282974 (+742658us) service_pool.cc:224] Handling call
0709 13:08:19.846848 (+1563874us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003be7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.847009 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901236992}
I20260709 13:08:19.848484 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2344) took 2048 ms. Trace:
I20260709 13:08:19.848865 15728 rpcz_store.cc:276] 0709 13:08:17.800219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.347739 (+1547520us) service_pool.cc:224] Handling call
0709 13:08:19.847009 (+499270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.847198 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.847222 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.847263 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.847291 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.847343 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.848334 (+   991us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003be7d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.848428 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147554176}
I20260709 13:08:19.848882 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.850649 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2598) took 1586 ms. Trace:
I20260709 13:08:19.851219 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:19.803269 20003 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:19.852598 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.851008 15653 rpcz_store.cc:276] 0709 13:08:18.264200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.264347 (+   147us) service_pool.cc:224] Handling call
0709 13:08:18.264645 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.342218 (+ 77573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.342247 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.342287 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:18.342319 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.850425 (+1508106us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b54002e3e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.850469 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.850580 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177947392}
I20260709 13:08:19.856369 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2656) took 1586 ms. Trace:
I20260709 13:08:19.859210 15721 rpcz_store.cc:276] 0709 13:08:18.269864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.855623 (+1585759us) service_pool.cc:224] Handling call
0709 13:08:19.855927 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.856093 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.856116 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.856155 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:19.856182 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.856229 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.856318 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:19.861781 20465 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:19.866331 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2595) took 2891 ms. Trace:
I20260709 13:08:19.860773 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2657) took 1590 ms. Trace:
I20260709 13:08:19.867909 15721 rpcz_store.cc:276] 0709 13:08:18.270279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.860132 (+1589853us) service_pool.cc:224] Handling call
0709 13:08:19.860417 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.860560 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.860575 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.860604 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:19.860622 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.860662 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.860734 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.869289 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.866788 15651 rpcz_store.cc:276] 0709 13:08:16.974428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.977059 (+  2631us) service_pool.cc:224] Handling call
0709 13:08:16.977389 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.989980 (+ 12591us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:16.990009 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.996715 (+  6706us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.327883 (+331168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:17.327957 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.328257 (+   300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.606316 (+2278059us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:19.851642 (+245326us) raft_consensus.cc:1685] finished
0709 13:08:19.851662 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.866249 (+ 14587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3708,"raft.queue_time_us":6650,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4545,"spinlock_wait_cycles":7456000,"thread_start_us":254054,"threads_started":1,"wal-append.queue_time_us":479666}
I20260709 13:08:19.871608 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.697587 20467 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.875475 20467 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.788075 20421 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:19.857649 20279 consensus_meta.cc:287] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.140s	user 0.007s	sys 0.004s
I20260709 13:08:19.881723 16271 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:19.880431 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:19.884954 15576 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:19.885782 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 129038us
I20260709 13:08:19.887581 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.892809 16278 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:19.876133 20125 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:19.896912 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:19.897606 15651 raft_consensus.cc:606] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.837535 20418 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.877959 20386 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:19.881402 20369 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:19.885566 20458 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:19.912374 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.852093 20238 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.904325 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.910508 20421 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.852516 20124 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:19.915973 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.916847 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:19.876114 20424 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:19.881896 20258 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:19.922652 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.924855 16270 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:19.922540 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.959681 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:19.926537 20309 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.927472 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2653) took 1665 ms. Trace:
I20260709 13:08:19.929219 19962 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.929715 20450 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:19.930176 20377 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:19.931578 20439 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.915783 20467 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.923890 20313 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:19.946535 20424 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.947364 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2063) took 1589 ms. Trace:
I20260709 13:08:19.941826 20418 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:19.620823 15727 rpcz_store.cc:276] 0709 13:08:17.543992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.133763 (+1589771us) service_pool.cc:224] Handling call
0709 13:08:19.181864 (+ 48101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.182073 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:19.370745 (+188672us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.598866 (+228121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.598918 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:19.598965 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.599033 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.599157 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272486,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":5559,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9835,"thread_start_us":378559,"threads_started":2}
I20260709 13:08:19.953639 20420 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.954803 20419 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.881353 19612 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:19.956733 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:19.960783 20468 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.961419 20410 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.961328 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:19.964569 20258 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:19.965535 20457 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.966214 20369 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:19.966918 20037 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:20.048328 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.969683 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:19.972980 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.049343 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.973248 15579 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:20.050863 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.005752 20313 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:20.053534 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 83951.8us
I20260709 13:08:20.053613 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.054427 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:20.056596 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.020814 20287 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:19.974584 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:19.975054 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:19.976862 20238 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:20.060333 20287 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.061506 20404 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:19.982790 20469 log.cc:927] Time spent T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:19.905841 20443 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:19.915114 20458 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.985963 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:19.986975 20435 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.002s
I20260709 13:08:19.896347 20405 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:08:19.988711 20028 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:19.989743 16269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1200) took 1549 ms. Trace:
I20260709 13:08:19.990756 15724 rpcz_store.cc:276] 0709 13:08:18.262254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.674308 (+1412054us) service_pool.cc:224] Handling call
0709 13:08:19.674727 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.675455 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.675498 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.676111 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.801081 (+124970us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:19.801210 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.801310 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.927257 (+125947us) raft_consensus.cc:1685] finished
0709 13:08:19.927277 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.927415 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":124512,"threads_started":1,"wal-append.queue_time_us":200128}
I20260709 13:08:19.997639 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.101456 16277 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:20.102327 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:20.102463 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2659) took 1798 ms. Trace:
I20260709 13:08:20.102828 16277 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.998581 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.103039 15724 rpcz_store.cc:276] 0709 13:08:18.304228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.101471 (+1797243us) service_pool.cc:224] Handling call
0709 13:08:20.101812 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.102052 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.102102 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.102159 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.102202 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.102273 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.102397 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.104992 15724 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:20.105671 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2660) took 1801 ms. Trace:
W20260709 13:08:20.014456 15573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2057) took 1704 ms (client timeout 1723 ms). Trace:
W20260709 13:08:20.109025 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 119380us
I20260709 13:08:20.018656 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2652) took 1760 ms. Trace:
I20260709 13:08:20.018656 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:20.020455 16275 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:20.022008 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:20.110417 15577 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.109874 15726 rpcz_store.cc:276] 0709 13:08:18.258538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.620137 (+1361599us) service_pool.cc:224] Handling call
0709 13:08:19.620444 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.693371 (+ 72927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.693402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.693438 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:19.693469 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.018435 (+324966us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54001fcf54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.018478 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.018595 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167310208}
I20260709 13:08:20.005584 15576 rpcz_store.cc:276] 0709 13:08:18.358018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.432366 (+ 74348us) service_pool.cc:224] Handling call
0709 13:08:19.947201 (+1514835us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003facd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:19.947301 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910349696}
I20260709 13:08:20.022505 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:20.112536 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45478.6us
I20260709 13:08:20.023053 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2054) took 1718 ms. Trace:
I20260709 13:08:19.994266 20450 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:20.000689 20245 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:08:20.025837 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.114892 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.027607 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.115214 15652 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:20.111984 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2355) took 1807 ms. Trace:
I20260709 13:08:20.028688 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.030675 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:20.032176 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.117525 15726 rpcz_store.cc:276] 0709 13:08:18.305122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.111197 (+1806075us) service_pool.cc:224] Handling call
0709 13:08:20.111485 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.111651 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.111685 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.111734 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:20.111776 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.111838 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.111934 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.957533 20421 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.041594 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.119611 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2661) took 1814 ms. Trace:
I20260709 13:08:20.047300 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:19.960455 16274 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:08:20.059635 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 85137.2us
I20260709 13:08:20.120406 15726 rpcz_store.cc:276] 0709 13:08:18.304962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.118820 (+1813858us) service_pool.cc:224] Handling call
0709 13:08:20.119180 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.119340 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.119361 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.119397 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.119426 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.119476 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.119564 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.121672 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103103us
I20260709 13:08:20.058683 20391 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.062466 20324 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.036525 20420 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.063149 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.065250 20411 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:19.981469 20109 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.641s	user 0.005s	sys 0.002s
I20260709 13:08:20.058748 20383 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:20.129631 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.130261 15576 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:20.059791 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:20.067848 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.039858 20468 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:20.034240 20003 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:20.055753 20037 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.070168 20128 consensus_queue.cc:1048] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:20.060353 20331 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.083287 20296 consensus_queue.cc:1059] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:20.086457 15728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2654) took 1823 ms. Trace:
I20260709 13:08:20.153205 15728 rpcz_store.cc:276] 0709 13:08:18.262559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.852413 (+1589854us) service_pool.cc:224] Handling call
0709 13:08:19.852729 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:19.870671 (+ 17942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.870715 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:19.882379 (+ 11664us) log.cc:844] Serialized 52 byte log entry
0709 13:08:20.049429 (+167050us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:20.049466 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.049529 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.086224 (+ 36695us) raft_consensus.cc:1685] finished
0709 13:08:20.086253 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.086401 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":329,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":117010,"threads_started":1,"wal-append.queue_time_us":170260}
I20260709 13:08:20.154700 19301 consensus_queue.cc:1059] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:20.088133 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2343) took 2485 ms. Trace:
I20260709 13:08:20.156019 15723 rpcz_store.cc:276] 0709 13:08:17.602578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.347132 (+1744554us) service_pool.cc:224] Handling call
0709 13:08:19.347406 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.478261 (+130855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.087848 (+609587us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400399754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.088063 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298905472}
I20260709 13:08:20.089231 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.090099 20023 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:20.045802 20258 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:20.047883 20369 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:20.092633 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:20.033820 20467 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:20.161343 20467 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.161604 20037 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:20.161751 20467 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:20.095007 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.162767 15655 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:20.056216 20313 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.135959 20109 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.168686 20109 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:20.169499 20369 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.138361 20443 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:20.170269 20443 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:20.119603 20326 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.058853 20457 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:20.003863 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.175135 16276 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:20.069577 20418 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.113104 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.113335 15575 rpcz_store.cc:276] 0709 13:08:18.305038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.306248 (+  1210us) service_pool.cc:224] Handling call
0709 13:08:20.022802 (+1716554us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400370354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:20.022975 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538647424}
I20260709 13:08:20.178632 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:20.109125 15573 rpcz_store.cc:269] 0709 13:08:18.310417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.310951 (+   534us) service_pool.cc:224] Handling call
0709 13:08:20.014296 (+1703345us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003fa7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:20.014394 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503368576}
I20260709 13:08:20.099707 16269 rpcz_store.cc:276] 0709 13:08:18.440261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.573331 (+133070us) service_pool.cc:224] Handling call
0709 13:08:18.573650 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.621321 (+1047671us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:19.621367 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.621432 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.621482 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.989522 (+368040us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540053a054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:19.989565 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.989674 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3084,"raft.queue_time_us":3787,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3513,"spinlock_wait_cycles":2401304320}
I20260709 13:08:20.114863 15724 rpcz_store.cc:276] 0709 13:08:18.304465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.104425 (+1799960us) service_pool.cc:224] Handling call
0709 13:08:20.104750 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.105398 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.105607 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.093070 20458 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.114678 20450 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:20.123236 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.123463 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2665) took 1691 ms. Trace:
I20260709 13:08:20.059863 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.124318 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.187239 15650 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:20.187423 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.121593 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:20.188259 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 66778us
I20260709 13:08:20.188982 16235 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:20.190371 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.188026 15655 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:20.131399 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1547) took 1479 ms. Trace:
I20260709 13:08:20.193905 16270 rpcz_store.cc:276] 0709 13:08:18.651665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.142122 (+490457us) service_pool.cc:224] Handling call
0709 13:08:19.142475 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.957882 (+815407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.131199 (+173317us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54006392d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.131350 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798817536}
I20260709 13:08:20.132023 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1545) took 1486 ms. Trace:
I20260709 13:08:20.194496 15726 rpcz_store.cc:276] 0709 13:08:18.431995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.122793 (+1690798us) service_pool.cc:224] Handling call
0709 13:08:20.123033 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.123182 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.123205 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.123246 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:20.123280 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.123328 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.123417 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.194933 16272 rpcz_store.cc:276] 0709 13:08:18.645406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.677581 (+ 32175us) service_pool.cc:224] Handling call
0709 13:08:18.677849 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.123182 (+445333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.129869 (+1006687us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54005f1c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.131965 (+  2096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795260288}
I20260709 13:08:20.134908 16273 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:20.138363 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.097443 20435 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.140347 15729 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:20.135105 20468 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.159526 20023 consensus_queue.cc:1243] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:20.141453 20420 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:20.141636 20003 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.143553 15574 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:20.210492 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:20.158237 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.170708 20443 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.135826 20481 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.097008 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.173637 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.174115 19301 raft_consensus.cc:3055] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:20.122327 20245 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.395702 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.396391 15647 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:20.397600 20245 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.237360 20003 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:20.183339 15724 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:20.131057 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 71333.1us
I20260709 13:08:20.412318 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:20.199256 16272 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.413857 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.199361 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.200457 16271 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.191677 20238 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:20.207490 20287 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:20.208741 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.200191 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.416671 16275 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:20.209656 20109 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:20.207928 20424 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:20.232496 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.175374 20028 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:20.236191 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.151460 16277 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:20.425518 16277 raft_consensus.cc:1240] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.421072 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:20.433005 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:20.434597 15692 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:20.436280 20461 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:20.177469 20457 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:20.276737 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:20.437302 20457 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.438128 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.438972 20421 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:20.439239 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.439617 20124 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.245512 20481 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:20.441329 20481 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.443427 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:20.380519 15576 raft_consensus.cc:2368] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16.
I20260709 13:08:20.278820 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.391744 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2668) took 1003 ms. Trace:
I20260709 13:08:20.445016 15729 rpcz_store.cc:276] 0709 13:08:19.388137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.139830 (+751693us) service_pool.cc:224] Handling call
0709 13:08:20.140090 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.196515 (+ 56425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.391683 (+195168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.391935 15725 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:20.392771 15571 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:20.173305 20258 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.395047 20377 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:20.399660 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.453689 15575 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.180788 15653 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:20.401676 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.404315 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2353) took 2114 ms. Trace:
I20260709 13:08:20.405566 15577 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:20.391232 19301 raft_consensus.cc:740] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:20.408056 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.408596 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 234173us
I20260709 13:08:20.436170 20383 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.436606 16275 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.459563 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.461607 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.462646 16271 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:20.462805 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.463373 15580 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:20.455112 15721 rpcz_store.cc:276] 0709 13:08:18.289606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.868900 (+1579294us) service_pool.cc:224] Handling call
0709 13:08:19.869181 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.893591 (+ 24410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.894719 (+  1128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.894767 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:19.894811 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.404072 (+509261us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b5400113d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.404118 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.404254 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7478,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8510,"spinlock_wait_cycles":19552128}
I20260709 13:08:20.440737 20435 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:20.443558 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.436874 20461 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:20.428858 20416 raft_consensus.cc:2764] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:08:20.211716 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 67186.9us
I20260709 13:08:20.210892 20326 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:20.459398 15573 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.465865 20128 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:20.466049 19301 consensus_queue.cc:260] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.422443 20238 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.428297 20028 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:20.471325 15579 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:20.452387 20377 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:20.536594 20313 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.537604 20377 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.538630 20377 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.450598 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:08:20.539788 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 89328.7us
I20260709 13:08:20.541477 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:20.476437 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:20.542714 20487 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:08:20.544188 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 85537.5us
I20260709 13:08:20.477133 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.477139 20461 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:20.563365 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.564314 15653 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:20.560916 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:20.478976 20484 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.479184 20436 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.460656 20421 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:20.472321 15576 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.532603 20128 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:20.441709 20003 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.556134 15575 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:20.531958 15618 leader_election.cc:400] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16.
I20260709 13:08:20.556190 20238 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.561884 20435 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:20.586444 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 451895us
I20260709 13:08:20.567263 20391 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:20.584045 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 104152us
I20260709 13:08:20.586331 15618 leader_election.cc:403] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.553860 20457 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.585301 20128 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.629794 15619 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:20.633725 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101934us
I20260709 13:08:20.639770 15618 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:20.643253 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2658) took 2339 ms. Trace:
I20260709 13:08:20.643769 15720 rpcz_store.cc:276] 0709 13:08:18.303903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.098193 (+1794290us) service_pool.cc:224] Handling call
0709 13:08:20.098473 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.171109 (+ 72636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.171141 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.171183 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.171214 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.642960 (+471746us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b5400002154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:20.643024 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.643183 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166634240}
W20260709 13:08:20.645502 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.589167 20421 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:20.637710 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96285.7us
I20260709 13:08:20.647413 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.648185 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.605123 20391 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:20.607108 19967 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:20.650658 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.606145 20435 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:20.652400 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.631632 20200 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:20.654484 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.638547 20003 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.638733 20484 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.661998 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.656054 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.587507 20450 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.639626 20141 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.663954 15727 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:20.669011 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.662345 15720 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:20.590361 19962 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:20.660951 15543 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:20.656491 20391 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:20.679993 20467 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.681221 20457 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.662647 20023 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.655328 20488 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:20.650821 20037 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:20.683032 20146 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:20.683230 16278 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:20.683666 20146 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:20.684653 20146 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.686445 20037 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:20.686882 20037 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:20.687666 20037 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.688792 20037 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:20.585927 20468 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.649446 20386 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:20.632048 20458 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.643921 20482 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.668545 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.708293 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.711977 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.661492 20435 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.718212 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:20.718849 16275 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:20.714735 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.720788 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:20.721521 15573 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:20.721376 20436 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.722455 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:20.722218 20436 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.723754 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.724066 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.724908 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:20.725083 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:20.725560 15650 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.726416 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.727277 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.727404 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:20.728041 16276 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.736898 20128 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.728940 20436 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:20.666831 20200 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.605603 20028 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.728441 15646 raft_consensus.cc:2410] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:20.719471 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:20.655090 20411 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:20.720386 15543 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:20.769819 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50421.2us
I20260709 13:08:20.662935 20326 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:08:20.761929 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.748606 15648 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:20.765718 16269 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:20.764078 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 117016us
I20260709 13:08:20.767488 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:20.662710 20124 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:08:20.745678 15650 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:20.775457 15722 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.738674 20443 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.779817 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:20.780846 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 66613.2us
I20260709 13:08:20.782353 15653 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
W20260709 13:08:20.772460 20491 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:08:20.789041 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2073) took 1089 ms. Trace:
I20260709 13:08:20.785081 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.738282 20457 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:20.788767 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.769166 20386 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:20.789450 15571 rpcz_store.cc:276] 0709 13:08:19.699417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.706826 (+  7409us) service_pool.cc:224] Handling call
0709 13:08:20.788888 (+1082062us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b5400109854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:20.788986 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201859456}
I20260709 13:08:20.803188 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:20.774294 20324 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:20.805639 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.779582 20436 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.781291 20028 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:20.787737 19951 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:20.807391 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:20.827337 16271 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.833889 15722 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:20.800331 20488 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.798486 20391 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.814205 20404 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.897742 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:20.816000 20436 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.907974 15646 raft_consensus.cc:1240] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:20.915274 16271 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:20.916929 15543 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:20.961757 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44949.8us
I20260709 13:08:20.963742 20264 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:20.964323 20264 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:20.887486 20141 consensus_queue.cc:1059] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:08:20.966105 20141 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:20.966589 20141 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:20.965332 20264 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.967555 20141 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.968561 20443 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.819284 20324 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.970844 20391 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:20.801004 20457 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:20.810410 19919 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:08:20.775904 20421 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:20.993827 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.997874 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.006570 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:20.895932 19951 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:20.902642 20424 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:20.908641 20436 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.988018 20023 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.015970 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:20.959496 20383 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:21.020335 15649 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.959864 20418 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.020860 15720 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.016423 20200 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:21.027908 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.022799 20468 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.039006 20468 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.040076 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.048244 15720 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:21.050559 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.051580 15650 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:21.046757 15693 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:21.053072 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:21.053903 15693 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:21.055433 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.057127 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:21.058250 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.061029 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.020035 20023 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:21.012137 20462 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:08:21.077472 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.082562 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.057103 20331 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:21.021793 20386 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:21.070290 20461 consensus_meta.cc:287] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.001s
I20260709 13:08:21.085866 15619 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.026454 20424 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.045563 20468 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:21.090458 15692 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.129:45045 timed out after 1.910s (SENT) [suppressed 19 similar messages]
W20260709 13:08:21.095256 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 265577us
I20260709 13:08:21.043545 20418 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.057016 20391 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.045276 20299 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:08:21.071182 20128 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.041824 20383 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.103780 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.104156 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.130189 15725 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:21.111910 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.113091 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.115067 15647 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.115864 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.132323 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.132517 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.084532 20458 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.130721 15650 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:21.133517 15647 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:21.134974 15654 raft_consensus.cc:2368] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:21.138470 20331 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.139065 20331 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.139562 20331 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.149487 20508 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:21.151554 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47905.8us
W20260709 13:08:21.152168 20497 log.cc:927] Time spent T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:08:21.152721 20519 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.153328 20519 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.155833 20519 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.156500 20519 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.165772 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.166675 15725 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:21.167955 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:21.168643 15725 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.170606 15619 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.171716 20458 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.172073 20458 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:21.172438 20458 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:21.176252 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.122049 20484 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16.
I20260709 13:08:21.192595 15649 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
W20260709 13:08:21.208796 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 147818us
I20260709 13:08:21.210741 15693 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:21.103691 20461 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.217231 15725 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:21.217875 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:21.218914 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:21.219990 20006 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:21.220628 20006 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:21.221699 20006 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:21.222687 20517 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:21.087973 19951 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:21.224366 20504 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:08:21.227201 15724 raft_consensus.cc:1240] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.228775 15724 pending_rounds.cc:85] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:21.229094 15724 pending_rounds.cc:107] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:21.229367 15724 raft_consensus.cc:2889] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.230257 15648 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
W20260709 13:08:21.212833 20483 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:21.207495 20279 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.238629 15723 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:21.237349 15693 leader_election.cc:400] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:21.240047 15693 leader_election.cc:403] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:08:21.238911 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 86573.5us
I20260709 13:08:21.263561 20461 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.237851 20457 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.266777 20457 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:21.271325 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.234207 20518 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.248492 20391 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.276738 20383 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:21.282167 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.286967 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 196529us
W20260709 13:08:21.289763 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 55663us
I20260709 13:08:21.293828 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.294723 16274 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:21.295383 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.297222 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.298002 15572 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.299075 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.273157 20511 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:21.248293 20279 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:21.284842 20510 log.cc:927] Time spent T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:08:21.320612 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.321010 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.307415 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.275537 20518 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.278319 20391 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.276017 20006 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:21.324121 15578 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.325194 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:21.305797 20369 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.136s	user 0.012s	sys 0.000s
W20260709 13:08:21.337914 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.338217 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.330665 15579 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:21.272050 20331 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.342115 15572 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:21.340795 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:21.328133 20435 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.560s	user 0.002s	sys 0.010s
I20260709 13:08:21.288153 20520 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.332384 20391 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.328205 20518 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:21.344246 20037 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.000s
I20260709 13:08:21.359230 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.351329 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.363006 20533 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:21.363970 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:21.365238 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.319406 20511 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.347544 20468 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.357107 20331 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.386044 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.347278 20531 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.342288 20369 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.358399 20418 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.344918 20435 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.395358 16276 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:21.354453 20534 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.378152 20515 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.396889 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.378929 20457 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.407691 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.411329 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.442981 20279 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.403775 20535 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.452126 20383 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.417028 20468 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.440538 20418 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:21.492960 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 81768.5us
I20260709 13:08:21.494107 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:21.495153 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.496074 15725 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.439850 20341 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:08:21.498289 15574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1956) took 1443 ms (client timeout 1539 ms). Trace:
I20260709 13:08:21.409618 20534 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.484822 20515 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:21.498696 15574 rpcz_store.cc:269] 0709 13:08:20.055357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.062882 (+  7525us) service_pool.cc:224] Handling call
0709 13:08:21.497289 (+1434407us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54000d52d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:21.498217 (+   928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38749952}
I20260709 13:08:21.488358 20535 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.493278 20468 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.440853 20457 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:21.505498 20532 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:21.505796 20436 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.507042 15720 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:08:21.506176 20308 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.508648 20308 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.509053 20511 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:21.499811 20238 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
W20260709 13:08:21.502014 20528 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:08:21.510630 20278 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.511782 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.512523 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.512795 20308 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.514478 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.515496 16278 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:21.526872 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.529698 15579 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:21.502617 20535 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.502116 20418 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:21.530650 20418 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.531077 20418 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:21.519356 20542 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.535243 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.537163 20278 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.538138 20534 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.539314 20308 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.539389 20458 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.542398 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:21.543041 16276 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:21.544706 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:21.545707 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.549830 15651 raft_consensus.cc:1275] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:08:21.550000 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.550361 15651 pending_rounds.cc:85] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 10
I20260709 13:08:21.550729 15651 pending_rounds.cc:107] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:08:21.550815 15577 raft_consensus.cc:2368] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:21.551740 20308 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.552170 20308 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.552513 20308 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.558562 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:21.559031 20369 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.559321 15574 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:21.560776 20458 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.518110 20238 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.562196 16270 raft_consensus.cc:1240] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:21.551097 15651 raft_consensus.cc:2889] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.578092 20238 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.563724 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.565400 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:21.585144 20313 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.586081 20313 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.503512 20515 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.586534 20313 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.587010 20313 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:21.537178 20481 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.095s	user 0.006s	sys 0.006s
I20260709 13:08:21.589080 20481 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.590180 15571 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.591246 20481 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.595943 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.605028 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.606376 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:21.608943 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.611666 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48030.5us
I20260709 13:08:21.611691 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.613180 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.613389 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:21.615218 20369 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:21.615476 20531 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:21.618659 20238 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.615391 20421 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.616020 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.621428 15692 leader_election.cc:400] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:21.623162 15575 raft_consensus.cc:2393] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:21.539433 20278 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.623241 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.623884 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.625519 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:21.626657 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.630606 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:21.634335 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 139397us
I20260709 13:08:21.635432 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.636392 16236 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.636976 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.640458 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.617381 20410 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.616798 20125 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.628994 20006 raft_consensus.cc:993] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:08:21.631944 20258 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.647235 20410 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.633831 20516 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.638962 20238 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.647589 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.645236 19919 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.614459 20535 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.650794 20468 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.653502 20128 raft_consensus.cc:1081] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Signalling peer 8995ef9978c446769377fc0e9a0cb9c1 to start an election
I20260709 13:08:21.665463 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:21.665903 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:21.666486 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.667061 16276 raft_consensus.cc:2376] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11. Re-sending same reply.
I20260709 13:08:21.667860 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.634045 20520 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:21.669785 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.656584 20410 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.671890 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.670630 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:21.675485 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:21.672290 20515 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.670822 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.676522 20331 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.677043 20331 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.677043 16277 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:21.668833 20548 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:21.668927 20531 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:21.679147 20331 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.679633 20531 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.681630 16277 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:21.685267 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.674525 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.673220 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.688110 15724 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:21.692437 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.692891 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.693109 15724 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:21.693624 15651 raft_consensus.cc:2393] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:21.696372 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.695158 19967 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:21.698827 19967 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:21.699194 19967 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:21.702739 20309 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:21.703236 20309 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:21.704186 20309 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.705552 20309 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:21.708423 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.709443 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:21.669561 20457 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.714285 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.715318 15653 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:21.718369 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.722297 20443 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:21.724345 20533 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.726716 16277 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:21.728549 20278 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:21.730484 20313 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.731366 20023 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.732201 20518 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.732750 20313 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.692565 20515 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.734437 20515 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.735327 20435 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.737286 20515 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.739209 20324 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.746198 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.690721 20331 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.746934 20331 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.747896 15723 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.681936 20531 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.697182 20436 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.766498 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.766884 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.767167 15649 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:21.767478 15654 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:21.768827 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:21.769376 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.769529 15650 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.769562 15647 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:21.763278 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.771191 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.773546 20308 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.775712 20308 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.776026 20416 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.780638 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:21.781270 16277 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.750301 20457 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:08:21.785526 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.773557 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:21.778923 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.721170 20369 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:21.791476 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:21.792424 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.754894 19919 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:21.805879 20003 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.139s	user 0.008s	sys 0.008s
I20260709 13:08:21.806144 19919 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.749684 20331 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:21.728994 20418 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:21.810828 20518 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.811942 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:21.812147 20418 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.812716 15724 raft_consensus.cc:2368] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14.
I20260709 13:08:21.814374 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:21.814483 20391 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:21.814949 15723 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:21.816004 15723 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:21.816618 20391 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:21.817016 15723 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.817467 15727 raft_consensus.cc:2393] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 14: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:21.819730 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2687) took 1109 ms. Trace:
I20260709 13:08:21.820114 15729 rpcz_store.cc:276] 0709 13:08:20.710673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.713098 (+  2425us) service_pool.cc:224] Handling call
0709 13:08:20.713357 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.716921 (+  3564us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:21.516496 (+799575us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b180036e440. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:08:21.654535 (+138039us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.692901 (+ 38366us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.721865 (+ 28964us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.722000 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:21.722058 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.722145 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.819446 (+ 97301us) raft_consensus.cc:1685] finished
0709 13:08:21.819559 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.819676 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50569,"prepare.queue_time_us":800540,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":3329,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":32880,"spinlock_wait_cycles":8583552,"thread_start_us":161017,"threads_started":2,"wal-append.queue_time_us":145779}
I20260709 13:08:21.823870 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.824487 15654 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:21.832485 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.832922 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.834535 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:21.798858 15650 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:21.799333 16277 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:21.802134 20287 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:21.862772 15654 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:21.786064 20535 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:21.762336 20313 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.927882 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:21.861151 15728 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:21.864360 15693 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:21.936024 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:21.936630 15651 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:21.929517 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 127645us
W20260709 13:08:21.939782 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 75507.9us
I20260709 13:08:21.831453 20416 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:21.931061 20542 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:21.953549 15724 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:21.862581 20418 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:21.932183 20369 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:21.938441 20457 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.940973 20313 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.943805 20535 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.962368 15653 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:21.916230 20468 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.933624 20534 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:21.964593 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 255209us
I20260709 13:08:21.932375 20548 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:21.954445 20531 raft_consensus.cc:2804] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:21.979171 15651 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:21.954629 20416 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:21.953229 20405 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:21.991206 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:21.975040 20313 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.013582 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.000331 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.041342 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.041968 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:22.042491 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.042608 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.043430 15571 raft_consensus.cc:2393] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:22.013558 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.044046 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:22.046770 15573 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:22.047034 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:22.048143 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61872.3us
I20260709 13:08:22.045792 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:22.050155 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 259908us
I20260709 13:08:22.042583 15575 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.001237 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.052547 15572 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:21.977829 20534 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.053447 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:22.058899 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 265279us
I20260709 13:08:22.060971 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:21.992245 20405 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:22.064613 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.975492 20457 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.056201 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.042659 20324 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.046584 20391 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.040110 20531 raft_consensus.cc:697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:21.992373 20416 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.053678 20518 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.076033 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:22.083501 15571 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.062232 20534 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.075445 20324 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.073199 20331 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.089704 20405 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.091497 15727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:51660
W20260709 13:08:22.091912 20561 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:22.092373 20454 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:22.092626 20551 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:22.093657 20507 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:22.106683 15648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2622) took 1330 ms (client timeout 1581 ms). Trace:
W20260709 13:08:22.218750 15648 rpcz_store.cc:269] 0709 13:08:20.776822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.777373 (+   551us) service_pool.cc:224] Handling call
0709 13:08:22.106434 (+1329061us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400085a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:22.106600 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979145600}
W20260709 13:08:22.219264 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 154765us
I20260709 13:08:22.113664 15571 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:22.117441 20296 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:22.118500 20467 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.121246 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2368) took 1089 ms. Trace:
I20260709 13:08:22.224408 15725 rpcz_store.cc:276] 0709 13:08:21.031542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.250622 (+219080us) service_pool.cc:224] Handling call
0709 13:08:21.250941 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.497794 (+246853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.121012 (+623218us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540039a154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:22.121190 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563314432}
I20260709 13:08:22.080519 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:22.131700 15575 raft_consensus.cc:2410] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:08:22.132061 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 83144.1us
I20260709 13:08:22.237326 15619 leader_election.cc:400] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14.
I20260709 13:08:22.237792 15619 leader_election.cc:403] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.133240 15727 raft_consensus.cc:606] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.239787 15727 raft_consensus.cc:614] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:22.142818 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 215154us
I20260709 13:08:22.242334 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:21.979772 20542 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.283630 20542 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.042608 20548 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.113380 19301 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.220762 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:22.283964 20531 consensus_queue.cc:237] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.247897 15579 raft_consensus.cc:3060] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.277940 20518 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.312124 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:22.223966 20391 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.278811 20535 consensus_queue.cc:1048] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:22.279937 20468 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.291476 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.292560 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:22.332173 15725 raft_consensus.cc:2393] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:22.293478 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:22.332809 15729 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:22.146407 20454 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:22.278580 20258 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14.
W20260709 13:08:22.311388 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71947.5us
I20260709 13:08:22.315290 20245 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:22.315498 20418 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.342831 20245 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.343030 20418 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.345558 20245 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.311337 20482 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:22.346424 20468 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:22.347132 20557 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:08:22.348299 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56962.8us
I20260709 13:08:22.377486 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:22.349152 20436 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.218254 20507 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:22.328838 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.224103 20296 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:22.312601 20279 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:22.078625 20369 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.345738 20418 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:22.373811 15725 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.386097 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:22.390517 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.473661 15725 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:22.401015 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72248.9us
W20260709 13:08:22.402168 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 341252us
I20260709 13:08:22.404812 15729 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:22.406342 15579 raft_consensus.cc:2468] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:22.331599 20494 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.326997 20518 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.481838 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:22.374433 20245 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:22.475922 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:22.486104 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100163us
I20260709 13:08:22.497179 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.487146 20331 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.396762 20391 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:22.485055 20559 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:22.427830 20468 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:22.514446 15693 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:22.488996 20557 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:22.469929 20436 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.516136 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:22.516858 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:22.517508 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.518200 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.518321 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.518950 20003 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:22.473165 20279 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:22.488502 20541 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.428429 20454 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.480832 20411 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:22.523761 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:22.584276 16272 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.547950 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:08:22.670230 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 122372us
W20260709 13:08:22.510986 20410 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.000s
I20260709 13:08:22.671993 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.666428 19301 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.667614 16277 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 6: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:22.520376 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:22.667779 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.676823 16274 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:22.675923 19301 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.678551 19301 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.679500 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.644600 16276 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:22.588125 16269 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:22.582281 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:08:22.680593 16275 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:08:22.681996 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.683792 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.685956 16275 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:22.375337 20482 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.690653 16272 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:22.519450 20324 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:22.584512 20542 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.582690 20560 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:22.598196 20568 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.598618 20003 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:22.593948 20548 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.523396 20468 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.511901 20245 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.683187 20489 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.676461 20404 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.694674 20569 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.672624 20418 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.697582 20454 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.702925 20313 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.002s
I20260709 13:08:22.492250 20494 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.684273 20238 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:22.775909 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.009s
W20260709 13:08:22.835721 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.000s	sys 0.010s
I20260709 13:08:22.836123 20238 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:22.678750 15692 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:22.673987 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:22.839361 15725 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:22.839228 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 160504us
I20260709 13:08:22.793207 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2090) took 2084 ms. Trace:
W20260709 13:08:22.790768 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 230932us
I20260709 13:08:22.841712 15576 rpcz_store.cc:276] 0709 13:08:20.708016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.741496 (+ 33480us) service_pool.cc:224] Handling call
0709 13:08:21.498220 (+756724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.498395 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.498420 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.498479 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:21.498509 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.498559 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.792450 (+1293891us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54000d52d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:22.792832 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670982016}
I20260709 13:08:22.843513 20560 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.716372 20404 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.678154 20410 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.863499 20410 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:22.720252 20418 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.867156 20418 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.720782 20313 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.677362 20411 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.884949 20411 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:22.721279 20416 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 13:08:22.885471 20450 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 6 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.714082 20489 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.935737 20489 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:22.719795 20569 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.518966 20507 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.582188 20296 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.709553 20468 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:22.696996 20542 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:22.987102 20542 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.682350 20541 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.703639 20568 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.804180 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:22.805398 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:22.805553 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:22.807950 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:22.992482 15652 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:22.818193 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2370) took 1769 ms. Trace:
I20260709 13:08:22.993362 15720 rpcz_store.cc:276] 0709 13:08:21.032105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.382415 (+350310us) service_pool.cc:224] Handling call
0709 13:08:21.382739 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.507492 (+124753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.800438 (+1292946us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400399754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:22.800966 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285304576}
I20260709 13:08:22.718906 20279 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.826397 20245 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:22.825870 19967 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.830346 20548 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:22.997046 19967 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.834240 20200 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:22.998255 20200 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:22.836201 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 785059us
I20260709 13:08:22.837666 16272 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:22.793898 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:22.999908 15651 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:23.000363 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:23.001349 16272 raft_consensus.cc:2368] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15.
W20260709 13:08:22.720113 20309 consensus_meta.cc:287] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.014s	user 0.014s	sys 0.000s
I20260709 13:08:22.818536 16271 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:22.856350 20404 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:22.857029 20567 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.003381 20567 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.829012 20003 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.859911 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:22.860157 15728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 2360) took 1831 ms (client timeout 1575 ms). Trace:
I20260709 13:08:22.860742 15724 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:22.669101 20436 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.860797 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:22.880743 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.886565 20416 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.721892 20482 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:23.039387 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.042330 16272 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.042431 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 2125) took 1296 ms. Trace:
I20260709 13:08:23.043004 15653 rpcz_store.cc:276] 0709 13:08:21.745679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.745924 (+   245us) service_pool.cc:224] Handling call
0709 13:08:23.041913 (+1295989us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400368654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:23.042210 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495478016}
I20260709 13:08:23.045326 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:08:22.857782 20238 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.895216 20313 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:22.898536 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 416618us
I20260709 13:08:23.052839 20141 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:22.910439 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67538.9us
I20260709 13:08:22.910701 20258 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:22.913945 20418 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.068239 20418 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.927568 20531 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.929662 20467 consensus_meta.cc:287] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.617s	user 0.000s	sys 0.017s
I20260709 13:08:22.936251 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.070503 20531 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.071427 16269 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:22.936578 20484 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.072558 20484 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.074059 20531 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:22.937151 19612 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.075815 19612 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:22.691908 20566 consensus_queue.cc:1059] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:22.888535 20518 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:22.960577 20534 consensus_meta.cc:287] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.006s
I20260709 13:08:22.968617 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:22.969507 20383 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:22.976887 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:22.985486 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:22.995639 20568 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:22.996516 20548 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:22.833443 20494 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.002447 20287 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:23.006171 15728 rpcz_store.cc:269] 0709 13:08:21.028881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.029052 (+   171us) service_pool.cc:224] Handling call
0709 13:08:22.859728 (+1830676us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001fc554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:22.859927 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731858304}
I20260709 13:08:23.026188 15571 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:23.033944 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:22.888533 16270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1210) took 2687 ms. Trace:
W20260709 13:08:23.046144 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 45622.9us
I20260709 13:08:22.908751 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.060554 19301 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.066910 20245 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:23.081694 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 174106us
I20260709 13:08:23.118854 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2362) took 2089 ms. Trace:
I20260709 13:08:23.119303 15726 rpcz_store.cc:276] 0709 13:08:21.029799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.029971 (+   172us) service_pool.cc:224] Handling call
0709 13:08:21.030573 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.186213 (+155640us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:21.518278 (+332065us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.670220 (+151942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.670272 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:21.670314 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.118423 (+1448109us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540011b7d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:23.118492 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.118665 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332871,"prepare.queue_time_us":394249,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":267,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5311,"spinlock_wait_cycles":357142400,"thread_start_us":150203,"threads_started":1,"wal-append.queue_time_us":179176,"wal-append.run_cpu_time_us":1370,"wal-append.run_wall_time_us":1111690}
I20260709 13:08:23.121261 20416 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:23.122228 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 63146us
I20260709 13:08:23.122879 16275 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 8: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:23.123085 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:23.056679 20308 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:08:23.126997 15693 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:23.127542 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.080750 20383 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.128422 15652 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:23.129693 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.136102 20511 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.136307 20416 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.137137 20541 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.092942 20569 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.080029 20534 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.084642 15648 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:23.138178 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:23.094939 16270 rpcz_store.cc:276] 0709 13:08:20.200800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.200915 (+   115us) service_pool.cc:224] Handling call
0709 13:08:20.231963 (+ 31048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.562559 (+1330596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.887799 (+1325240us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54007701d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:22.888273 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3058708352}
W20260709 13:08:23.138579 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.116514 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:23.046211 20567 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.142378 15651 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.147652 20200 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.150183 20424 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.151886 20443 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.155241 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:23.156944 20542 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.081966 20518 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:23.091975 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 1986) took 1089 ms. Trace:
W20260709 13:08:23.158466 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 84746.7us
I20260709 13:08:23.090394 20287 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.159157 20125 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.160411 20258 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:23.206151 20443 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.206508 20258 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.207813 20258 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.208396 20418 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.209421 20258 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.160892 20296 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.211679 20542 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.196736 20494 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.212385 20494 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.212821 20494 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.213106 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:23.213551 16274 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:23.214018 20518 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.214546 20518 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:23.165314 20507 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.223237 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:23.202536 15571 rpcz_store.cc:276] 0709 13:08:22.011547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.220503 (+208956us) service_pool.cc:224] Handling call
0709 13:08:23.091699 (+871196us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54000d4dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:23.091897 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657522560}
I20260709 13:08:23.224499 20467 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.224764 20377 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.227319 20560 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:23.228047 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.228268 20560 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:23.228845 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:23.232018 20405 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.165858 20555 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.165302 20023 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.234580 20555 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.169771 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:23.084208 15724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2382) took 1307 ms. Trace:
I20260709 13:08:23.094586 15650 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.092839 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2626) took 2197 ms. Trace:
I20260709 13:08:23.185297 19612 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.189925 16272 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:23.258278 19301 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.259037 20468 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.261379 20468 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.193657 20534 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.169602 20511 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:23.237812 15646 rpcz_store.cc:276] 0709 13:08:20.895275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.896980 (+  1705us) service_pool.cc:224] Handling call
0709 13:08:20.897303 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.977712 (+ 80409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.092405 (+2114693us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b54002e2a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:23.092660 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17454976}
I20260709 13:08:23.263252 20511 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.264189 15648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ec834a3b71420c9f09248e41809358"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:23.264918 20511 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.194937 20398 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.266537 20398 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.269307 20398 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:23.196542 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 58549.2us
I20260709 13:08:23.272092 15618 leader_election.cc:400] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15.
I20260709 13:08:23.272539 15618 leader_election.cc:403] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.274199 20467 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.275868 15579 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:23.276094 15726 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.077935 20436 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.166489 20308 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.086639 20548 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.205806 20287 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.242674 20516 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:23.244424 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:23.202823 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:23.246212 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 215967us
I20260709 13:08:23.247066 19967 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:23.247169 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 92129.5us
I20260709 13:08:23.247808 20454 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.247821 19951 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.248337 20424 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.248493 20568 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:23.249315 20200 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.251636 20125 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.252007 20531 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.225529 20377 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.255221 15576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:41396
I20260709 13:08:23.303247 20308 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:23.256649 20278 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.190649 20565 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.237288 15724 rpcz_store.cc:276] 0709 13:08:21.776540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.977039 (+200499us) service_pool.cc:224] Handling call
0709 13:08:22.859996 (+882957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.006391 (+146395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.083971 (+ 77580us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54001fc550. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:23.084123 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001747328}
I20260709 13:08:23.308434 20589 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.078424 20515 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.346309 20515 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.349582 20515 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.350386 20542 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.350979 20542 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.352947 20542 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.353477 20542 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.353791 20564 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.345521 20565 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.308689 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:23.229434 20560 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.265694 20494 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.276873 20484 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.256023 15728 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:23.304636 20467 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:23.328701 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 204021us
I20260709 13:08:23.329761 15651 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:23.330462 19951 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.331374 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:23.334192 20424 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.325924 20125 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.337994 20369 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.339047 20541 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.340513 20377 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.326438 15576 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.376405 15576 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.343781 19301 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.344547 20278 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.354921 15574 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.355321 20418 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.357117 20565 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.356525 15573 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:23.356976 15650 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:23.304339 19612 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:23.382843 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:23.379294 20410 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:23.383636 15652 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.384546 20278 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.386853 19951 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.386991 20424 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.375425 20541 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:23.387915 20411 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.388367 20411 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.388612 20541 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.354539 20564 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.390473 20308 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.391811 20308 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.392848 20564 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:23.393793 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 62593.3us
I20260709 13:08:23.394563 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.395105 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:23.396091 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.398658 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.399477 15578 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:23.400602 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.401201 15578 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:23.402488 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.403090 16274 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.404502 20468 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.405033 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.405162 20468 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.373420 20369 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.406603 16270 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:23.406863 20369 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.407223 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:23.408149 20416 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.325569 20548 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.408627 20416 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.409118 20548 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.409394 20522 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.409600 20548 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.328244 20398 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.410495 19612 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:23.410916 19612 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.411022 20398 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.411974 19612 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.327521 20534 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.413669 20534 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.415073 19612 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.416071 20526 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.416438 20410 consensus_queue.cc:1243] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:23.416793 20526 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.417109 20568 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.417341 20526 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.417500 20568 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.353989 20542 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.419968 16275 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.420269 20494 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.382476 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.422698 15649 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:23.382387 20418 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.354331 15722 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:23.424635 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:23.426266 20287 consensus_queue.cc:1059] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:23.427112 20484 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.427204 20287 raft_consensus.cc:3055] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:23.427591 20484 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.427636 20287 raft_consensus.cc:740] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.428098 20484 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.428742 20287 consensus_queue.cc:260] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.382157 20457 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:23.430584 15722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2689) took 2413 ms (client timeout 1921 ms). Trace:
I20260709 13:08:23.370761 20436 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:23.431010 15722 rpcz_store.cc:269] 0709 13:08:21.017731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.018200 (+   469us) service_pool.cc:224] Handling call
0709 13:08:23.430364 (+2412164us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54000e5954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:23.430508 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5320168192}
I20260709 13:08:23.431793 20555 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.395243 15579 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:23.363813 20569 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15.
I20260709 13:08:23.358995 19967 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:23.433444 19967 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.436409 16275 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.413730 19301 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.389343 20411 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.438108 20125 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.439303 20411 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.439844 20125 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.382113 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:23.375198 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.356051 20531 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.455587 20299 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.456400 20299 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:23.457094 15653 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:23.443594 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.458449 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.418552 20568 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:23.458966 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.459932 20568 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.461112 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:23.461380 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:23.461974 15653 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.462940 20416 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.464099 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:23.465826 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 221566us
I20260709 13:08:23.466776 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:23.468185 20587 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.409829 20522 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:23.448098 20589 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.470711 20522 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:23.449376 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 51855.3us
I20260709 13:08:23.416180 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.444294 20454 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.505426 19301 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.449677 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:23.509557 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.510393 20515 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.510924 20515 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.511412 20515 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.458492 20541 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.566982 15722 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:23.567113 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.575059 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.577100 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.567567 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.448927 20287 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.551774 20416 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.464080 20398 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.591615 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:23.599000 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.366411 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57788.9us
W20260709 13:08:23.608026 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 141364us
I20260709 13:08:23.610442 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.574267 20436 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.627540 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.632011 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.632620 15578 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.613986 20522 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.639112 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:23.645907 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.650520 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.651538 15651 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:23.637878 20416 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.658306 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.661496 20410 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.651165 15649 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.449817 20467 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.666051 20564 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.669696 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.647246 20468 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:23.649498 20531 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:23.684253 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.684597 20124 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.686625 20436 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.677500 20564 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:23.677134 20457 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.691903 20564 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.692204 20457 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.663627 20383 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.695977 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.696691 20383 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.697347 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.699314 16274 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.700515 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.701169 16274 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
W20260709 13:08:23.702220 20584 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:23.676662 20443 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.704792 15722 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.691524 20436 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.708410 15652 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:23.691536 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.697934 16269 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:23.715837 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.717289 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:23.725821 15647 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:23.727702 20278 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:23.734905 20124 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.735594 20278 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:23.736133 20278 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:23.737207 20124 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.737109 20278 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.738897 20278 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.739405 20467 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.706249 20418 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.740415 16273 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:23.745123 20457 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.747180 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:23.747807 20405 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.008s
I20260709 13:08:23.748318 20569 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.748636 20526 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.748811 20569 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:23.749819 20023 consensus_meta.cc:287] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.010s
I20260709 13:08:23.749949 16276 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:23.662060 20410 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.728440 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.729928 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.741652 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.757400 16273 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:23.759166 20558 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.759337 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.759984 16269 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:23.759730 20558 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:23.761233 16269 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:23.755162 20467 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.759366 15646 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:23.762390 20467 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.764577 20508 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:23.765000 20467 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.768764 20457 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:23.770506 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.771159 15728 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:23.773110 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.773768 15726 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:23.774660 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:23.774883 20526 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.769483 20457 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.775305 15579 raft_consensus.cc:1275] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:23.776320 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.777765 16269 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:23.757759 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:23.780337 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.780716 15653 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.780994 15651 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:23.783655 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.783687 15578 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:23.782833 15579 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:23.678001 20003 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:23.788832 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.787273 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.781798 15543 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:23.790653 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.733040 20468 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:23.788815 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.795885 15648 raft_consensus.cc:606] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:23.796325 15648 raft_consensus.cc:614] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:23.756946 20589 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.794727 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.804548 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:23.804591 15573 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:23.804991 16270 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:23.798452 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.810415 15578 raft_consensus.cc:2368] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12.
I20260709 13:08:23.802996 15575 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:23.809689 15728 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:23.812160 19301 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.810621 15577 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:23.812611 20278 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.805883 20467 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:08:23.815799 20200 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:23.810293 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:23.817382 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.817539 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.814878 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:23.813306 20518 consensus_meta.cc:287] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.009s
I20260709 13:08:23.799543 20457 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.821410 15720 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.821944 20299 consensus_queue.cc:1059] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:23.832993 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.834589 15693 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:23.837399 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:23.838619 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.839110 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.832603 20518 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.838304 15728 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.815814 20278 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.848691 15577 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:23.853547 20518 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.854476 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:23.856993 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.831864 20589 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:23.864920 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.869930 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.814498 20468 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.871194 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.871249 15728 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.874562 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.875278 15654 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:23.877929 20443 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:23.882136 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.854974 20457 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.882869 20457 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.883249 20457 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.883428 20416 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.848479 20278 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.889420 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.891073 16271 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.858675 20299 consensus_queue.cc:1243] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:23.899163 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.899329 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.877714 20410 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:23.900184 15725 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:08:23.900511 20141 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.847s	user 0.022s	sys 0.002s
I20260709 13:08:23.896129 20589 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:23.902281 20589 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:23.906208 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 201143us
W20260709 13:08:23.899720 20593 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:23.914372 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.914345 15572 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:23.920864 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:23.921657 15653 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:08:23.887377 20508 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.919279 15574 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.926115 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.926357 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:23.938297 15619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.926944 20534 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.930213 20418 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.932073 16278 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.933674 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.896174 20526 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.941984 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.888363 20542 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:23.978533 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.943759 15725 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:23.948093 20457 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:23.948828 15580 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.002s
I20260709 13:08:23.980683 15580 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:23.950589 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.981066 15720 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:23.951745 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.958544 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:23.963282 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.964107 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:23.926108 15655 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:23.952629 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.981953 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:23.991513 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:23.992591 15725 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:23.994288 20576 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.995757 15728 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:23.993808 15725 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.994333 15721 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:24.004364 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.005599 15720 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:24.012522 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.015646 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.016297 15729 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:24.017699 15692 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.026439 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:24.031186 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91982.5us
I20260709 13:08:24.032392 15652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:24.033161 15652 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Received request to transfer leadership to TS 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.033560 15652 raft_consensus.cc:614] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.034291 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.034999 15727 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:24.036079 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.036739 15577 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:24.037638 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.038434 20569 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.038487 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.976447 20418 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.040091 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.040772 20418 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:23.982822 20526 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.041466 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:24.042404 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.041464 16270 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:24.043251 20526 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:24.044690 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 61404.6us
I20260709 13:08:24.045243 20003 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.067364 15721 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:24.068950 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.051360 20457 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:23.943856 20508 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:23.994889 20576 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:24.014648 20590 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 13:08:24.065368 15575 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:24.058149 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:24.082297 16272 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:24.088917 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:23.957695 20548 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.095782 15579 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:24.028620 20515 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:24.150393 20308 consensus_meta.cc:287] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.758s	user 0.014s	sys 0.006s
I20260709 13:08:24.093127 20418 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.075461 20454 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:08:24.078855 20443 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:24.150236 20484 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.008s
I20260709 13:08:24.105686 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:24.124344 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 66351.7us
I20260709 13:08:24.147284 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:24.157006 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:24.155817 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50997.7us
I20260709 13:08:24.123622 20287 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.162818 15575 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.097983 20569 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:08:24.167953 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:24.173874 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:24.175482 15576 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.015s
I20260709 13:08:24.175937 15576 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.177524 15726 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:24.171348 15574 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:24.178432 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.180600 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.181434 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:24.181689 20468 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.182085 16277 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:24.142598 20023 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:08:24.191104 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.193974 15576 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.170349 20287 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:24.177881 20410 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.198576 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.202751 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:24.171914 20484 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.193109 20589 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.206851 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.210861 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:24.211634 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 103644us
I20260709 13:08:24.196507 20287 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.209221 15619 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.217521 15575 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:24.182633 20418 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:24.216042 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 124151us
I20260709 13:08:24.200783 20410 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.203462 20566 raft_consensus.cc:2764] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:24.227788 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.224601 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.228435 15579 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:24.224785 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.207500 20141 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.232860 20405 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:24.233371 20405 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:24.213682 20589 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:24.202348 20443 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.240099 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.228243 20410 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.233752 20405 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.352314 19951 raft_consensus.cc:3055] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:24.352974 19951 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:24.355652 20568 consensus_meta.cc:287] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.005s
I20260709 13:08:24.231564 20141 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:24.235704 20003 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:24.240751 20589 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.228076 20411 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:08:24.239249 19612 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.242858 20511 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.238381 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.329429 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:24.326711 20508 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.325543 20548 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.232489 20596 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.342623 20515 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:24.343096 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2108) took 1007 ms. Trace:
I20260709 13:08:24.357586 20558 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.384217 20534 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.385948 20534 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.388355 20534 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:24.363703 15650 raft_consensus.cc:2410] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:08:24.390261 15655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 2122) took 2705 ms (client timeout 1940 ms). Trace:
W20260709 13:08:24.390630 15655 rpcz_store.cc:269] 0709 13:08:21.684857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.685006 (+   149us) service_pool.cc:224] Handling call
0709 13:08:24.390047 (+2705041us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540035cd54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:24.390179 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5125320576}
W20260709 13:08:24.365857 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 125821us
I20260709 13:08:24.374047 19612 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.379205 20511 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.364437 20141 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.383201 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:24.381633 15571 rpcz_store.cc:276] 0709 13:08:23.358158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.361467 (+  3309us) service_pool.cc:224] Handling call
0709 13:08:23.372401 (+ 10934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.404628 (+ 32227us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:23.404991 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.957502 (+552511us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b18004ad700. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:08:23.957731 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.957911 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.957956 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:23.969420 (+ 11464us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:23.974918 (+  5498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.334574 (+359656us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54003f93d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:24.334633 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.334762 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36459,"prepare.queue_time_us":309787,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":14522,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":7209,"spinlock_wait_cycles":122554624,"thread_start_us":231958,"threads_started":1,"wal-append.queue_time_us":267347}
I20260709 13:08:24.384173 20596 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.378669 20278 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:24.377877 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 139555us
I20260709 13:08:24.391837 20484 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:24.487804 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.451872 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.478000 20003 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.473284 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.668426 15653 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.390920 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.502341 20443 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.564496 15650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46002 (request call id 876) took 1103 ms. Trace:
I20260709 13:08:24.668787 15654 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
W20260709 13:08:24.569103 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.669124 15651 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:24.515565 20287 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.586787 20405 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.684031 20287 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.690564 20405 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.392387 20568 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:24.638264 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:24.692814 20568 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.693280 20568 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.526058 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:24.695598 16275 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:24.469331 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.696475 15652 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:24.512379 20576 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.370573 19951 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.697942 19951 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.373811 20023 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:24.702252 20023 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:24.702720 20023 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:24.376785 20369 consensus_meta.cc:287] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.969s	user 0.017s	sys 0.006s
I20260709 13:08:24.706316 20369 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.707541 15723 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:24.708539 20369 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.473839 20515 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.709452 20515 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.711745 20515 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:24.433030 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 346622us
I20260709 13:08:24.712642 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.451468 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:24.713447 16277 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:08:24.637024 15693 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.002s	sys 0.018s
I20260709 13:08:24.377518 20416 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.469273 20508 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.459110 16236 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.446973 20558 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.433209 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:24.620527 20566 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:24.615144 20308 consensus_queue.cc:1059] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:08:24.379488 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 141576us
I20260709 13:08:24.570554 20299 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:24.670612 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.669220 15650 rpcz_store.cc:276] 0709 13:08:23.460699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.460821 (+   122us) service_pool.cc:224] Handling call
0709 13:08:24.564191 (+1103370us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540006a754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:24.564412 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061126016}
I20260709 13:08:24.675482 20596 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.677415 15573 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:24.679507 20410 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:24.679503 15653 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:24.681334 20511 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.668661 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:24.379248 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 154718us
I20260709 13:08:24.651433 20418 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:24.714320 15693 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.007s	sys 0.018s
W20260709 13:08:24.723861 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55269.8us
W20260709 13:08:24.724418 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 862526us
I20260709 13:08:24.665241 19612 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:24.717156 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 284021us
I20260709 13:08:24.750619 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.741537 16235 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:24.753345 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:24.720356 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 261335us
I20260709 13:08:24.754187 20416 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:24.754648 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.755529 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.755697 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.756138 15725 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:24.720319 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:24.756701 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.730166 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.757645 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.731554 20410 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.722523 20003 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.734321 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:24.735028 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:24.735679 16276 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:24.736023 20576 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.736145 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.763461 15651 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.723397 20558 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:24.737457 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.720119 20508 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.721452 20468 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:24.737711 20541 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.738462 20245 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:24.739560 20308 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:24.741210 20278 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.741495 20443 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.737327 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.737308 15654 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:24.744163 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:24.786492 16278 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.745828 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.787340 15647 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:24.745803 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.747346 20515 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:24.748021 20023 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.748678 20405 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.748884 20484 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.754714 20416 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:24.719887 20299 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:24.755781 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:24.815079 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 43829.2us
I20260709 13:08:24.721896 20603 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.765879 20411 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:24.766625 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.818322 15724 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:24.822613 20416 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.826145 20443 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.822687 20299 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.828684 20443 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.814659 20405 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.829111 20299 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.767294 20558 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:24.767377 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:24.763062 20576 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.830483 15726 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:24.764222 15646 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:24.765389 20596 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.775429 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:24.776221 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:24.838186 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 97650us
I20260709 13:08:24.838651 15725 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:24.780522 16236 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.780015 20541 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:24.784766 20569 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:24.770320 20564 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:24.789726 20508 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.781098 20245 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:24.779752 20418 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.791196 20468 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:24.790427 15473 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 4 to 6, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 6 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:24.779699 19951 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:24.794121 15650 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:24.780282 20511 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:24.858014 20511 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:24.808924 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 87526.2us
I20260709 13:08:24.858285 20245 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.858552 20589 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:24.859831 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:24.860736 20589 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:24.860800 20279 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.779807 20287 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.861774 20279 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:24.862388 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 104111us
I20260709 13:08:24.863433 16235 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.863339 20279 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.768144 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:24.866222 20548 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.866513 15727 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:24.834645 15729 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:24.836783 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55908.3us
I20260709 13:08:24.868000 15646 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:24.868803 20541 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.869405 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:24.846204 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 65756.7us
I20260709 13:08:24.869904 20541 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.870870 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.849228 16278 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:24.780823 20568 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.871179 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.872638 20484 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:24.873178 20568 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.852639 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.873899 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:24.874097 15654 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:24.874624 15647 raft_consensus.cc:2368] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:24.874372 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.875247 20568 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.875594 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.837437 20411 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.876134 20411 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:24.876470 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.877022 20411 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:24.877761 15543 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:24.878062 20411 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.878616 20454 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:24.879081 20454 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:24.880040 20023 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.879958 20454 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.881744 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.882273 15723 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:24.882491 20023 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.869055 20566 consensus_queue.cc:1059] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:24.883742 20468 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.884440 20566 raft_consensus.cc:3055] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:24.884856 20566 raft_consensus.cc:740] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:24.877040 15648 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:24.887002 20405 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.871454 15646 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.875139 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:24.837914 20596 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:24.890846 20596 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.890853 15654 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:24.885715 20566 consensus_queue.cc:260] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.892004 15473 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:24.894352 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:24.838328 20576 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.895889 16236 leader_election.cc:400] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:24.906613 16236 leader_election.cc:403] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.896610 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.851984 15693 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:24.915050 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:24.914884 15473 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:24.851171 20602 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:24.858479 20511 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.916425 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.852813 20418 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:24.945474 15720 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:24.948504 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 43796.4us
I20260709 13:08:24.848126 20443 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:08:24.855826 20564 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:24.894209 20526 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:24.953517 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.955628 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:24.956416 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:24.959993 15726 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:24.960855 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:24.961632 15651 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:24.922855 20405 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:24.940353 20603 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.979421 20003 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:24.981603 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.982806 20526 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:24.984125 20566 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.983918 20526 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:24.966503 15475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 371) took 17132 ms (client timeout 15000 ms). Trace:
I20260709 13:08:24.967615 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:24.968190 20484 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.968590 20522 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:24.969934 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 118044us
I20260709 13:08:24.976457 20564 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.855636 20569 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:24.978642 20515 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.942133 20508 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:24.996440 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 99723.4us
I20260709 13:08:25.022581 15726 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:25.023223 15646 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:25.026779 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:25.043038 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:25.044608 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:25.027688 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:25.051272 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50489.1us
W20260709 13:08:25.051947 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 88265us
I20260709 13:08:24.952728 20418 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:25.097597 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 181236us
I20260709 13:08:25.099740 16277 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:25.066949 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 170563us
I20260709 13:08:25.067487 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.096211 15575 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.096835 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.100553 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.101580 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:25.093824 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:25.054468 15544 connection.cc:256] RPC call timeout handler was delayed by -2.1206348200000775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:08:25.102406 15650 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.103641 15723 raft_consensus.cc:1240] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:25.104698 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.105345 20508 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.106201 20611 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.106621 20611 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.106957 20611 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.107264 15725 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:25.102420 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:24.960495 20416 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.066715 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.108366 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.097476 15578 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:24.995253 20405 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:25.114326 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 71430.2us
I20260709 13:08:25.068471 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.053066 20287 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.116626 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:25.107486 20508 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.116627 15647 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:25.119714 15724 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:25.123204 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:25.124233 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:25.124432 15725 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:25.045979 20522 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.125718 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:25.127655 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:24.994678 20608 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.125197 20443 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:24.994149 20141 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.130649 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.059331 20278 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.156239 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55761.1us
I20260709 13:08:25.107944 20003 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.136847 15571 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:25.118889 20405 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.153034 20522 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.114075 20125 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.131151 20589 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:25.184836 20601 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:25.137357 20410 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:08:25.180059 15724 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:25.202409 20589 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.190775 20508 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:25.184405 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 69206.8us
I20260709 13:08:25.172418 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.235466 15647 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:25.237668 15653 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:25.193595 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:25.131606 20617 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.265638 20617 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.266208 20617 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.136925 20608 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.266970 20608 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.200269 15575 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
W20260709 13:08:25.175897 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71271.6us
I20260709 13:08:25.234750 20589 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.175192 20515 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.227461 15723 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:25.182667 15726 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:25.278362 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.196507 20003 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.246549 20596 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.191069 20278 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.201722 20468 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:25.204154 20416 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:25.262904 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.245776 20603 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:25.198482 15655 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:25.272990 19301 raft_consensus.cc:2764] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:25.202373 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:25.234949 20508 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.201894 20125 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.192317 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.355065 15650 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
W20260709 13:08:25.355203 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 162922us
I20260709 13:08:25.356168 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.280911 20369 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.284051 19612 consensus_meta.cc:287] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:08:25.284329 20569 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.285055 20141 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:24.995137 15475 rpcz_store.cc:269] 0709 13:08:07.877229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.900533 (+ 23304us) service_pool.cc:224] Handling call
0709 13:08:08.221713 (+321180us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:24.966267 (+16744554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.066521 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.243364 (+176843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.243439 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:08:20.243468 (+    29us) tablet.cc:662] Decoding operations
0709 13:08:20.554590 (+311122us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.554706 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.554738 (+    32us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:08:20.559429 (+  4691us) tablet.cc:701] Row locks acquired
0709 13:08:20.559477 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:20.559683 (+   206us) write_op.cc:270] Start()
0709 13:08:20.561364 (+  1681us) write_op.cc:276] Timestamp: P: 1783602500559599 usec, L: 0
0709 13:08:20.561414 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.577604 (+ 16190us) log.cc:844] Serialized 9885 byte log entry
0709 13:08:21.259696 (+682092us) op_driver.cc:464] REPLICATION: finished
0709 13:08:21.480873 (+221177us) write_op.cc:301] APPLY: starting
0709 13:08:21.481001 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:22.369904 (+888903us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:22.472324 (+102420us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.434276 (+961952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.434738 (+   462us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:08:23.434800 (+    62us) write_op.cc:312] APPLY: finished
0709 13:08:23.435519 (+   719us) log.cc:844] Serialized 220 byte log entry
0709 13:08:23.665445 (+229926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.808379 (+142934us) write_op.cc:454] Released schema lock
0709 13:08:23.816510 (+  8131us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.897161 (+ 80651us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.914672 (+ 17511us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2361976,"reported_tablets":46,"spinlock_wait_cycles":294008704,"child_traces":[["op",{"apply.queue_time_us":220846,"apply.run_cpu_time_us":52645,"apply.run_wall_time_us":2378295,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":223381,"prepare.run_cpu_time_us":39638,"prepare.run_wall_time_us":780296,"raft.queue_time_us":106123,"raft.run_cpu_time_us":21568,"raft.run_wall_time_us":232090,"replication_time_us":698117,"thread_start_us":838704,"threads_started":5,"wal-append.queue_time_us":802890,"wal-append.run_cpu_time_us":11536,"wal-append.run_wall_time_us":2230271}]]}
I20260709 13:08:25.290129 20515 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:25.293596 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:25.275288 20609 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:25.338163 15725 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
W20260709 13:08:25.349429 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 247069us
I20260709 13:08:25.359300 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:25.340520 20411 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.371311 20245 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.371150 19612 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.371212 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:25.372484 20278 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.336580 20468 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.340025 20416 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.368307 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:25.384172 20618 log.cc:927] Time spent T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:08:25.385074 20614 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:08:25.350571 20508 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.358901 20125 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.392092 20515 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:25.393702 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 100211us
I20260709 13:08:25.394429 20622 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.406591 20616 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.406633 20526 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.423617 15724 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:25.423205 20416 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.374992 20410 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.423012 20468 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.377135 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.374900 20626 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:25.458210 20626 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.458647 20626 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.459407 20611 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.461570 20611 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.462190 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.462802 16274 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:25.423683 19612 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.445331 20596 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:25.446087 20610 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.463s	user 0.002s	sys 0.011s
I20260709 13:08:25.446841 20003 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.480122 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.448149 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.436692 20616 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.451354 20278 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.499765 20278 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.500177 20278 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.500674 15652 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:25.503381 15726 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:25.452545 20613 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.470s	user 0.002s	sys 0.000s
I20260709 13:08:25.504463 15654 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:25.438113 20621 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.505605 15654 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:25.470683 20602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.015s
W20260709 13:08:25.506152 20602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.001s	sys 0.015s
I20260709 13:08:25.506431 20602 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:25.507362 20602 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:25.507984 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.509840 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:25.510478 15572 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
W20260709 13:08:25.441751 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 64672.5us
I20260709 13:08:25.511965 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.453444 20522 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.417012 20568 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:25.485675 15653 raft_consensus.cc:2410] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:25.417907 20576 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:25.488785 20612 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
W20260709 13:08:25.478699 20548 consensus_meta.cc:287] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.000s
I20260709 13:08:25.418341 20411 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.437848 20526 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.490562 20541 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.492285 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.494133 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.531255 15723 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.466979 20410 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.424419 20369 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.538280 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.533486 20631 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.539049 20631 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.539569 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.540062 20369 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.540644 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:25.540926 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 46905.6us
I20260709 13:08:25.541175 20631 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.541741 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.542199 20622 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.499369 20616 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.505203 20589 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.505300 20621 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.457434 20245 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:25.413985 20405 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:25.458657 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 286297us
I20260709 13:08:25.514060 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:25.501849 15652 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:25.516706 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:25.523587 15724 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:25.524196 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.524716 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.525808 19301 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.527917 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:25.484058 20511 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:08:25.519376 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:25.529186 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:25.530931 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47122.5us
I20260709 13:08:25.532580 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:25.582907 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 50442.6us
I20260709 13:08:25.583563 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
W20260709 13:08:25.583884 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.479038 20620 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.533574 20541 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.522676 20443 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.542974 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:25.543172 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:25.449713 20468 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.499157 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:25.536062 20548 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.537834 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.545749 15578 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:25.530241 20558 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.015s	sys 0.014s
I20260709 13:08:25.548370 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.553978 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.556272 20576 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.547736 20568 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.531217 20299 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.558288 20369 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:25.559540 20589 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.592317 20566 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.563352 15654 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:25.587941 19612 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.535403 15576 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:25.585359 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 68781.3us
I20260709 13:08:25.486572 20564 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.589251 19301 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:25.593276 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 68631.5us
I20260709 13:08:25.654012 15579 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:25.654295 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.594257 15575 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:25.597014 15729 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.587911 20511 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.640491 20589 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:25.598591 15646 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:25.599723 20468 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.599890 20287 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:25.586267 20541 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.601508 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.602285 20508 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:25.603526 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.542608 20596 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.550350 20003 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:25.637832 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.652297 19612 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.675427 16272 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:25.563488 20621 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.642536 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.659734 20564 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.684458 20564 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.685238 16271 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:25.626005 15723 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
W20260709 13:08:25.643147 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 123853us
I20260709 13:08:25.609789 15650 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:25.646687 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:25.588507 20615 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:25.651540 15652 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.591009 20443 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.689580 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.563592 20125 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:25.660894 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.550992 20622 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.667526 20287 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:25.661782 16235 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:25.666654 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:25.741437 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 79724.6us
I20260709 13:08:25.741729 15724 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.675413 20589 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:25.587435 20245 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.641574 20369 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:25.752202 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:25.752573 20369 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.753805 15650 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:25.753657 20287 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:25.641270 15573 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.754330 20468 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:25.754913 20287 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.672147 19301 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.663211 20569 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.606550 20558 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.015s	sys 0.014s
I20260709 13:08:25.692937 15576 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:25.693096 20405 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:25.785565 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 120226us
I20260709 13:08:25.696030 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.666886 20279 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.588814 20603 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.723459 20125 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.723995 15648 raft_consensus.cc:1240] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.720914 20141 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:25.792003 20418 consensus_meta.cc:287] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.000s
I20260709 13:08:25.691004 19612 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.724377 20626 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.792413 20418 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.794343 20626 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:25.795289 20416 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.797375 20416 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.726431 20443 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.692049 20526 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:25.726773 20596 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.799993 20596 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.727481 15652 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:25.801153 16277 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:25.728866 15651 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:25.688342 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45895.4us
I20260709 13:08:25.802804 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.804122 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.804924 20484 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:25.805305 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.805537 20484 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.806421 20279 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:25.810949 20616 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.813248 20616 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:25.786535 20569 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.818308 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:25.699322 15574 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:25.699195 16270 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:25.676172 20003 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:25.753885 20245 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.678345 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.686005 15655 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:25.760977 19301 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.824952 19301 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.827150 20639 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.827248 19301 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.828224 15721 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:25.637182 20515 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:25.699710 20200 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.692512 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:25.672511 20299 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:08:25.670439 20454 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:08:25.667269 20548 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:08:25.640537 20566 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.790800 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.791122 20603 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.820861 16275 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:25.827838 20639 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.750790 20621 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:25.726789 20608 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.830015 20125 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:25.662288 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 120626us
I20260709 13:08:25.740931 20615 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:25.828773 20515 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.588852 20620 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:25.839262 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 144153us
W20260709 13:08:25.841969 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 180723us
I20260709 13:08:25.897428 15544 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.898262 15580 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:25.901145 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.901747 15655 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:25.842276 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:25.848161 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.903439 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.903544 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:25.849063 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.786343 19951 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.829428 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:25.830758 20003 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:25.861006 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:25.910465 15576 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:25.832294 16271 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.861231 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:25.918424 15573 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.892004 20023 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:25.817037 20589 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:25.859081 20603 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.927233 19301 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:25.933395 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.859493 20621 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.859110 20405 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:25.975533 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:25.860635 20522 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.843523 20200 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:25.951828 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.987736 15725 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.952653 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.988372 15726 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.955531 16269 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:25.981796 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:25.992885 15652 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:25.939246 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:25.976454 15651 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:25.976683 15729 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.890763 20410 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:25.961589 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:25.995404 15723 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:25.981510 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:25.992744 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89265.8us
I20260709 13:08:25.995895 15648 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:25.996349 15692 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:25.953409 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:25.998354 15722 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
W20260709 13:08:25.975003 20617 consensus_meta.cc:287] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.003s
I20260709 13:08:26.008205 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1631) took 1133 ms. Trace:
I20260709 13:08:26.010186 15580 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:25.895020 20416 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
W20260709 13:08:26.004274 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 98674.6us
I20260709 13:08:25.964511 20125 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.860991 20626 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:08:26.015120 19301 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:25.975143 20621 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:26.008559 16275 rpcz_store.cc:276] 0709 13:08:24.859077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.859243 (+   166us) service_pool.cc:224] Handling call
0709 13:08:24.859657 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.851583 (+991926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.992144 (+140561us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54005393d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:25.992325 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209948416}
I20260709 13:08:26.020455 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:26.030110 15726 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:26.031960 15725 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:26.043955 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.044267 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:25.896888 20369 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.045125 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.015308 15544 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:25.924360 20633 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:08:25.982285 19951 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:08:26.081982 15648 raft_consensus.cc:2393] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.082331 15655 raft_consensus.cc:2368] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
W20260709 13:08:26.073371 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 231149us
I20260709 13:08:26.044756 20418 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.093274 15573 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
W20260709 13:08:26.095397 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 80182.1us
W20260709 13:08:26.105603 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 85220.4us
I20260709 13:08:26.092998 16271 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:26.093150 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.133755 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:26.106101 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.023161 20245 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:08:25.955163 20279 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.024896 20454 consensus_queue.cc:1059] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:08:26.140133 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:26.046260 20564 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:08:26.145540 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.146303 15651 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.144914 20627 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.079241 20508 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:26.154767 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61692.2us
I20260709 13:08:26.155752 15618 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:26.080227 20622 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.054284 20125 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.076572 19612 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.025599 20617 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:26.193961 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100819us
I20260709 13:08:26.146575 20569 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.151504 20627 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:26.185153 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 188855us
W20260709 13:08:26.213891 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45449.2us
W20260709 13:08:26.212762 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72720.8us
I20260709 13:08:26.216725 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:26.218847 15692 leader_election.cc:400] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12.
I20260709 13:08:26.215173 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:26.157755 20443 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:26.220463 15649 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.222498 19301 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.158392 20568 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.165659 20622 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.225157 19301 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.166109 20633 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:26.162400 20649 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.237265 20649 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.226436 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:26.231268 16273 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:26.207192 20287 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:26.239207 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:26.165934 20558 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.237780 20649 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.228183 16236 leader_election.cc:400] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:26.221933 20566 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.167126 20657 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:26.260177 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45114us
W20260709 13:08:26.258014 15724 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.001s
W20260709 13:08:26.232889 20638 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.461s	user 0.000s	sys 0.001s
I20260709 13:08:26.219075 20627 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.230366 20443 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:26.252390 16236 leader_election.cc:403] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.101284 20615 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.220613 20639 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.284498 15572 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.235416 20622 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:26.288357 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 153575us
I20260709 13:08:26.280130 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:26.284873 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57013.6us
I20260709 13:08:26.219118 20645 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:08:26.285976 15576 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:26.268239 20245 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:26.287907 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 47980.6us
I20260709 13:08:26.273453 19301 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.226413 20454 consensus_queue.cc:1059] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:08:26.291050 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.264194 15724 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:26.265653 20405 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.299033 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.299635 15720 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:26.297859 15650 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:26.258373 20515 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.270510 20548 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.302801 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.303321 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.304177 15655 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:26.269599 20633 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:26.298911 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.309526 15724 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:08:26.301594 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.310652 15720 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:26.296017 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:26.281939 20443 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:26.306742 16236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.936s (SENT) [suppressed 11 similar messages]
W20260709 13:08:26.320585 15653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.001s	sys 0.017s
W20260709 13:08:26.320981 15653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.001s	sys 0.017s
I20260709 13:08:26.298204 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.291242 20622 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.277889 20657 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:26.307961 15727 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:26.284250 20287 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:26.313199 20658 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.313638 20411 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.314561 20663 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:08:26.316383 20648 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:26.296413 15654 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:26.290772 20639 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:26.311669 20278 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
I20260709 13:08:26.360936 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.323539 15721 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:26.499712 15646 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:26.294371 20608 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:26.361606 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 437560us
I20260709 13:08:26.365768 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.366911 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.368153 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.368484 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.369740 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.375883 20622 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.295766 20245 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:26.396325 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.303093 20548 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.307119 20418 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.363161 20558 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:26.359062 20614 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:26.305301 20200 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.327395 20405 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:26.498731 15692 connection.cc:256] RPC call timeout handler was delayed by -1.2170790559999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:08:26.572009 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.572532 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.572955 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.573475 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.573553 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.501718 15693 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.574564 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.517776 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1633) took 1622 ms. Trace:
I20260709 13:08:26.327749 20515 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:08:26.294386 20644 consensus_queue.cc:1048] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.314s
I20260709 13:08:26.400995 20369 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.562827 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:26.581576 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 79959.2us
W20260709 13:08:26.572271 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0496790560000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:08:26.395982 20649 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.578732 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.575507 16278 rpcz_store.cc:276] 0709 13:08:24.895479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.895604 (+   125us) service_pool.cc:224] Handling call
0709 13:08:24.942408 (+ 46804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.065580 (+123172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.065636 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.510264 (+444628us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b2c00012c98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:25.510648 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.666372 (+155724us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:25.666409 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.666469 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.503024 (+836555us) raft_consensus.cc:1685] finished
0709 13:08:26.503053 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.517682 (+ 14629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":596,"raft.queue_time_us":225382,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20886,"spinlock_wait_cycles":48956160,"thread_start_us":277950,"threads_started":2,"wal-append.queue_time_us":160353}
I20260709 13:08:26.585618 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:26.305720 20611 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.585096 15693 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.561115 20548 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.565814 19951 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:26.506628 20278 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.595196 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.596464 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:26.598362 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:26.574414 20648 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:26.601804 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.603649 15572 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.605827 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.606662 15577 raft_consensus.cc:2393] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.607039 20639 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.607839 20667 raft_consensus.cc:3055] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:26.608265 20667 raft_consensus.cc:740] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:26.610288 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.611061 15571 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:26.610296 20657 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.578996 19612 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.614634 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.615510 15578 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:26.587030 20608 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:26.617563 20608 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:26.617969 20608 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.621315 20418 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:26.622430 20405 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.583276 20125 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.624676 20655 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.625298 20655 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.626540 20649 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.627526 20655 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.627993 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.629333 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:26.630406 20652 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 13:08:26.579663 20558 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:26.634848 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 49840.5us
I20260709 13:08:26.647034 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 979) took 1042 ms. Trace:
W20260709 13:08:26.651855 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55551.6us
I20260709 13:08:26.652786 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:26.635818 15572 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:26.624073 20669 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.641690 20023 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:26.644869 20541 consensus_meta.cc:287] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.969s	user 0.010s	sys 0.000s
I20260709 13:08:26.646452 16278 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:26.709162 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.647421 15580 rpcz_store.cc:276] 0709 13:08:25.604281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.604423 (+   142us) service_pool.cc:224] Handling call
0709 13:08:26.646867 (+1042444us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000d4dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:26.646978 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465546624}
I20260709 13:08:26.558336 20668 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:08:26.602718 19951 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:26.706634 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53977.6us
W20260709 13:08:26.702296 20603 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
I20260709 13:08:26.650652 20369 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.718623 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:26.710949 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.702574 20644 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.723001 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.724191 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.720994 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.707787 20023 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.726353 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.707846 20639 raft_consensus.cc:2764] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:26.728430 15729 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:26.708087 20658 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.744546 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.744859 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:26.745649 15724 raft_consensus.cc:2368] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:26.746390 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.747130 15654 raft_consensus.cc:2368] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14.
I20260709 13:08:26.747550 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.731489 15580 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 6.
I20260709 13:08:26.719174 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.712954 20541 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.731148 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.736390 20665 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:26.736529 20566 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:26.736851 20645 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.740952 20617 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.721182 20369 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.742319 20620 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.742857 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.742365 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:26.767513 15646 raft_consensus.cc:2368] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:26.749569 15727 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:26.756067 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.768934 15720 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.756263 15724 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:26.602185 20287 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.757543 15728 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.771385 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.760849 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.766475 20369 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.773022 20665 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:26.774158 20646 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.477s	user 0.011s	sys 0.000s
I20260709 13:08:26.775453 20665 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.776831 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2155) took 1575 ms. Trace:
I20260709 13:08:26.757736 20569 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.777181 15647 rpcz_store.cc:276] 0709 13:08:25.201516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.238914 (+ 37398us) service_pool.cc:224] Handling call
0709 13:08:25.239264 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.564830 (+325566us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b18003ae400. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92923455 00007f2d95a0b060 00007f2d95a0bbfb 00007f2d95a1664b
0709 13:08:25.564982 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.565007 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.565481 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.891641 (+326160us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:25.891699 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.891775 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:26.776511 (+884736us) raft_consensus.cc:1685] finished
0709 13:08:26.776531 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.776734 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39550,"raft.queue_time_us":21761,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8369,"spinlock_wait_cycles":10507136,"thread_start_us":283907,"threads_started":2,"wal-append.queue_time_us":405555}
I20260709 13:08:26.778416 20569 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.779385 20608 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.780741 20569 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.781654 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.782413 20278 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:26.722530 20603 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.783109 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.783959 19951 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.784379 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.784817 20603 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:26.785192 19951 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.785537 16276 raft_consensus.cc:2368] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15.
I20260709 13:08:26.786834 20606 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:26.787207 20606 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:26.788018 20606 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.789124 20606 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.582924 20633 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.755576 20658 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.793362 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1257) took 1269 ms. Trace:
I20260709 13:08:26.707615 20669 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.771570 20645 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:26.793804 16274 rpcz_store.cc:276] 0709 13:08:25.524309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.524632 (+   323us) service_pool.cc:224] Handling call
0709 13:08:25.524909 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.982449 (+457540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.982480 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.982635 (+   155us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:25.982695 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.793083 (+810388us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400630e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:26.793134 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.793295 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051734272}
I20260709 13:08:26.824318 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.795609 20308 raft_consensus.cc:2764] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:08:26.796245 20003 consensus_meta.cc:287] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
I20260709 13:08:26.827641 20608 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.827414 20003 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.757341 20566 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:26.798607 15579 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:26.798863 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.832127 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.832887 16270 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:26.833789 16270 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:26.799283 15654 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:26.803061 20558 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:26.809358 20627 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:08:26.802452 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.810014 20622 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:26.859959 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.825489 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.857704 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:26.861167 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 1268) took 1241 ms. Trace:
I20260709 13:08:26.861304 16269 raft_consensus.cc:2393] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:26.856300 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.862671 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 89805.8us
I20260709 13:08:26.863642 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:26.864182 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.863646 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.865859 16270 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:26.862218 16276 rpcz_store.cc:276] 0709 13:08:25.597627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.660673 (+ 63046us) service_pool.cc:224] Handling call
0709 13:08:26.839224 (+1178551us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005f1c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:26.839399 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448432512}
I20260709 13:08:26.874095 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.875687 15722 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 6.
I20260709 13:08:26.877558 15654 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.883780 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.884559 15573 raft_consensus.cc:2368] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12.
I20260709 13:08:26.884451 20003 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.888315 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.889142 16269 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.886210 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.889473 16278 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:26.888581 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.890658 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.892416 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.893289 20576 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.894183 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.894495 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.895231 16270 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:26.897614 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.898522 15577 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:26.899055 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.899482 15573 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:26.912390 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:26.858453 20661 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.907495 16276 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:26.919329 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.922567 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.922708 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.923219 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.923262 15571 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.920226 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:26.923563 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.921702 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.923314 15572 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:26.924352 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:26.928536 15652 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:26.927184 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:26.925979 15577 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.930096 16236 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:26.931836 20675 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.932922 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:26.933696 15693 leader_election.cc:400] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14.
I20260709 13:08:26.934085 20664 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.927386 20603 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:08:26.938113 20617 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:26.941608 15728 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:26.942147 20669 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.942402 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.943135 20658 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.863696 20627 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.945386 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.946005 15724 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:26.946424 15619 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.946894 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:26.947293 15619 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.947490 20569 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.950333 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:26.912774 20576 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.950917 15724 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.951478 16277 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.934090 15693 leader_election.cc:403] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.953013 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:26.954304 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.955158 15654 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:26.926679 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:26.961234 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.964118 20627 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.963840 20667 consensus_queue.cc:260] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:26.965377 20576 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.966162 20141 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:26.966832 16273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39946 (request call id 1256) took 1442 ms (client timeout 1756 ms). Trace:
I20260709 13:08:26.979152 15693 leader_election.cc:400] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:26.979611 15693 leader_election.cc:403] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.967511 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:26.981206 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54588us
I20260709 13:08:26.914109 20541 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:26.980361 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.971163 15571 raft_consensus.cc:2468] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
W20260709 13:08:26.971897 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 108328us
I20260709 13:08:26.984089 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.987390 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:26.985457 15724 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
W20260709 13:08:26.967259 16273 rpcz_store.cc:269] 0709 13:08:25.524032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.534813 (+ 10781us) service_pool.cc:224] Handling call
0709 13:08:26.966631 (+1431818us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54004efcd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:26.966773 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436364032}
W20260709 13:08:26.988699 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 233220us
I20260709 13:08:26.993126 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:26.993741 15728 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.993943 15655 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.925232 20684 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:26.987480 15574 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:26.919365 20279 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.003008 16269 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:27.006309 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:26.988644 20410 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.967584 20569 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:27.015518 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:26.982681 20589 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14.
I20260709 13:08:26.988787 20620 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:26.982314 20141 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:27.021018 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:27.025558 15577 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:27.005541 20541 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.031693 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:26.994458 20655 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.048987 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.014596 20003 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17.
I20260709 13:08:27.041018 19612 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.054167 15618 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:27.054620 19612 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:26.958603 20675 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:08:27.055529 19612 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.054628 20484 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.057690 20484 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.907080 20566 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.050913 20410 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:26.988729 20411 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:27.062630 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.063256 15727 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:26.967435 20626 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:27.066339 15728 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:27.068092 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:27.059403 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46050us
I20260709 13:08:27.017551 20684 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:27.075395 15618 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:27.058106 20484 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.026849 20669 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:08:27.079615 20141 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.097354 20569 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.084412 20576 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:27.087337 20369 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.053133 20655 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:27.088996 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101814us
I20260709 13:08:27.097851 15577 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:27.107075 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.078289 20558 raft_consensus.cc:2804] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:27.062250 20620 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:27.018522 20279 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:27.081579 20621 consensus_meta.cc:287] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.994s	user 0.016s	sys 0.004s
I20260709 13:08:26.954250 20661 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.149574 15720 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:27.066109 20665 consensus_queue.cc:1175] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:27.131628 15728 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:27.103114 20405 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:27.152877 15618 leader_election.cc:400] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15.
I20260709 13:08:27.204226 15729 raft_consensus.cc:2368] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13.
I20260709 13:08:27.114279 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.162386 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.159417 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.153816 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.162813 15571 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:27.221061 20681 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:08:27.222967 20405 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:27.216926 15726 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.209602 20651 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.219884 15580 raft_consensus.cc:2410] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:08:27.110986 20548 consensus_meta.cc:287] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:08:27.105518 20649 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:27.225374 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71647.7us
I20260709 13:08:27.222807 15723 raft_consensus.cc:2368] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
W20260709 13:08:27.216805 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64133.9us
I20260709 13:08:27.241371 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:27.241915 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.242388 15573 raft_consensus.cc:2410] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:27.229085 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.173309 20645 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.236841 15574 raft_consensus.cc:2410] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:27.249013 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.237776 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.163944 20279 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.209761 20660 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:08:27.114527 20655 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.149603 20576 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:27.243958 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.245702 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.250058 15720 raft_consensus.cc:2393] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:27.251031 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.251994 15726 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:27.209853 20676 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.276s
W20260709 13:08:27.237272 20695 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:27.154996 20664 consensus_queue.cc:1059] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:08:27.216058 20621 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.108402 20410 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.224069 20405 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.157094 20684 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.252411 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.251205 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:27.396847 15727 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:27.346398 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:27.398567 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 152961us
I20260709 13:08:27.271258 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:27.272827 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.319135 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:27.350965 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.399972 15724 raft_consensus.cc:2376] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10. Re-sending same reply.
W20260709 13:08:27.350135 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.253527 16274 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:27.256817 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.235533 20617 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.402230 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:27.300189 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.344470 15576 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:27.403541 15576 pending_rounds.cc:85] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 8
I20260709 13:08:27.256283 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:27.344776 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:27.404446 15573 raft_consensus.cc:2368] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9.
W20260709 13:08:27.404801 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 148623us
I20260709 13:08:27.403286 15727 raft_consensus.cc:2368] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
I20260709 13:08:27.319978 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.399230 16269 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:27.405911 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.241240 19951 raft_consensus.cc:2764] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:27.302739 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.406793 15574 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:27.402361 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.408327 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.241509 20558 raft_consensus.cc:697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:27.409770 16275 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:27.424096 20662 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:27.424876 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 937) took 1049 ms. Trace:
I20260709 13:08:27.424590 20558 consensus_queue.cc:237] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.425292 16275 rpcz_store.cc:276] 0709 13:08:26.375405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.510611 (+135206us) service_pool.cc:224] Handling call
0709 13:08:27.424671 (+914060us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400644e54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:27.424822 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896764288}
W20260709 13:08:27.412382 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 93355.6us
I20260709 13:08:27.426136 20141 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.426609 20141 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.426983 20141 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.285944 20698 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.272s
I20260709 13:08:27.254278 20278 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:27.428910 20615 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:27.253364 20697 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.186s
I20260709 13:08:27.431784 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46002 (request call id 890) took 1961 ms. Trace:
I20260709 13:08:27.432200 15649 rpcz_store.cc:276] 0709 13:08:25.470512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.637502 (+166990us) service_pool.cc:224] Handling call
0709 13:08:25.651699 (+ 14197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.233227 (+581528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.431516 (+1198289us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002e4354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:27.431720 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307602816}
I20260709 13:08:27.412143 15725 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
W20260709 13:08:27.398159 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 147049us
I20260709 13:08:27.237672 20023 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.399077 20564 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.412119 20622 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.410424 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.420696 20667 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.409909 20653 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:27.295792 20694 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:08:27.244613 20651 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.287465 20620 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.424691 20662 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.450426 15646 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:27.410220 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 157860us
I20260709 13:08:27.452219 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.411738 15726 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:27.435452 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:27.416033 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.435600 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:27.453079 15728 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:08:27.401671 20443 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.004s
I20260709 13:08:27.471253 20443 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.473529 20443 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:27.285763 20654 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.421s
I20260709 13:08:27.482275 20576 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.403849 15576 pending_rounds.cc:107] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:27.493144 15576 raft_consensus.cc:2889] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.438064 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.494227 16274 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:27.439558 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.495151 15727 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 7.
I20260709 13:08:27.495548 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 930) took 1124 ms. Trace:
I20260709 13:08:27.495968 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.495903 16272 rpcz_store.cc:276] 0709 13:08:26.370766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.370909 (+   143us) service_pool.cc:224] Handling call
0709 13:08:26.371300 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.371764 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.371800 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.372330 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.494582 (+1122252us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b18003065e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d955bb4bc 00007f2d9290948b 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1
0709 13:08:27.494728 (+   146us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:27.495001 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.495190 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.495264 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.495302 (+    38us) raft_consensus.cc:1685] finished
0709 13:08:27.495392 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.495501 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186586,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2967,"spinlock_wait_cycles":11306752,"thread_start_us":187821,"threads_started":1,"wal-append.queue_time_us":382284}
I20260709 13:08:27.316473 20631 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.440608 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.503739 15725 raft_consensus.cc:2393] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:27.440622 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.253566 20649 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.508697 20698 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.509872 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2662) took 1209 ms. Trace:
I20260709 13:08:27.510478 20649 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.441838 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:27.511915 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 71396.4us
I20260709 13:08:27.337997 20511 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.512817 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.268631 20411 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.443220 15720 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:27.513796 20411 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.418320 20418 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:27.511936 20671 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.754s	user 0.003s	sys 0.000s
I20260709 13:08:27.514675 20418 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:27.515645 20418 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.516566 20566 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:27.335459 20661 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.412442 20617 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.429322 20278 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:08:27.453255 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.248039 20548 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.530669 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:27.411525 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.460106 15726 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:27.531805 16274 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:27.460355 20023 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:27.460547 20641 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 1.538s	user 0.000s	sys 0.003s
I20260709 13:08:27.460574 20622 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.535981 15648 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:27.461194 20642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.015s	sys 0.016s
I20260709 13:08:27.443152 20683 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:27.445509 20308 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.470435 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.437036 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.510284 15655 rpcz_store.cc:276] 0709 13:08:26.300149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.320892 (+ 20743us) service_pool.cc:224] Handling call
0709 13:08:26.361517 (+ 40625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.994360 (+632843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.509662 (+515302us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540015a4d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:27.509815 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454054144}
I20260709 13:08:27.541911 15728 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.515640 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2656) took 2220 ms. Trace:
I20260709 13:08:27.446393 16277 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:27.542135 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 105175us
I20260709 13:08:27.517910 15727 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:27.531276 20278 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.503335 20631 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:27.530576 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.504617 20564 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.535661 15578 raft_consensus.cc:1240] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:08:27.535511 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.571555 15724 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:27.454627 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.538089 16273 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:27.572518 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 117961us
I20260709 13:08:27.572979 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.573748 15721 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 18: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:27.574076 15692 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:27.469766 20484 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.512861 20511 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:27.542285 19301 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.586645 19301 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.587168 19301 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.524288 15725 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:27.543924 15653 rpcz_store.cc:276] 0709 13:08:25.295420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.542233 (+246813us) service_pool.cc:224] Handling call
0709 13:08:25.542546 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.637445 (+ 94899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.637477 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.642051 (+  4574us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.321378 (+679327us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:26.321418 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.321491 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.511342 (+1189851us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:27.515355 (+  4013us) raft_consensus.cc:1685] finished
0709 13:08:27.515380 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.515577 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19428,"raft.queue_time_us":50454,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11067,"spinlock_wait_cycles":17377536,"thread_start_us":649467,"threads_started":1,"wal-append.queue_time_us":1042274}
I20260709 13:08:27.319865 20369 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.548313 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:27.549013 16271 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:27.592059 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.549113 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:27.567564 16275 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
W20260709 13:08:27.537876 20642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.015s	sys 0.017s
I20260709 13:08:27.465945 20141 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.568419 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:27.600435 15726 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:27.593577 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44540.5us
I20260709 13:08:27.594760 20664 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.596144 20607 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:27.597127 20511 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.603626 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.605590 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.633991 15724 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:27.606364 20644 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:27.606681 20617 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:27.608888 15579 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:27.640004 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:27.621308 20655 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.598555 20576 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.598716 20654 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.623355 20278 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.624531 15723 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:27.630483 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56508.4us
I20260709 13:08:27.634400 15725 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:27.637480 15721 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.622334 15728 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:27.653829 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.628659 20607 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:27.656854 15692 leader_election.cc:400] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12.
I20260709 13:08:27.636921 20369 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:27.659456 15692 leader_election.cc:403] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.659775 20369 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:27.660167 20443 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12.
I20260709 13:08:27.660957 20369 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.663784 15692 leader_election.cc:400] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9.
I20260709 13:08:27.664237 15692 leader_election.cc:403] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.666110 15721 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:27.666711 20651 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.667407 20515 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:27.666112 20631 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.667819 20515 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.668232 20515 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:27.637969 20644 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:27.683919 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:27.684170 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:27.684610 15579 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:27.684962 15721 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:27.685833 20607 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.686925 20607 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:27.690904 20703 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:08:27.692538 20706 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:08:27.693604 20711 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:08:27.695434 20662 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:27.698581 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.650759 20654 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.675077 15692 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.706489 16273 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:27.677824 20443 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 8. Current term is 9.
I20260709 13:08:27.721131 20660 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.706063 20654 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.629210 20245 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.713708 19301 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.677244 20668 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:27.718436 20662 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.765694 19301 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:27.766244 16236 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.660s (SENT)
I20260709 13:08:27.766830 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.763417 20668 consensus_queue.cc:1243] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:27.764389 20443 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:27.780638 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 105682us
I20260709 13:08:27.770557 20620 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:27.793713 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.804850 20642 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.804993 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.805374 20642 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.805725 20642 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:27.806551 20708 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:08:27.770846 20141 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.779594 20603 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:27.819598 20705 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:08:27.776252 20697 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:27.780858 20548 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.763298 20662 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:27.825309 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 120232us
I20260709 13:08:27.822934 20484 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.817584 20668 consensus_queue.cc:1059] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:27.825914 20443 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:27.816190 20620 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:27.852859 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 47950.6us
I20260709 13:08:27.854071 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.830335 20697 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.859519 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:27.869596 20697 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:27.870426 20511 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.870860 15573 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:27.850261 20719 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.845122 20683 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:27.861943 20668 raft_consensus.cc:3055] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:27.883766 20668 raft_consensus.cc:740] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:27.884680 20668 consensus_queue.cc:260] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:27.888969 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.890479 20683 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.890990 20683 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:27.892004 20683 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.893607 20683 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.883150 20662 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:27.920318 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.921052 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.921202 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.921844 16272 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.922410 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:27.895627 20712 log.cc:927] Time spent T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:08:27.924775 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.925387 16274 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:27.899013 20719 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.882218 20723 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:27.904146 20620 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.885973 20668 raft_consensus.cc:3060] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.908632 20245 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.926311 20511 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:27.936874 20511 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.939316 20511 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:27.941004 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.941707 16274 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:27.916107 20642 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.918963 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.942407 16269 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.905723 20278 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.923451 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:27.958904 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 2167) took 1070 ms. Trace:
I20260709 13:08:27.932878 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:27.933164 20621 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.912313 20279 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:27.970372 20279 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:27.970520 16271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39960 (request call id 940) took 1415 ms (client timeout 1793 ms). Trace:
W20260709 13:08:27.970917 16271 rpcz_store.cc:269] 0709 13:08:26.554966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.555889 (+   923us) service_pool.cc:224] Handling call
0709 13:08:27.970307 (+1414418us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54005424d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:27.970453 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242767616}
I20260709 13:08:27.971295 20279 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.972361 20279 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:27.977631 20642 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:27.945457 15578 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:27.984333 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:27.986987 20522 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.987249 20698 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.987648 20649 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.988137 20649 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.989552 20558 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.989697 20411 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.990180 20558 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.991261 20023 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.991776 20023 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.993238 20141 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.993712 20141 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.996248 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:27.998638 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:27.998876 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:27.999347 20687 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.914s	user 0.014s	sys 0.000s
I20260709 13:08:27.999773 15655 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.001260 16269 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:28.003477 15648 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:27.909833 20654 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.959484 15654 rpcz_store.cc:276] 0709 13:08:26.888084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.888326 (+   242us) service_pool.cc:224] Handling call
0709 13:08:27.958647 (+1070321us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b5400418f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:27.958822 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148876544}
I20260709 13:08:27.967101 20655 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:27.990268 20411 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:27.931669 20418 consensus_queue.cc:1059] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:28.012076 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:28.035478 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.035878 15651 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:28.021323 15652 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:28.021826 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.037858 15729 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:28.040337 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 107549us
I20260709 13:08:28.041846 15728 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:28.031560 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.029297 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.044678 15650 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:28.039201 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:28.022966 16269 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.046096 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:28.047135 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 187727us
I20260709 13:08:28.048135 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.048882 15652 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:28.030798 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.050613 15647 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:28.052402 15728 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.055764 15650 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:28.057013 15648 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:28.060068 15649 raft_consensus.cc:2393] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.059919 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:28.061980 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.063966 16271 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.063737 15543 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:28.066327 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.070075 15721 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:28.045128 20675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.019s	sys 0.015s
I20260709 13:08:27.956774 20719 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:08:28.042721 20405 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.072907 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.080889 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.059511 20662 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.078429 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.010110 20522 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:27.996677 20515 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.068159 20443 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.084038 15652 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.084646 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:28.012573 20698 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.064550 20655 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.047575 20651 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:28.070266 20245 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.055239 20418 consensus_queue.cc:1243] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:08:28.080340 20675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.020s	sys 0.016s
I20260709 13:08:28.078096 20642 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.089481 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.100598 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:28.138463 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 99341.5us
I20260709 13:08:28.074812 20278 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.099882 15649 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
I20260709 13:08:28.142800 15655 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:28.143621 20655 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.144011 20655 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.147184 20515 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.149312 20522 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:28.149879 20522 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.150537 20522 consensus_queue.cc:1243] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:28.151306 20655 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.088342 20405 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.154899 20651 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:28.163335 20558 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.126883 20245 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.166307 20245 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.166478 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:28.167366 15655 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.120909 20649 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.173807 15693 leader_election.cc:400] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:28.174335 15693 leader_election.cc:403] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.173802 15729 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:28.088523 20662 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.176012 20662 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.084824 20141 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:28.134248 16236 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.843s (SENT)
I20260709 13:08:28.178422 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:28.179270 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45059us
I20260709 13:08:28.181432 20698 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.090094 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.127250 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:28.137475 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.175424 20411 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.098388 20719 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.183458 15646 raft_consensus.cc:1240] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:28.184873 15650 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:28.125715 20654 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.186766 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:28.134871 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:28.192414 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 65236.2us
I20260709 13:08:28.193076 15728 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:28.193387 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:28.121978 20645 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.203227 20642 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:28.203527 20443 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:28.204602 20640 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:28.207634 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 117649us
I20260709 13:08:28.216115 20606 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:28.124552 20023 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.211990 20125 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.218964 20125 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:28.213315 20418 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:28.219959 20418 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:28.210732 20675 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:28.220438 20418 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:28.206089 20511 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:28.200306 20141 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.213888 16236 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.923s (SENT)
I20260709 13:08:28.223187 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:28.219879 20125 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.223992 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.192425 20468 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.227566 15728 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:08:28.228037 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75149.5us
I20260709 13:08:28.208557 20607 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:28.199743 15655 raft_consensus.cc:2468] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
W20260709 13:08:28.233057 16236 leader_election.cc:336] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.941s (SENT)
I20260709 13:08:28.221360 20418 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.234741 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:28.235675 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.237128 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.237716 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:28.238548 19301 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.240293 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.212160 20278 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:28.212443 20728 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.233965 20607 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.229133 20616 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.260210 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.233964 19951 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.242079 20125 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.212673 20645 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.239996 20667 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.243613 15648 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:08:28.253386 20719 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.222494 20141 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.242239 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.261576 20607 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.243902 15693 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:28.282402 20675 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:28.295356 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.240216 20023 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:28.281235 19951 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.282932 20418 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.299405 20640 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:28.299485 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57652.9us
I20260709 13:08:28.254420 20443 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:08:28.300832 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57010.5us
I20260709 13:08:28.284785 20278 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.308209 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:28.318578 19301 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:28.304827 19951 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.304286 20642 raft_consensus.cc:2804] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:28.322891 19301 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.351200 20642 raft_consensus.cc:697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:28.352221 20642 consensus_queue.cc:237] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.331727 15647 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:28.353365 15647 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:28.354120 15647 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.354992 15647 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.357724 15722 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:28.358129 15722 pending_rounds.cc:85] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:28.358332 15722 pending_rounds.cc:107] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:28.358563 15722 raft_consensus.cc:2889] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.361321 15651 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:28.362437 20617 raft_consensus.cc:3055] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.362866 20617 raft_consensus.cc:740] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:28.363076 20443 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.363746 20617 consensus_queue.cc:260] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.364972 20617 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.365337 15647 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:28.365779 15647 pending_rounds.cc:85] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 10
I20260709 13:08:28.365979 15647 pending_rounds.cc:107] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:28.366216 15647 raft_consensus.cc:2889] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.369316 16277 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:28.370376 20697 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:28.372205 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.373493 16271 raft_consensus.cc:1217] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[12.11-17.13]   Dedup: 12.11->[15.12-17.13]
I20260709 13:08:28.373999 16271 pending_rounds.cc:85] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 11
I20260709 13:08:28.374261 16271 pending_rounds.cc:107] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:28.374475 16271 raft_consensus.cc:2889] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:28.376878 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.378080 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.338667 20660 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:28.312177 20719 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.350555 20645 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:28.350795 20640 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:28.377960 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55693.9us
W20260709 13:08:28.381325 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.336504 20141 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.378840 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 7.
I20260709 13:08:28.394179 20662 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.394951 20606 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.395530 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.384862 20661 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.388311 20660 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.397785 20245 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:28.397709 20710 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.637s	user 0.000s	sys 0.002s
I20260709 13:08:28.417601 15692 leader_election.cc:400] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:28.427511 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:28.438146 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.441680 16278 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:28.388037 20719 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:28.444409 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.418916 20640 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:28.447016 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.447654 20640 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.454175 20606 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:28.454746 20606 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:28.456760 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.457571 20719 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.458335 20611 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:28.458788 20719 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.458863 20611 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.461146 20611 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.456707 20606 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:28.466598 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 225648us
I20260709 13:08:28.468813 15544 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.469058 20622 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:28.471412 20622 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.471856 15578 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:28.473457 20622 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:28.473366 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:28.475210 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.428001 20661 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.478129 20745 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:28.479944 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.480557 16272 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.486167 20661 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.487845 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.489208 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:28.492162 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:28.492612 15579 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:28.492731 15572 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:28.493731 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:28.494530 15652 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 17: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.494453 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:28.495261 15578 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:28.429533 20668 consensus_queue.cc:1059] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:28.506671 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.507830 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.508435 15726 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:28.509366 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.505770 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.511005 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.443732 20740 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:28.478688 20745 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:28.516419 15725 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:28.515070 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.478132 20662 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.517340 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2163) took 1489 ms. Trace:
I20260709 13:08:28.515738 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.524225 15721 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 17: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.526113 15572 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:08:28.523224 15571 rpcz_store.cc:276] 0709 13:08:27.011932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.020743 (+  8811us) service_pool.cc:224] Handling call
0709 13:08:28.501558 (+1480815us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001c4654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:28.501654 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282232064}
I20260709 13:08:28.530952 20245 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.522421 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.533593 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.534209 16273 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.536842 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.537437 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.542549 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.543754 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.544780 19301 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:28.537621 15726 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.546978 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.548223 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.549309 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.550812 15652 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:28.551224 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.552104 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.553069 15727 raft_consensus.cc:2368] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:28.553439 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:28.554672 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.556514 15729 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:28.545280 19301 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.556903 15726 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:28.563011 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.564052 15723 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:28.565052 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.560438 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.569416 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.569903 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:28.558408 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.563478 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.574859 15725 raft_consensus.cc:1240] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.485407 19951 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.577003 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:28.577711 15727 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.581339 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.582723 15723 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:28.581669 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.586823 19301 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:28.556591 20484 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:28.556763 20642 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.580621 20410 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:28.592916 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.534750 20611 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:28.593288 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:28.561570 20615 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:28.600489 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.600396 20727 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:28.601509 20719 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:28.605003 19301 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:28.605593 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 46520.6us
I20260709 13:08:28.592622 20484 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:28.578258 20141 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:08:28.607957 15580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2151) took 1711 ms (client timeout 1933 ms). Trace:
W20260709 13:08:28.629252 15580 rpcz_store.cc:269] 0709 13:08:26.896241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.896357 (+   116us) service_pool.cc:224] Handling call
0709 13:08:28.607796 (+1711439us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54001351d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:28.607907 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666903296}
I20260709 13:08:28.611577 15725 raft_consensus.cc:2376] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12. Re-sending same reply.
I20260709 13:08:28.583570 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:28.612854 15650 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:28.613627 15724 raft_consensus.cc:1240] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:28.591835 15619 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:28.614804 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 185000us
I20260709 13:08:28.617609 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:28.622462 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:28.633793 15727 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.629876 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:28.615664 20410 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.608386 20508 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:08:28.628861 20484 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.667323 15725 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:28.670423 15721 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:08:28.653818 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 62052.7us
I20260709 13:08:28.608582 20558 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:08:28.626318 20745 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.615453 20734 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:08:28.630291 20727 consensus_queue.cc:1243] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:28.628959 20668 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:28.723755 20752 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:08:28.757933 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:28.710353 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:28.758673 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.732116 16272 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:28.771811 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:28.737361 19951 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.729110 20484 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.726775 20660 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.815845 20766 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.816380 20766 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.816783 20766 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.818393 20723 raft_consensus.cc:3055] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.818894 20723 raft_consensus.cc:740] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:28.816082 20484 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.819834 20723 consensus_queue.cc:260] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.820640 15543 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:28.821655 19951 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:28.822244 19951 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:28.823156 19951 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.833083 16275 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:28.801122 16273 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:28.675118 15619 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:28.668254 20410 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.662235 20728 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
W20260709 13:08:28.834901 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 159870us
I20260709 13:08:28.835899 15543 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:28.619339 20642 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:28.833626 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 61908.6us
W20260709 13:08:28.878078 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.699719 20698 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.733747 20631 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.847575 16277 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:28.766178 19301 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:28.670230 20607 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:28.883744 20660 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:28.889909 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.892117 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.896433 19301 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.832600 20308 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:28.915192 15726 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:28.911533 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:28.675882 20640 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:28.927675 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.891683 20508 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:28.934137 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 52164.9us
W20260709 13:08:28.907802 20125 consensus_meta.cc:287] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 13:08:28.694051 20651 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.224s
I20260709 13:08:28.922580 20308 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.904008 20606 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:28.699538 20720 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:28.945420 15652 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:28.947201 19301 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:28.955103 15619 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:28.948851 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:28.984920 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.934299 20508 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.936241 20640 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:28.936316 20698 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:28.984476 16277 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:28.922254 20766 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:28.991997 15543 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:28.995051 19301 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:28.943866 20719 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.995558 19301 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:28.986745 20720 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:29.002717 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47705.3us
I20260709 13:08:29.012199 19301 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.990069 20508 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.020864 20642 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.021373 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.022063 15578 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
W20260709 13:08:29.023698 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.009938 20611 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.988101 20615 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:29.058297 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.058634 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.059114 15578 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 7: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:29.059855 15575 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:29.061583 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:28.989720 20606 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:29.049945 20667 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.053131 15580 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:29.062520 15578 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:29.066563 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.067220 15577 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 8.
I20260709 13:08:29.067410 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.070750 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.057008 20245 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:29.071645 15575 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:29.081184 19301 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.095362 15578 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:29.097997 15576 raft_consensus.cc:1240] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.103569 15578 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:29.002979 20719 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.126161 15578 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:29.127872 19301 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.128993 15578 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:29.129390 15578 pending_rounds.cc:85] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 8
I20260709 13:08:29.129662 15578 pending_rounds.cc:107] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:29.129958 15578 raft_consensus.cc:2889] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.132282 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.123440 15724 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:29.136101 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.132707 20720 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:29.080729 20245 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.139953 20245 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.067752 20698 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.140848 16276 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:29.142280 15544 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:29.142855 20607 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:29.143599 20607 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.148314 20642 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.148430 20645 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.149016 20642 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.149091 20645 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.150846 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.151337 20645 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.150964 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:29.151644 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:29.152407 20743 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.152840 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:29.153347 15654 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:29.153972 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:29.154480 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:29.152894 20743 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.155683 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:29.125365 20651 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.156704 20651 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.157171 20743 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:29.157936 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.158685 20651 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.159197 20607 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.159473 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:29.152840 15647 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:29.160982 20642 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.161751 15655 raft_consensus.cc:2393] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:29.163321 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:29.163930 15724 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.159545 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:29.179998 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.155236 15654 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:29.072882 20667 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.081599 20640 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.164618 20606 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.180626 15544 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:29.186345 15578 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:29.196121 15577 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:08:29.196587 15577 pending_rounds.cc:85] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 11
I20260709 13:08:29.196784 15577 pending_rounds.cc:107] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:29.196991 15577 raft_consensus.cc:2889] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.228729 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:29.238734 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.245155 15724 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:29.198593 20245 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:29.228539 20772 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:08:29.203074 20743 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:29.227530 20278 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:29.262369 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:29.264626 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.240278 20676 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:29.264588 20728 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:29.269063 19951 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:29.269162 20728 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.269771 19951 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:29.270720 20729 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.176s	user 0.005s	sys 0.001s
I20260709 13:08:29.272166 20728 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.273437 19951 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.274477 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:29.275192 15648 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:29.275413 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2165) took 1746 ms. Trace:
I20260709 13:08:29.275758 15573 rpcz_store.cc:276] 0709 13:08:27.529113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.871570 (+342457us) service_pool.cc:224] Handling call
0709 13:08:27.871827 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.872128 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.872154 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.872617 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.928743 (+ 56126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:27.928793 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.928866 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.270145 (+1341279us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:29.275141 (+  4996us) raft_consensus.cc:1685] finished
0709 13:08:29.275161 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.275359 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2236,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":96003840,"thread_start_us":55720,"threads_started":1,"wal-append.queue_time_us":168373}
I20260709 13:08:29.278689 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.286681 20719 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.194089 20607 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.289243 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:29.255928 20245 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:29.263067 20766 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.292783 20615 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:08:29.238106 20645 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:08:29.345880 15577 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.240124 20720 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:29.301121 20245 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.346946 20676 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.359299 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.360088 15574 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:29.347688 20772 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:08:29.345722 20484 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:29.289348 20278 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:29.438777 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.440231 15574 raft_consensus.cc:1275] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:29.375775 20484 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.442721 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:29.452775 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 109326us
I20260709 13:08:29.459978 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:29.460783 15654 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:29.461110 20308 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.382761 20651 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:08:29.450547 20484 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:29.470615 20410 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.006s
I20260709 13:08:29.471037 20410 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.472152 15651 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:29.474550 20655 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.475441 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1298) took 1107 ms. Trace:
W20260709 13:08:29.476794 20770 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:08:29.475970 16271 rpcz_store.cc:276] 0709 13:08:28.367807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.372930 (+  5123us) service_pool.cc:224] Handling call
0709 13:08:28.373297 (+   367us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:28.375107 (+  1810us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:28.637102 (+261995us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.759865 (+122763us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:28.783973 (+ 24108us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.786907 (+  2934us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:28.788552 (+  1645us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.794636 (+  6084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.794700 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.027499 (+232799us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b1800460d20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:29.273583 (+246084us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800460d20. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92926522 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:29.475156 (+201573us) raft_consensus.cc:1685] finished
0709 13:08:29.475187 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.475365 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195117,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":895,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7080,"spinlock_wait_cycles":49962368,"thread_start_us":316283,"threads_started":2,"wal-append.queue_time_us":387115}
W20260709 13:08:29.478945 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.479457 20245 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.488535 20484 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.489692 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:29.369475 20676 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.491124 20484 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.493259 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.493981 15578 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
I20260709 13:08:29.505434 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:29.506390 15578 raft_consensus.cc:2410] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:29.448395 20508 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.507155 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.507464 20522 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:29.507875 20522 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:29.508157 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:29.508723 20508 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.510721 15574 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.515269 20278 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.517458 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 2488) took 1012 ms. Trace:
I20260709 13:08:29.508723 20522 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.518635 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2665) took 1526 ms. Trace:
I20260709 13:08:29.519045 15646 rpcz_store.cc:276] 0709 13:08:27.992727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.993497 (+   770us) service_pool.cc:224] Handling call
0709 13:08:27.993924 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.199765 (+205841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.518360 (+1318595us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400085a54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:29.518575 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435155840}
I20260709 13:08:29.519476 20522 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:29.519719 20308 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.517882 15729 rpcz_store.cc:276] 0709 13:08:28.505308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.510718 (+  5410us) service_pool.cc:224] Handling call
0709 13:08:29.517284 (+1006566us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b5400114754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:29.517399 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103355136}
I20260709 13:08:29.582525 15578 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:29.603308 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2466) took 2082 ms. Trace:
I20260709 13:08:29.603789 15720 rpcz_store.cc:276] 0709 13:08:27.520453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.520953 (+   500us) service_pool.cc:224] Handling call
0709 13:08:27.521221 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.455493 (+934272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.455521 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.455949 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.569149 (+113200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:28.569186 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.602853 (+1033667us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54000e5954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:29.602913 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.602970 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:29.602985 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.603237 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2452,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2147856768,"thread_start_us":112859,"threads_started":1,"wal-append.queue_time_us":237852}
I20260709 13:08:29.607199 15726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 961) took 1048 ms. Trace:
I20260709 13:08:29.607702 15726 rpcz_store.cc:276] 0709 13:08:28.559149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.563195 (+  4046us) service_pool.cc:224] Handling call
0709 13:08:29.606948 (+1043753us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400398354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:29.607133 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788726016}
W20260709 13:08:29.609624 20736 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 1.319s	user 0.004s	sys 0.004s
I20260709 13:08:29.611227 15653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2666) took 1618 ms. Trace:
I20260709 13:08:29.611605 15653 rpcz_store.cc:276] 0709 13:08:27.993053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.994093 (+  1040us) service_pool.cc:224] Handling call
0709 13:08:27.994470 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.994842 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.994880 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.023700 (+ 28820us) log.cc:844] Serialized 26 byte log entry
0709 13:08:28.196244 (+172544us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:28.196285 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.196349 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.608901 (+1412552us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:29.610794 (+  1893us) raft_consensus.cc:1685] finished
0709 13:08:29.610831 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.611149 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":813,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"spinlock_wait_cycles":4832128,"thread_start_us":126221,"threads_started":1,"wal-append.queue_time_us":194695}
W20260709 13:08:29.617111 16236 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.121s (SENT)
I20260709 13:08:29.617743 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:29.635847 16236 leader_election.cc:336] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.170s (SENT)
I20260709 13:08:29.636329 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:29.638839 16236 leader_election.cc:336] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.199s (SENT)
I20260709 13:08:29.639289 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:29.639962 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 176773us
W20260709 13:08:29.648286 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 186748us
I20260709 13:08:29.637820 20631 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:29.651955 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.652312 20766 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:08:29.637425 20607 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.630688 20789 consensus_queue.cc:1059] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:29.670189 20676 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.578634 20644 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.710268 20792 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:29.691987 20698 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:29.711879 20698 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.713020 20787 raft_consensus.cc:3055] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:29.713416 20787 raft_consensus.cc:740] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:29.680387 20789 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:29.720196 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.738529 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 91757.5us
W20260709 13:08:29.741185 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89668.5us
I20260709 13:08:29.741604 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:29.717195 20644 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.738049 20508 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:29.764093 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.746976 20769 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.747689 20698 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:29.770058 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 131218us
W20260709 13:08:29.772987 16236 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.241s (SENT)
I20260709 13:08:29.773432 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.744757 20631 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:29.768183 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:29.767804 20418 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:29.761157 20773 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:08:29.794832 16236 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 1.936s (SENT)
I20260709 13:08:29.805303 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.766367 20789 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:29.767643 20508 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.762468 20787 consensus_queue.cc:260] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.803112 20418 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:29.816439 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48328.4us
W20260709 13:08:29.841971 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 96207.4us
I20260709 13:08:29.840077 20418 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.810901 20698 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:29.809744 20801 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:29.844539 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 49744.3us
I20260709 13:08:29.847994 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:29.846757 20795 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:29.864274 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.858482 20787 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:29.847031 20800 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:29.881209 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.884140 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.866581 20655 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.874567 20631 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:29.891351 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.866796 20810 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:29.876996 20773 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.893266 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.893916 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:29.897874 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.895124 15727 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:29.881562 20789 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:29.898595 15724 raft_consensus.cc:2393] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:29.896723 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57328us
I20260709 13:08:29.863298 20698 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:29.899206 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:29.901454 15720 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:29.903049 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.906153 15720 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:29.907461 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:29.897743 20794 log.cc:927] Time spent T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:08:29.910580 15571 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.913964 15577 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:08:29.913730 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 45391.6us
I20260709 13:08:29.916126 15578 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:29.938273 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:29.930773 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:29.886941 20522 consensus_queue.cc:1048] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:29.939216 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:29.907269 20796 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.890439 20602 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:29.944562 15720 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:29.945523 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.893023 20631 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:29.947815 16272 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:29.963752 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:08:29.948093 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.954491 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:29.954734 20405 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:29.955392 20484 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:29.964488 15729 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:29.967996 15724 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:29.888929 20800 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:29.966777 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:29.908288 20807 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.948086 20811 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.001802 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:29.941906 20655 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:29.963055 20797 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:08:29.972733 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:29.905191 20803 consensus_queue.cc:1059] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:08:29.971939 20793 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:08:30.030599 16272 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:29.970996 20631 raft_consensus.cc:3060] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:29.941251 20789 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:08:30.055642 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.041605 16276 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:30.060264 20675 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:30.061359 20803 raft_consensus.cc:2764] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:08:30.064064 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 164978us
I20260709 13:08:30.090685 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.039515 20815 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:29.968235 20796 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:30.078070 20798 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:08:30.071440 20808 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.104022 20622 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.104604 20622 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.106870 20622 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:30.097586 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 133904us
I20260709 13:08:30.100090 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.108538 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.109380 15571 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:30.099082 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.110374 15574 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:30.084942 20405 consensus_queue.cc:1059] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:30.085893 20508 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.114749 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.115321 20815 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.115917 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.116927 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.117569 15577 raft_consensus.cc:2393] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:30.002314 20814 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:08:30.122427 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.126063 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:30.118251 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.135607 15572 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.140878 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.141736 16274 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:30.142696 16272 raft_consensus.cc:2393] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 11: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:30.143826 16269 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:30.144667 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.036309 20811 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.145037 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:30.119127 20805 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:30.150923 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.148370 15571 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:30.149147 15574 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:30.150710 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.096287 20818 raft_consensus.cc:3055] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.117964 20815 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.153015 16270 raft_consensus.cc:2393] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 7: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:30.159947 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.160715 16269 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:30.153889 15577 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:30.153045 16277 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:30.155974 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.155865 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.164273 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.167150 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.147428 20508 raft_consensus.cc:3055] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:30.161890 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.167801 16274 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
I20260709 13:08:30.175652 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.156206 20405 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.173152 15572 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:30.178331 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.178915 16277 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:08:30.180068 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.181797 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.157928 20818 raft_consensus.cc:740] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:30.139290 20808 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.190042 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:30.161249 20816 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.193614 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.174738 20125 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.173455 20606 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.173775 20508 raft_consensus.cc:740] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:30.197280 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.184147 20820 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.203691 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.211836 16276 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:30.215672 15571 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:08:30.216199 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 274442us
I20260709 13:08:30.188257 20698 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.193275 20789 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.218771 16236 leader_election.cc:400] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11.
I20260709 13:08:30.220679 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:30.196085 20125 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:30.210484 20814 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.235270 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:30.228112 20731 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 2.080s	user 0.000s	sys 0.009s
I20260709 13:08:30.236892 16278 raft_consensus.cc:2410] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:30.199040 20418 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.217941 20800 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.237761 16276 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:30.238672 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.262169 16271 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.239151 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.263469 16277 raft_consensus.cc:2393] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:08:30.239981 20823 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:08:30.240481 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.265214 16273 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:30.212993 20815 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:30.245488 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:30.269819 16269 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.245985 20808 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.221462 20602 consensus_queue.cc:1059] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:30.230365 20796 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.197916 20816 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.204203 20606 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.283922 20816 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.230644 20125 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.246423 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.284631 20606 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.284853 16272 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 8.
W20260709 13:08:30.247310 20824 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:08:30.247921 20820 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.286829 20820 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.289356 20820 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.237018 20818 consensus_queue.cc:260] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:30.251456 20822 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:30.254969 20811 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:30.255604 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.217885 20812 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.294911 19951 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:30.295387 19951 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:30.299999 16271 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:30.300261 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.301103 15571 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:30.302678 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.233639 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.217063 20828 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:30.260617 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.305581 20828 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:30.223183 20508 consensus_queue.cc:260] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.306383 20606 raft_consensus.cc:2764] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:30.274878 20245 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:30.275854 20644 consensus_meta.cc:287] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 13:08:30.307734 20589 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.308185 20589 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:30.310253 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.279812 20803 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:30.305102 15579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 998) took 1246 ms. Trace:
W20260709 13:08:30.235862 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.311687 15579 rpcz_store.cc:276] 0709 13:08:29.058273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.058424 (+   151us) service_pool.cc:224] Handling call
0709 13:08:30.304901 (+1246477us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54001c4654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:30.305043 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374030080}
W20260709 13:08:30.305883 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 73845.4us
I20260709 13:08:30.312904 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.313457 15579 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:30.313527 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.306658 20508 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.315383 20811 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:30.305109 16269 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:30.311699 20787 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.319170 20787 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:30.319945 20787 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.321060 20787 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:30.323513 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.323989 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.326167 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.326550 20828 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.328178 15654 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.327637 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.329653 15646 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:30.330549 20745 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.329612 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.331094 20745 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:30.332439 15543 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.334748 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.310499 15722 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:30.335914 15722 pending_rounds.cc:85] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 7
I20260709 13:08:30.336124 15722 pending_rounds.cc:107] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:30.336336 15722 raft_consensus.cc:2889] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.337872 19301 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:30.338392 19301 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:30.331583 20745 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.333938 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.341718 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.342363 15655 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:30.342221 20245 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:30.331765 20728 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.353650 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.342483 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.347575 19301 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.352005 15655 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:30.354291 15654 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:30.350188 20617 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:30.356772 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 136158us
I20260709 13:08:30.273892 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 9.
I20260709 13:08:30.365990 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.361747 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.352731 20811 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.394742 15655 raft_consensus.cc:1240] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.398236 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.400290 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.313565 20589 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:30.355396 20606 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:30.358543 20816 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.404047 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.411060 20821 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.397203 20811 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.414788 20811 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.419471 20796 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:30.420889 20589 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:30.421284 20589 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:30.359136 20728 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.422062 20589 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.422327 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.423159 20589 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.424892 20728 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.425671 20832 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.420644 20796 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:30.393340 20644 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.419778 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:30.426630 20644 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.427582 20796 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.427947 20796 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.428274 20796 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.428823 20816 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:30.472266 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 52555.2us
W20260709 13:08:30.472354 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50119.4us
I20260709 13:08:30.490456 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:30.494186 20697 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:30.494467 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.495299 15646 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:30.496549 20125 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.498737 20125 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.499444 15653 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:30.532390 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.533258 15650 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 18.
I20260709 13:08:30.535210 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.535980 15649 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:30.464349 20816 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:30.551592 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.552809 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.553171 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.554564 16273 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:30.477406 20728 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.401778 20631 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.499850 20821 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:30.585487 16277 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:30.536846 20644 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:30.536458 20808 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.489959 20820 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:08:30.431632 20606 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.579461 20728 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.624881 20606 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.637411 20606 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:30.638010 20667 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.637952 20606 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.642632 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.643852 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.651863 20606 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.653577 15651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2688) took 1506 ms. Trace:
I20260709 13:08:30.653957 15651 rpcz_store.cc:276] 0709 13:08:29.147496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.150273 (+  2777us) service_pool.cc:224] Handling call
0709 13:08:29.150571 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.472652 (+322081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.653354 (+1180702us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540017c854. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:30.653522 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738947840}
I20260709 13:08:30.657549 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1000) took 1598 ms. Trace:
I20260709 13:08:30.657914 15576 rpcz_store.cc:276] 0709 13:08:29.058803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.066394 (+  7591us) service_pool.cc:224] Handling call
0709 13:08:29.066678 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.098551 (+ 31873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.657326 (+1558775us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54003facd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:30.657491 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71643520}
I20260709 13:08:30.661260 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.661490 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.670990 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.597019 20808 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.686647 15572 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:30.690114 19301 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:30.689668 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 274261us
I20260709 13:08:30.691108 19301 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:30.660125 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 327723us
I20260709 13:08:30.675638 20792 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.696460 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.700021 16276 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:08:30.704645 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.710956 15572 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 18.
I20260709 13:08:30.714128 20418 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.703806 20640 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.717963 16235 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.718400 20640 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:30.720562 20819 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.638s	user 0.001s	sys 0.000s
I20260709 13:08:30.720863 20640 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:30.721654 20799 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.876s	user 0.003s	sys 0.000s
W20260709 13:08:30.722015 15580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41382 (request call id 2033) took 2052 ms (client timeout 1902 ms). Trace:
W20260709 13:08:30.722381 15580 rpcz_store.cc:269] 0709 13:08:28.669140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.669349 (+   209us) service_pool.cc:224] Handling call
0709 13:08:30.721833 (+2052484us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000d52d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:30.721949 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558296832}
I20260709 13:08:30.723429 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:30.723990 15580 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:30.724153 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:30.727936 20808 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.704833 15692 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:30.702275 15543 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.698900 20719 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.695266 20622 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.674016 20745 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.732086 15578 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:30.733822 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.738219 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 1.27581e+06us
I20260709 13:08:30.750875 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:30.753703 15723 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:30.743674 19301 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:30.740509 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:30.755496 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:30.744779 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.753286 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:30.758525 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.757745 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53001.4us
W20260709 13:08:30.757635 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.709004 20837 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:30.763937 15727 raft_consensus.cc:2393] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:30.763586 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:30.765715 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:30.768131 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.769930 15721 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:30.765169 15726 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
W20260709 13:08:30.746045 20835 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:08:30.776254 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.767628 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:30.729996 20728 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.776922 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.762530 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.793210 15579 raft_consensus.cc:2468] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:30.795066 16235 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:30.759433 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:30.805200 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.746060 20808 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:30.734417 20849 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:30.809247 19301 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.809953 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:30.758097 20821 raft_consensus.cc:3055] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:30.812006 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:30.800987 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:30.861501 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.857709 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56803us
W20260709 13:08:30.867033 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.819226 19301 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.772380 20675 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:30.733691 20811 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:30.710531 20796 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.818337 15648 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:30.938304 16276 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:30.940716 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:30.943424 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 74556.4us
I20260709 13:08:30.735351 20667 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:08:30.736027 20719 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.735782 20843 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.199s
I20260709 13:08:30.752050 20622 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:30.993014 20640 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:30.804901 20589 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:30.934705 20821 raft_consensus.cc:740] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:30.811522 20617 raft_consensus.cc:2804] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:30.939574 20728 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:31.022666 15651 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:30.817912 20849 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.041183 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.043388 15723 raft_consensus.cc:2368] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14.
I20260709 13:08:31.043665 15724 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:30.959239 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:31.064241 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 105117us
I20260709 13:08:30.944643 20410 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:31.071677 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.071864 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.073423 19301 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:30.778187 20837 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:31.054469 20840 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:08:31.090962 20804 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.104017 20804 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.104192 20846 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 13:08:31.104483 20804 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:31.099017 20852 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
I20260709 13:08:31.015776 20808 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.110774 20808 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:31.017249 20675 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:31.078253 20787 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.005s
I20260709 13:08:31.066210 15692 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:31.166350 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100324us
I20260709 13:08:31.167413 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.170296 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.174265 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.071396 20849 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.090848 20617 raft_consensus.cc:697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:31.056473 20728 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.160669 15653 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
W20260709 13:08:31.214699 16236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.266829 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 99529.5us
I20260709 13:08:31.267884 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:31.268095 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.280491 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.292941 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.185438 20727 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.270973 20589 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:31.274571 20728 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:31.323884 20806 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 1.376s	user 0.007s	sys 0.018s
W20260709 13:08:31.325034 20845 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
W20260709 13:08:31.325501 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.326471 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1014) took 1107 ms. Trace:
I20260709 13:08:31.326951 15574 rpcz_store.cc:276] 0709 13:08:30.219196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.320636 (+101440us) service_pool.cc:224] Handling call
0709 13:08:30.320915 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.336852 (+ 15937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.336889 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.337336 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.662578 (+325242us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:30.662633 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.662726 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.326201 (+663475us) raft_consensus.cc:1685] finished
0709 13:08:31.326227 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.326403 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15572,"raft.queue_time_us":16520,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":303589,"threads_started":1,"wal-append.queue_time_us":418092}
I20260709 13:08:31.330359 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1017) took 1109 ms. Trace:
W20260709 13:08:31.330648 20848 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:08:31.330935 15576 rpcz_store.cc:276] 0709 13:08:30.220633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.675404 (+454771us) service_pool.cc:224] Handling call
0709 13:08:30.676228 (+   824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.676556 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.676593 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.677954 (+  1361us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.938091 (+260137us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:30.938148 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.938234 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.330061 (+391827us) raft_consensus.cc:1685] finished
0709 13:08:31.330096 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.330291 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":231663,"threads_started":1,"wal-append.queue_time_us":635367}
I20260709 13:08:31.333612 15576 raft_consensus.cc:1240] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:31.334635 20727 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.346737 20745 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.348819 20811 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.350472 20719 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:31.352558 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.352777 20622 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:31.356017 20813 log.cc:927] Time spent T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 1.448s	user 0.005s	sys 0.015s
I20260709 13:08:31.359141 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.318269 20589 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.368341 20589 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:31.369190 20723 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.287458 20410 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.375586 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.039s	sys 0.088s
W20260709 13:08:31.377246 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.039s	sys 0.088s
I20260709 13:08:31.299803 20558 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:31.189369 20804 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:31.378849 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 567642us
I20260709 13:08:31.383463 20558 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.395969 20804 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.399297 19951 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.400300 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1016) took 1180 ms. Trace:
I20260709 13:08:31.400835 19951 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.401865 20558 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.403985 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.405788 15693 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:31.380810 20410 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.407456 20804 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.407833 20804 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.408079 20410 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.408196 20804 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.411548 20787 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.412108 20787 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.413694 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:31.400668 15571 rpcz_store.cc:276] 0709 13:08:30.220271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.340899 (+120628us) service_pool.cc:224] Handling call
0709 13:08:30.341293 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.671925 (+330632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.671956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.672397 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.118712 (+446315us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:31.118765 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.118856 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.400090 (+281234us) raft_consensus.cc:1685] finished
0709 13:08:31.400111 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.400246 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77728,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":743918,"threads_started":2,"wal-append.queue_time_us":682045}
I20260709 13:08:31.415849 20727 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:31.415849 20804 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.417264 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.420095 20811 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.420706 20811 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.421307 20811 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.423707 20804 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.275152 20821 consensus_queue.cc:260] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.386706 20675 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:31.448813 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.449180 15580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2038) took 1205 ms. Trace:
I20260709 13:08:31.466830 15577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2198) took 1374 ms. Trace:
I20260709 13:08:31.470243 20728 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:31.471014 20792 consensus_queue.cc:1059] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:31.471293 20787 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:31.472886 20728 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:31.442648 20617 consensus_queue.cc:237] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.477320 20640 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.467267 15577 rpcz_store.cc:276] 0709 13:08:30.092284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.165012 (+ 72728us) service_pool.cc:224] Handling call
0709 13:08:30.185043 (+ 20031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.285407 (+100364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.285438 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.285862 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.540930 (+255068us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:30.810174 (+269244us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.810383 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.466363 (+655980us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54000d66d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:31.466409 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.466451 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:31.466555 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.466771 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":550332,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":283704,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":180,"spinlock_wait_cycles":230107520,"thread_start_us":449434,"threads_started":2,"wal-append.queue_time_us":411851}
W20260709 13:08:31.512702 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 244911us
I20260709 13:08:31.519681 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.525514 20728 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.531230 15724 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.531409 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:31.532320 15720 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:31.533042 15725 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:31.533551 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:31.541360 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:31.512285 20847 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.701s	user 0.004s	sys 0.008s
I20260709 13:08:31.542001 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:31.542846 19951 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.544520 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:31.545156 15721 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:31.545213 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.546165 20566 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:31.546810 20566 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.546976 20849 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.548648 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.549628 20606 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.552079 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.552834 20606 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.556212 20606 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:31.558048 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.543380 19951 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.558517 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.558878 20837 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:31.560001 20862 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.560252 19951 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.560751 20862 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.563470 20862 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.565310 20606 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.477988 20640 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.566407 20631 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:31.567790 20640 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.570502 20818 raft_consensus.cc:3060] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.577322 15572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2039) took 1333 ms. Trace:
I20260709 13:08:31.578357 15572 rpcz_store.cc:276] 0709 13:08:30.243980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.726918 (+482938us) service_pool.cc:224] Handling call
0709 13:08:30.727185 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.727357 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:31.185146 (+457789us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.576286 (+391140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.576354 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:31.576764 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.576901 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.577259 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60425,"prepare.queue_time_us":578058,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":787547,"threads_started":2,"wal-append.queue_time_us":280968}
I20260709 13:08:31.593940 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:31.596817 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.602078 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.603024 15574 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
W20260709 13:08:31.605522 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 190310us
W20260709 13:08:31.614667 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 167763us
I20260709 13:08:31.615175 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.617143 15652 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.629509 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.630213 15655 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:31.575819 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:31.631755 15578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.013s
W20260709 13:08:31.632272 15578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.007s	sys 0.014s
I20260709 13:08:31.634826 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.635619 15653 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:31.637400 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.633224 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2045) took 1378 ms. Trace:
I20260709 13:08:31.651750 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.653051 15572 raft_consensus.cc:2410] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:08:31.653887 19951 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:31.655189 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 79447.6us
I20260709 13:08:31.656694 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.657361 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:31.658383 15579 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:31.663764 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.664168 19951 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:31.672010 19951 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:31.672519 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:31.672509 19951 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:31.646051 15578 rpcz_store.cc:276] 0709 13:08:30.254616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.743666 (+489050us) service_pool.cc:224] Handling call
0709 13:08:30.743917 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.744097 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:31.048168 (+304071us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.632796 (+584628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.632866 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:31.632925 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.633010 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.633159 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580644,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":10773,"thread_start_us":872549,"threads_started":2}
W20260709 13:08:31.679160 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 375003us
I20260709 13:08:31.681527 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.690953 15652 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:31.679440 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.651445 20640 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.680136 20606 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:31.665205 20727 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.720973 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:31.665309 20876 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.723785 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.693198 15655 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 19.
I20260709 13:08:31.732389 15571 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:31.670492 20804 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.669616 20837 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:31.727509 15572 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:31.700078 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 231694us
I20260709 13:08:31.669836 20728 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.719035 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:31.728060 20816 consensus_meta.cc:287] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 1.138s	user 0.010s	sys 0.003s
I20260709 13:08:31.693396 20849 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.716572 20558 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:31.729856 20881 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.744426 20728 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.762117 20881 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:31.762732 20881 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.763540 20728 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.721467 20723 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:31.667785 20589 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:31.745069 20872 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:31.716511 20566 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:31.724833 20606 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:08:31.746814 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67450.1us
W20260709 13:08:31.765676 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 103259us
I20260709 13:08:31.777304 15574 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:31.770053 20882 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:31.778554 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:31.781776 15571 raft_consensus.cc:1240] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:31.735603 19951 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.793056 15544 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.801033 15572 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 19.
I20260709 13:08:31.745985 20885 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:31.752106 20862 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:31.726411 20640 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.835400 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:31.836601 15544 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.764295 20631 raft_consensus.cc:3055] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:31.751820 20558 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:31.845546 20631 raft_consensus.cc:740] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:31.740720 20876 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:31.845885 20558 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:31.846516 20878 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:31.846736 20631 consensus_queue.cc:260] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.847724 20876 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:31.742779 20804 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.847994 20631 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.733548 20727 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.747669 20837 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.849859 20804 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.850952 19951 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:31.853560 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 136436us
I20260709 13:08:31.810122 20606 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:31.840996 20869 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:31.811574 20882 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.854128 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.864032 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:31.789719 20723 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.752492 20816 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.887305 15544 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:31.890432 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.891791 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:31.834794 20868 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:08:31.889552 20769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.982s	user 0.017s	sys 0.019s
W20260709 13:08:31.897337 20769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.992s	user 0.017s	sys 0.020s
I20260709 13:08:31.843465 20676 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:31.864557 20745 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.864737 20886 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.910169 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.894068 20566 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.911247 15720 raft_consensus.cc:2368] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
W20260709 13:08:31.905908 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.887398 20410 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:31.927268 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:31.927564 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:31.928402 16274 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:31.913882 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 194930us
I20260709 13:08:31.914893 15648 raft_consensus.cc:2393] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 17: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:31.889416 20882 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.860025 20811 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.931289 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:31.843365 20885 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.910522 20899 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:31.956468 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 55201.4us
W20260709 13:08:31.957574 20888 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:08:31.920462 20881 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.921854 20849 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.948367 20876 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.935321 20745 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.935905 20801 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:31.974658 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.976186 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:31.985638 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54435.9us
I20260709 13:08:31.987551 15648 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:31.956634 20566 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:31.995750 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.987200 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:32.000531 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 108839us
W20260709 13:08:32.001289 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 138143us
I20260709 13:08:32.007282 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.010246 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:32.012184 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.012854 15646 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:32.013960 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:31.947322 20410 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.918958 20886 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:31.968247 20876 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:32.022408 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.022919 15647 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:32.023473 15653 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:32.016199 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.017107 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:31.979487 20881 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.027253 15648 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:32.033171 15646 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:32.000600 20898 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.036761 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.038792 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.016172 20849 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:32.019459 20566 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.050649 20723 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:32.051334 20892 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:32.053635 20589 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:31.449579 15580 rpcz_store.cc:276] 0709 13:08:30.243725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.724589 (+480864us) service_pool.cc:224] Handling call
0709 13:08:30.724887 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.725074 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:31.043460 (+318386us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.448745 (+405285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.448797 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:31.448845 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.448918 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.449122 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1857,"prepare.queue_time_us":482034,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4064,"thread_start_us":721061,"threads_started":2}
I20260709 13:08:31.959087 20899 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.036787 20880 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 13:08:32.040601 20884 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:08:32.029100 20876 raft_consensus.cc:3060] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:32.033998 20879 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:08:32.074122 19301 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.076990 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.079789 19301 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.077441 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:32.081717 15727 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:32.085867 15646 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:32.041911 20881 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.042623 20916 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:32.076447 20889 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 13:08:32.123646 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:31.995354 20801 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.065801 20849 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:32.136061 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.083808 20640 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.142087 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:32.142777 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 114257us
I20260709 13:08:32.152724 15649 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:32.127279 20816 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.168017 19301 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.141390 20418 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.144944 20906 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.162659 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.180294 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.196069 15726 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:32.043242 20898 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.183529 20801 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.185806 20885 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.194303 20811 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:32.194618 20894 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:08:32.135013 20903 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:08:32.127842 20916 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.245401 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.191782 20418 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.203845 20589 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:32.264170 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.264878 15580 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
W20260709 13:08:32.266956 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.268442 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.269052 15580 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 11.
W20260709 13:08:32.266280 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 259183us
I20260709 13:08:32.258764 20801 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.193712 20906 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.273234 20818 consensus_meta.cc:287] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.000s
I20260709 13:08:32.318706 16275 raft_consensus.cc:1275] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:08:32.319249 16275 pending_rounds.cc:85] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 11
I20260709 13:08:32.319552 16275 pending_rounds.cc:107] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:08:32.319857 16275 raft_consensus.cc:2889] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.278697 20410 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.281909 20589 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:32.328495 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.328617 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.331065 15580 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:32.333313 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:32.333930 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.334370 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:32.334945 15571 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.335175 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.335822 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.336455 15726 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:32.336614 15580 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:32.258106 20849 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.338361 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:32.343698 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 343777us
I20260709 13:08:32.281658 20882 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.355734 15571 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:32.327163 20869 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.364964 20818 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.365679 20818 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.366542 20920 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.367007 20920 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:32.367383 20920 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.368227 20818 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.368876 20818 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.327484 20886 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.361685 20898 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.362277 20918 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.340945 20885 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:32.344801 20899 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.363160 20418 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.363978 20912 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.364516 20882 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.372995 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.361349 20938 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.315162 20801 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.369381 20818 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.375095 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.393090 20589 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.410718 15649 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:32.394058 20885 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.394928 20918 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.403664 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.404314 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:32.393913 20622 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:32.415613 15578 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.420439 20622 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:32.424638 20622 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.426962 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2739) took 3937 ms. Trace:
I20260709 13:08:32.381112 20922 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.427394 15722 rpcz_store.cc:276] 0709 13:08:28.489288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.489424 (+   136us) service_pool.cc:224] Handling call
0709 13:08:28.489686 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.336745 (+1847059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.425982 (+2089237us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400398d54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:32.426880 (+   898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4186754432}
W20260709 13:08:32.412029 20558 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.002s
I20260709 13:08:32.432426 20558 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.436947 20906 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:32.437455 20606 consensus_meta.cc:287] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
I20260709 13:08:32.437711 20558 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:32.438386 20631 consensus_meta.cc:287] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.000s
I20260709 13:08:32.438612 15648 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.427261 20920 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.440414 20858 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.748s	user 0.000s	sys 0.001s
I20260709 13:08:32.396253 20886 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:08:32.428720 20882 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:32.435039 20922 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.446458 20922 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.448024 20801 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.448923 20916 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.475716 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:32.469122 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53833.1us
I20260709 13:08:32.453589 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:32.451963 16274 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:32.474974 20801 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.487301 15578 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:32.486444 20920 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.469717 20907 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.458178 20882 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:32.486825 20913 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.498586 20821 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.491416 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:32.559324 16276 raft_consensus.cc:2410] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:32.488010 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:32.408777 20912 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.511543 20937 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.511821 20818 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.513042 20876 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.413281 20938 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.578326 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34148 (request call id 975) took 1036 ms. Trace:
I20260709 13:08:32.578758 15720 rpcz_store.cc:276] 0709 13:08:31.541639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.541782 (+   143us) service_pool.cc:224] Handling call
0709 13:08:32.578125 (+1036343us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003d1654. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:32.578269 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847251712}
I20260709 13:08:32.580142 20938 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.572778 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.569185 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.583806 15721 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 10: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:32.532655 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39960 (request call id 956) took 2385 ms. Trace:
I20260709 13:08:32.563989 15724 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:32.584175 16275 rpcz_store.cc:276] 0709 13:08:30.146856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.146984 (+   128us) service_pool.cc:224] Handling call
0709 13:08:30.162004 (+ 15020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.320387 (+2158383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.532372 (+211985us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54006e0354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:32.532591 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4958802944}
I20260709 13:08:32.552392 16271 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:32.555019 20928 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:32.555613 20837 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.556206 20882 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.554721 15648 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:32.587898 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41396 (request call id 2186) took 3076 ms. Trace:
I20260709 13:08:32.588393 15573 rpcz_store.cc:276] 0709 13:08:29.505751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.510111 (+  4360us) service_pool.cc:224] Handling call
0709 13:08:30.722186 (+1212075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.722348 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.722392 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.722438 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:30.722468 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.722521 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.582213 (+1859692us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000d52d0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:32.582334 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786880896}
I20260709 13:08:32.437876 20606 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.560882 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 72982.9us
I20260709 13:08:32.561733 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:32.596588 15727 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 9: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:32.575274 20864 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:32.576666 20876 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.583145 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.598750 15693 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:32.599619 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 241302us
I20260709 13:08:32.599879 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:32.586954 15724 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:32.561554 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.601289 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.573405 20913 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.601979 15618 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.603178 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:32.601881 15573 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:32.605911 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.603585 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:32.558154 20801 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.609710 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.609679 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.559276 20907 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.615099 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.615084 15720 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:32.618216 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.604251 20766 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.598246 20864 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:32.564267 20728 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:32.667476 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.668033 15580 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.675266 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.607239 20837 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:32.669723 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.687052 15575 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:32.605396 20913 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.618877 15579 raft_consensus.cc:1240] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:32.671049 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.695108 15571 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:32.617774 20876 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.667488 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.618402 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:32.672102 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:32.700119 15576 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.608984 20895 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.607671 20938 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:32.609107 20897 raft_consensus.cc:2764] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:32.679414 20812 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:32.680130 20907 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.731804 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:32.732719 15654 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.681150 15572 raft_consensus.cc:1240] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:32.734243 15723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44464 (request call id 2766) took 1979 ms (client timeout 2216 ms). Trace:
I20260709 13:08:32.682585 20818 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:32.684644 20728 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:32.730080 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58059.4us
I20260709 13:08:32.737754 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.616272 20939 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:32.731706 20877 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:32.734896 15723 rpcz_store.cc:269] 0709 13:08:30.755121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.755283 (+   162us) service_pool.cc:224] Handling call
0709 13:08:32.733865 (+1978582us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54001fc554. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:32.734160 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658266880}
I20260709 13:08:32.586766 20937 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.747148 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.702546 20796 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.710976 20913 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.699299 20876 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.746466 20907 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:32.755581 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:32.732270 20812 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.761166 20812 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.773049 15576 raft_consensus.cc:2468] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:32.759344 20876 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.759167 20895 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.739507 20938 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.773245 20928 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.789368 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.793160 16235 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:32.802479 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:32.803049 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:32.803918 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:32.804543 16277 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 7.
I20260709 13:08:32.805579 20728 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.755992 20864 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.808995 16274 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:32.810117 20606 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.810432 20727 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.810832 20808 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.811164 20801 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:32.811877 20912 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.813217 20937 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:32.813609 20943 log.cc:927] Time spent T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.304s	user 0.013s	sys 0.010s
I20260709 13:08:32.815725 20909 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:32.818367 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:32.818987 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:32.819497 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:32.822008 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.823427 16278 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:32.823496 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:32.823768 15654 raft_consensus.cc:2468] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:32.825798 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:32.829155 15655 raft_consensus.cc:2468] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:32.817940 20667 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.823537 20803 raft_consensus.cc:2804] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.835597 20667 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.836599 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:32.837888 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.838760 15579 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:32.839077 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:32.794764 20928 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.841887 15722 raft_consensus.cc:2368] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:32.844069 20915 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:32.844854 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.801573 20945 consensus_queue.cc:1059] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:32.818095 20818 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:32.816421 20909 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:32.850373 16278 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:32.851778 15693 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:32.852833 15693 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:32.860154 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:32.860684 15722 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:32.862874 15619 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.864526 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:32.838212 20803 raft_consensus.cc:697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:32.847671 20928 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.825757 20911 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:32.854628 20818 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.859035 20766 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.862277 20927 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.870994 20642 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:32.872217 20821 raft_consensus.cc:3055] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:32.868258 20667 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.892257 20898 raft_consensus.cc:2804] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:32.890527 20925 raft_consensus.cc:2804] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.898541 20818 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.965723 20916 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:32.967104 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.968789 20916 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.969532 20916 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.916867 20821 raft_consensus.cc:740] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
W20260709 13:08:32.933694 20951 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:08:32.927381 20937 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:32.971868 20887 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.015s	sys 0.008s
I20260709 13:08:32.935078 20898 raft_consensus.cc:697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:32.986229 20877 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:32.996647 20939 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.926457 20766 consensus_queue.cc:1059] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:08:33.000768 20938 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.993847 20877 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.975489 20803 consensus_queue.cc:237] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:32.979223 20920 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.006223 20920 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.006845 20909 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.008241 20920 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:32.972066 20925 raft_consensus.cc:697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:32.915428 20927 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:32.985512 20887 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.015s	sys 0.008s
I20260709 13:08:33.023037 20916 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:32.984375 20907 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:32.973950 20915 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:33.010304 20821 consensus_queue.cc:260] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.049273 20821 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.038375 20876 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.068589 20912 raft_consensus.cc:3055] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:33.111856 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 270976us
I20260709 13:08:33.115731 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.118064 15580 raft_consensus.cc:2368] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
W20260709 13:08:33.122733 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 353528us
W20260709 13:08:33.126430 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 259875us
I20260709 13:08:33.128888 15729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34148 (request call id 973) took 1590 ms. Trace:
I20260709 13:08:33.143473 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.149361 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.150044 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.151105 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.152267 15574 raft_consensus.cc:2410] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:33.153390 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.129534 15729 rpcz_store.cc:276] 0709 13:08:31.540534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.540696 (+   162us) service_pool.cc:224] Handling call
0709 13:08:31.541058 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.541397 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.541429 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.544147 (+  2718us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.493936 (+949789us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b18004943e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d92908e07 00007f2d9b763ab9 00007f2d9292569b 00007f2d9292393f 00007f2d92925c02 00007f2d955ad20b 00007f2d955b2d23 00007f2d955b30d1 00007f2d959cea0f
0709 13:08:32.591875 (+ 97939us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:33.019468 (+427593us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.019732 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.019816 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.019876 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:33.128159 (+108283us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.128596 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6108,"prepare.queue_time_us":76754,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2537,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":5718,"spinlock_wait_cycles":13907200,"thread_start_us":508436,"threads_started":2,"wal-append.queue_time_us":1215824}
I20260709 13:08:33.156015 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.157079 16276 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:33.158648 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.160933 15580 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.143556 16235 leader_election.cc:400] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
I20260709 13:08:33.162465 16235 leader_election.cc:403] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:33.168397 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.168841 20606 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.169756 15580 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:33.042215 20642 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:33.175064 20642 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.178892 20801 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
I20260709 13:08:33.060015 20898 consensus_queue.cc:237] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.194528 20876 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.068753 20907 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.069381 20912 raft_consensus.cc:740] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:33.199707 20913 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:33.201246 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73353.8us
I20260709 13:08:33.201637 20912 consensus_queue.cc:260] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.203282 20913 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.203970 20912 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.205305 15619 leader_election.cc:400] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:33.208470 15727 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:33.064420 20925 consensus_queue.cc:237] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.219414 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1025) took 1289 ms. Trace:
I20260709 13:08:33.205788 15619 leader_election.cc:403] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:33.229545 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:33.231609 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:33.225931 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.232705 20912 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:33.236562 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.237730 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.238893 20927 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.239809 20920 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.242926 15575 rpcz_store.cc:276] 0709 13:08:31.930050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.930247 (+   197us) service_pool.cc:224] Handling call
0709 13:08:31.953397 (+ 23150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.693491 (+740094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.218845 (+525354us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540033a254. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:33.219201 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664520960}
I20260709 13:08:33.256579 15654 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
W20260709 13:08:33.257418 20966 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:08:33.265094 20812 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.244441 20918 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:33.306496 20970 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.307446 20970 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.310134 20887 consensus_queue.cc:1059] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:33.314215 20821 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.314981 20821 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:33.315076 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 78873.7us
I20260709 13:08:33.315562 20821 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.317265 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.318427 15654 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 13:08:33.302961 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 98076.7us
I20260709 13:08:33.327570 20967 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.329526 20967 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.329922 20974 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.330175 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.341593 20969 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:33.342655 20967 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.330816 20974 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.344422 20967 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:33.344921 15578 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.345194 20974 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.345314 20967 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.346213 20667 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.346951 20969 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.331238 20927 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.349835 20967 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.351449 20927 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.354519 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.355050 20918 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.358124 15579 raft_consensus.cc:2393] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:33.325919 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:33.357431 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 219721us
I20260709 13:08:33.353845 20927 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.346256 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:33.371793 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 86986.2us
I20260709 13:08:33.349716 20928 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:33.373298 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.375749 20970 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.377429 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.378109 20887 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.378556 20887 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.378913 20887 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.381270 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.382107 16278 raft_consensus.cc:2393] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:33.383806 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.340879 20920 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:33.386855 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.387204 20812 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:33.388769 20920 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.392346 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:33.392946 15721 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.395216 20818 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.395859 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.397493 20818 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.398614 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.399510 16269 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:33.399693 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.401372 15652 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:33.403852 20928 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:33.404096 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 57978.8us
I20260709 13:08:33.404769 20928 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.405262 20928 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:33.404117 20789 raft_consensus.cc:3055] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.407887 20789 raft_consensus.cc:740] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:33.409063 20789 consensus_queue.cc:260] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.411155 20789 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.414901 20967 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.405711 20928 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.413389 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.422302 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.422626 20967 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:33.424592 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.424209 20967 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.425489 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:33.424201 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:33.427028 15720 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:33.427790 15544 leader_election.cc:400] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14.
W20260709 13:08:33.428756 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71091.8us
I20260709 13:08:33.431143 20969 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.431567 20912 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.431799 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:33.432049 20969 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.432369 20912 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.435586 20869 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:33.436030 20869 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:33.436491 20869 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:33.438086 20901 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.438795 20901 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.439492 20818 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.439946 20818 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.440343 20818 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.442402 20912 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:33.448089 20944 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.937s	user 0.004s	sys 0.000s
I20260709 13:08:33.455863 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:33.438798 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73014us
I20260709 13:08:33.462378 16236 leader_election.cc:400] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
I20260709 13:08:33.465119 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.465794 16269 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
W20260709 13:08:33.466971 20979 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:08:33.467408 16278 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:33.469343 20985 log.cc:927] Time spent T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:08:33.470817 16274 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:33.471473 20984 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:08:33.471215 20927 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.473047 20606 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.473783 20606 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.475835 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.476084 20606 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.477808 15578 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.481205 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.482228 15725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2775) took 1400 ms. Trace:
I20260709 13:08:33.482446 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.482740 20766 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.465380 15577 raft_consensus.cc:2393] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:33.486657 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.487586 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:33.469020 15727 raft_consensus.cc:1240] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:33.433771 15543 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:33.409375 20821 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.487936 15725 rpcz_store.cc:276] 0709 13:08:32.081415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.082147 (+   732us) service_pool.cc:224] Handling call
0709 13:08:32.084941 (+  2794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:32.085412 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:32.318874 (+233462us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.457228 (+138354us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:32.457780 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:08:32.457911 (+   131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:32.457941 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.458303 (+   362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.446917 (+988614us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:33.481691 (+ 34774us) raft_consensus.cc:1685] finished
0709 13:08:33.481811 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.482012 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25484,"prepare.queue_time_us":141250,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":25251,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":36812,"spinlock_wait_cycles":15335552,"thread_start_us":256898,"threads_started":2,"wal-append.queue_time_us":172713}
W20260709 13:08:33.497617 20978 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:08:33.506646 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.500043 15544 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:33.522457 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 88807.3us
I20260709 13:08:33.500734 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.525835 16274 raft_consensus.cc:2368] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 12. Current term is 13.
I20260709 13:08:33.490410 20766 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:33.535739 20887 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:33.539500 20980 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:08:33.544510 20606 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:33.545122 20606 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.545514 20606 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.547590 20928 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.550534 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.551291 20877 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.551970 20877 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.552409 20877 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.774528 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.556959 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.557132 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:33.557320 16277 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.558141 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.558714 16270 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:33.558884 16276 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:33.559738 20886 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.560039 15654 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:33.560130 20886 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.560633 20886 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.562285 20769 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:33.562990 20769 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.564036 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.565052 20962 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.565361 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.565963 16271 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:33.567178 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.567335 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.567883 16275 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.568017 15578 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.568879 15579 raft_consensus.cc:1240] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.569865 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.570156 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.572122 20622 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.572211 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.573093 15575 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:33.573931 20893 consensus_queue.cc:1059] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.574813 20893 raft_consensus.cc:3055] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:33.575124 20893 raft_consensus.cc:740] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:33.575198 20728 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.551357 20928 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:33.576550 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47287.1us
I20260709 13:08:33.587423 16271 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:33.588343 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.592166 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.533059 20901 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:33.565972 20769 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.615852 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:33.618709 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 130529us
I20260709 13:08:33.619526 15721 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:33.620958 20911 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.621168 20969 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.613952 15543 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:33.625622 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.626004 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:33.593128 20818 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.634235 16270 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:33.635560 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.624127 20887 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.626965 20970 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:33.644220 20947 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.935s	user 0.002s	sys 0.005s
I20260709 13:08:33.644989 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.647557 20928 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.648082 15727 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.648923 15729 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.660247 15721 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:33.661556 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.667441 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.669014 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.669873 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.670580 20849 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:33.656021 15725 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.659518 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:33.653752 15619 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.131:34333 timed out after 2.161s (SENT) [suppressed 19 similar messages]
W20260709 13:08:33.677462 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58093.4us
I20260709 13:08:33.615196 20893 consensus_queue.cc:260] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.643241 20967 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:33.696300 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 112262us
I20260709 13:08:33.698689 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.698319 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.674748 20766 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.715166 20766 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.716847 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:33.719980 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67488.1us
I20260709 13:08:33.725906 16278 raft_consensus.cc:2410] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:33.726066 20911 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:33.726733 20911 consensus_queue.cc:1243] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:33.729435 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.730373 15573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 1032) took 1113 ms. Trace:
I20260709 13:08:33.730734 15573 rpcz_store.cc:276] 0709 13:08:32.616559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.618432 (+  1873us) service_pool.cc:224] Handling call
0709 13:08:33.729176 (+1110744us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800002798. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:08:33.730288 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7137536}
I20260709 13:08:33.725028 20967 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:33.725190 20893 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:33.734490 20994 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:33.740841 16275 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:33.739138 15543 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:33.743022 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63503.9us
I20260709 13:08:33.743811 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.745409 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.746660 19951 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.747067 19951 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.747373 19951 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.752642 20885 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.754731 20818 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.754958 15725 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:33.755254 20864 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.756196 15655 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:33.758919 20927 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:33.761408 20992 log.cc:927] Time spent T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.456s	user 0.002s	sys 0.000s
I20260709 13:08:33.718796 20821 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:33.769411 20977 log.cc:927] Time spent T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.502s	user 0.000s	sys 0.002s
I20260709 13:08:33.772972 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.773934 15574 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:33.784094 15578 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
W20260709 13:08:33.792284 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44757.9us
I20260709 13:08:33.793437 15543 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.797394 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.802569 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:33.804086 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 60379.4us
I20260709 13:08:33.799538 20769 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.809537 20911 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.818796 15619 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:33.815642 20907 consensus_queue.cc:1059] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:08:33.815919 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:33.821593 15573 raft_consensus.cc:2393] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:33.819628 15572 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:33.825729 16275 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 9: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:33.818675 20911 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.826766 20911 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:33.832024 20975 log.cc:927] Time spent T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.566s	user 0.002s	sys 0.001s
I20260709 13:08:33.782059 20606 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.834473 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.837067 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.832881 20969 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:08:33.841526 15723 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:33.842572 15618 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:33.846163 20410 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:08:33.846493 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.846925 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.847621 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:33.848472 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.849066 16273 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.849669 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.850351 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.850919 16276 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:33.852046 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.853088 16276 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:33.853646 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.851631 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.863256 16274 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.866914 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.867762 16276 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.870956 16273 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:33.856166 20606 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.859185 20938 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:33.874301 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.821499 20869 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.874917 16273 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
I20260709 13:08:33.874496 20938 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.875976 16273 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:33.876288 16273 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:33.876675 20869 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.859367 15726 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:33.859831 20910 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:33.878464 20910 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.880976 20910 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:33.861025 19951 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.883507 19951 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:33.847681 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.883550 20877 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.884649 20938 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:33.884445 16275 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:33.824482 20886 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.886345 16273 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:33.887264 16275 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:33.888033 20886 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:33.888831 16273 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.888854 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:33.889734 20558 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:33.894696 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:33.895603 20910 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.896167 20910 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:33.897158 20910 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:33.899266 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.900676 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.906687 15692 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:33.906051 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.919287 16277 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:33.924914 16274 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:33.926446 16274 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:33.928097 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 109377us
I20260709 13:08:33.928330 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:33.929075 16275 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:33.930719 16273 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:33.931061 16273 pending_rounds.cc:85] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 8
I20260709 13:08:33.939699 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:33.941677 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.940368 16271 raft_consensus.cc:2376] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13. Re-sending same reply.
W20260709 13:08:33.948936 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106452us
I20260709 13:08:33.931258 16273 pending_rounds.cc:107] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:33.951128 16273 raft_consensus.cc:2889] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:33.953648 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.954375 15646 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.923216 20907 consensus_queue.cc:1243] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:33.948678 16269 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:33.944600 20769 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:33.970309 20410 consensus_queue.cc:1243] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 681370bcf39d46b189ec8e9a5957f93d log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:33.972635 20895 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.929992 20911 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:33.992573 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 51799us
I20260709 13:08:33.993873 15654 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:33.979477 20895 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:33.979080 20837 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.994892 16235 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:34.003785 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 105796us
I20260709 13:08:34.002889 16276 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:34.004529 15618 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:34.005717 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:33.983228 20877 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:34.015594 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.018765 19951 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.023289 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:34.024061 16238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.024423 15544 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:34.003784 20895 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.996912 20769 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.031142 15652 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:34.009009 20938 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.041180 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:34.041806 15573 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.040911 15647 pending_rounds.cc:85] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 9
I20260709 13:08:34.044132 15647 pending_rounds.cc:107] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:08:34.045053 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:34.037587 21001 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:08:34.047888 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.046120 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:34.050613 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.036855 20837 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.044474 15647 raft_consensus.cc:2889] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.038147 20900 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.049412 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:34.053078 15575 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.036427 20938 raft_consensus.cc:493] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.055409 15652 raft_consensus.cc:2368] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
W20260709 13:08:34.069082 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.112846 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 85690.6us
I20260709 13:08:34.115731 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.118126 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:34.120584 20902 raft_consensus.cc:3055] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.138141 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:34.122386 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 113750us
I20260709 13:08:34.063504 20909 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:34.139941 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:34.141667 16276 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.069047 20938 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.137331 20902 raft_consensus.cc:740] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.147286 20911 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:34.154150 16276 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:34.157524 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.158319 20864 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.159034 20970 consensus_meta.cc:287] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.002s
I20260709 13:08:34.154663 16275 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:34.154363 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:34.166653 15573 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:34.167994 16277 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 8.
I20260709 13:08:34.158902 20864 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.170933 16271 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.175491 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:34.137375 20951 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:08:34.178135 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 61217.6us
I20260709 13:08:34.207461 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:34.172556 21005 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:08:34.171847 21008 log.cc:927] Time spent T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:08:34.181025 20970 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.228376 20864 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:34.229089 20864 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.230239 21004 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:34.230755 21004 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.232986 21004 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:34.242348 20769 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.246721 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.247357 15725 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.229796 20864 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.254153 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.260170 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.262655 20938 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.265110 20938 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:34.171129 21011 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.210s
I20260709 13:08:34.268115 20911 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.268561 20911 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.268465 21018 consensus_queue.cc:1059] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:34.270331 15652 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:34.269621 20911 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.271718 20911 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.272789 20904 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.275274 21016 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.276139 20970 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:34.277052 20410 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:34.277390 20410 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.278288 20410 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:34.279181 20982 log.cc:927] Time spent T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.941s	user 0.003s	sys 0.000s
I20260709 13:08:34.282197 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.171304 20945 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.300326 15618 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:34.306788 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 278235us
I20260709 13:08:34.330513 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:34.336519 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:34.168814 20869 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 13:08:34.118485 20961 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.301s
I20260709 13:08:34.347976 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:34.328986 21018 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.339418 21011 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:34.368077 16278 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.335037 20945 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:34.371905 15722 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:08:34.370473 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 195081us
I20260709 13:08:34.342522 21004 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.380288 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.397601 15725 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:34.391322 20864 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.426822 15573 raft_consensus.cc:1275] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:34.449564 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1726) took 1156 ms. Trace:
I20260709 13:08:34.450278 16272 rpcz_store.cc:276] 0709 13:08:33.141674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.150173 (+  8499us) service_pool.cc:224] Handling call
0709 13:08:33.150661 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:33.151447 (+   786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.151485 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:33.152309 (+   824us) log.cc:844] Serialized 26 byte log entry
0709 13:08:33.337773 (+185464us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:33.337817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.337879 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.278517 (+940638us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:34.280976 (+  2459us) raft_consensus.cc:1685] finished
0709 13:08:34.280996 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.297603 (+ 16607us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26997,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"spinlock_wait_cycles":25627008,"thread_start_us":184915,"threads_started":1,"wal-append.queue_time_us":185349}
I20260709 13:08:34.453950 15576 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:08:34.455289 21016 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:34.456079 21016 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.462543 20945 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.391556 21004 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.467267 15572 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:34.468578 21004 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:34.428889 20864 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.475673 20864 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.484292 16278 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:34.465380 20606 consensus_queue.cc:1059] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:34.498384 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:34.519758 15576 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:34.522017 21016 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:34.525101 15726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44462 (request call id 2507) took 1962 ms (client timeout 2161 ms). Trace:
W20260709 13:08:34.493309 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 267625us
W20260709 13:08:34.511945 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.461737 20895 raft_consensus.cc:515] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.504606 20939 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:34.525628 15726 rpcz_store.cc:269] 0709 13:08:32.562360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.562545 (+   185us) service_pool.cc:224] Handling call
0709 13:08:34.524871 (+1962326us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540011a8d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:34.525005 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876757760}
W20260709 13:08:34.538484 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 163903us
I20260709 13:08:34.519373 20909 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.539251 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.539870 20909 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:34.540515 15692 leader_election.cc:336] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.724s (SENT)
I20260709 13:08:34.540961 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.541813 21016 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.542387 20962 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:34.542975 20962 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:34.543551 15692 leader_election.cc:336] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.169s (SENT)
I20260709 13:08:34.543995 15692 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.544755 21016 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.549088 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.550175 15726 raft_consensus.cc:2368] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:34.550097 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.552107 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.552337 15726 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.553409 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.554282 15725 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:34.554430 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.555593 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.556103 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.556694 15726 raft_consensus.cc:2393] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:34.549028 16276 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.558466 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.558988 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.559974 15725 raft_consensus.cc:2368] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
W20260709 13:08:34.560619 21009 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.496s	user 0.003s	sys 0.006s
I20260709 13:08:34.561565 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.562449 15725 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:34.563787 20864 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.564177 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.566044 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.566563 15725 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.569804 15572 raft_consensus.cc:3055] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.570255 15572 raft_consensus.cc:740] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.571183 15572 consensus_queue.cc:260] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.572111 15572 raft_consensus.cc:3060] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.577310 15726 raft_consensus.cc:1240] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:34.577598 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.578349 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.578737 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:34.579051 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.580960 15725 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:34.586100 20728 raft_consensus.cc:2764] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:34.554437 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:34.591396 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 52214.6us
I20260709 13:08:34.604211 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.604250 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:34.591535 21012 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.361s	user 0.004s	sys 0.000s
I20260709 13:08:34.597605 20796 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:34.633400 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.607227 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.592602 21031 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.636680 15646 raft_consensus.cc:1275] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:34.601574 21004 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.639880 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 106411us
W20260709 13:08:34.640136 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.642282 16236 leader_election.cc:400] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:34.642582 16236 leader_election.cc:403] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.594162 21030 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.637421 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.605293 20939 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.649047 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.650224 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.647198 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.598052 20728 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:34.662616 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.663729 20617 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
W20260709 13:08:34.663790 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.665654 20410 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.670212 21036 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:34.670831 21036 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.671357 20902 consensus_queue.cc:260] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.672931 20902 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.673135 21036 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:34.676949 20558 raft_consensus.cc:3055] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.677561 20558 raft_consensus.cc:740] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.678324 21027 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:34.678903 21027 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.681190 21027 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:34.678735 20558 consensus_queue.cc:260] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.683337 20558 raft_consensus.cc:3060] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.651145 15724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51660
I20260709 13:08:34.644114 20927 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.685101 15724 raft_consensus.cc:606] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.685417 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.631732 20837 consensus_queue.cc:1048] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:08:34.692186 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.694772 15575 raft_consensus.cc:1240] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.687649 20927 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:34.696636 20927 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.698845 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.544010 20962 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.699507 15647 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:34.709218 15576 raft_consensus.cc:1240] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:34.712779 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 110949us
I20260709 13:08:34.653551 21004 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.716190 15543 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:34.717832 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.709482 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.721495 20895 leader_election.cc:290] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:34.722947 20667 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:34.723488 20667 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.724459 20667 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.725783 15651 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:34.726225 20962 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.728705 15650 raft_consensus.cc:2368] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
W20260709 13:08:34.729899 21012 log.cc:927] Time spent T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:08:34.711086 20939 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.732127 15724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:51660
I20260709 13:08:34.733516 15724 raft_consensus.cc:606] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:34.733919 15724 raft_consensus.cc:614] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:34.658540 21031 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.736038 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.738541 15650 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.739675 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.740878 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:34.741150 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.741525 15576 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.743036 16271 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.743927 16275 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:34.744771 15575 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.733327 21040 consensus_queue.cc:1059] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:08:34.751586 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.752678 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:34.755028 21020 log.cc:927] Time spent T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
I20260709 13:08:34.755230 21018 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.755662 20766 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:34.756749 20766 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.757108 20766 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.758009 20766 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.759593 20766 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.719916 20877 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:08:34.764801 20961 consensus_queue.cc:1059] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.769157 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.770335 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.771368 21004 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:34.770501 15722 raft_consensus.cc:1240] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.772779 16236 leader_election.cc:400] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12.
I20260709 13:08:34.719127 20900 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:34.793998 15576 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:34.795756 16235 leader_election.cc:304] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:34.805051 16271 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:08:34.806102 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:34.806727 16272 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:34.810241 20869 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.810669 20869 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:34.811532 20869 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.811894 21031 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:34.812644 20869 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.819872 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:34.830428 15650 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:34.832805 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:34.833726 15724 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.808027 20938 raft_consensus.cc:2804] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.869081 20938 raft_consensus.cc:697] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:34.869994 20938 consensus_queue.cc:237] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:34.810674 20900 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:34.874742 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44275.7us
I20260709 13:08:34.841354 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:34.876336 15575 raft_consensus.cc:606] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:34.876789 15575 raft_consensus.cc:614] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:34.884776 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 112120us
I20260709 13:08:34.885788 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:34.894431 15720 raft_consensus.cc:1240] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:08:34.905206 20622 consensus_queue.cc:1048] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:34.905710 20728 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:34.907042 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:34.807355 20617 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 13:08:34.935953 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.940662 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 54984.8us
W20260709 13:08:34.942492 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.943828 15572 raft_consensus.cc:1275] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:34.944469 15572 pending_rounds.cc:85] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 7
I20260709 13:08:34.944773 15572 pending_rounds.cc:107] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:34.945065 15572 raft_consensus.cc:2889] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.956547 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.957599 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:34.922994 20886 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.922260 21018 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.987540 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:34.992628 15575 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:34.947657 20904 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.948837 15724 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:35.007174 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:35.016191 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.022609 15653 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
W20260709 13:08:35.040040 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 82531us
I20260709 13:08:34.962780 21031 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.000716 20945 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:35.053645 15574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:35.054673 15574 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:35.054999 15574 raft_consensus.cc:614] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:35.057289 15652 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:35.060680 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.061358 15721 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
W20260709 13:08:35.051515 21017 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:08:35.092667 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:35.092657 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:35.101680 15652 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:35.117780 21043 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:35.118645 21043 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:34.999683 21018 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:35.130975 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:35.136060 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 83079.3us
I20260709 13:08:35.138741 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:35.039474 20904 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:35.148566 20886 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:35.149567 15652 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:35.152082 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:35.159583 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.149317 21043 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:35.149660 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.151897 21018 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:35.152658 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.154762 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.086566 21031 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.163872 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.168829 20886 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:35.212646 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 128948us
I20260709 13:08:35.213089 20796 consensus_queue.cc:1048] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:35.216607 15543 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:35.217672 20938 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.218393 20938 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.219926 20967 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.220316 20967 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:35.220649 20967 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.220914 20938 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:35.222718 16270 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:35.223994 15572 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:35.230962 20911 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:35.232362 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.212630 20728 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:35.204025 20915 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.237064 20915 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.237846 20967 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.289111 20967 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:35.241652 15648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2726) took 1341 ms. Trace:
I20260709 13:08:35.289288 20915 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:35.289819 15648 rpcz_store.cc:276] 0709 13:08:33.900425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.921819 (+ 21394us) service_pool.cc:224] Handling call
0709 13:08:33.951724 (+ 29905us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.010217 (+ 58493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.010263 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.235446 (+225183us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b18003455e0. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d929263f3 00007f2d929287c1 00007f2d92928779 00007f2d92928709 00007f2d929286d1 00007f2d929279cd 000000000038f354 000000000038f199 00007f2d9290983a
0709 13:08:34.745086 (+509640us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b2c00074958. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:34.745522 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.044988 (+299466us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:35.045032 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.045095 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.241347 (+196252us) raft_consensus.cc:1685] finished
0709 13:08:35.241376 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.241560 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18614,"raft.queue_time_us":35207,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":35061888,"thread_start_us":299086,"threads_started":1,"wal-append.queue_time_us":420204}
I20260709 13:08:35.237749 15725 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:35.295151 15648 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:35.300274 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:35.300719 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.301106 16273 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:35.301527 15647 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:35.302214 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:35.303014 16274 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:35.304656 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.306599 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.307623 15651 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:35.317910 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.257984 20969 raft_consensus.cc:3055] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:35.257886 15472 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 6 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:35.262475 21026 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.667s	user 0.004s	sys 0.000s
I20260709 13:08:35.320569 20969 raft_consensus.cc:740] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:35.321553 20969 consensus_queue.cc:260] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.321491 15472 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 5 to 2, term changed from 6 to 5, leader changed from <none> to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 5 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:35.323248 20969 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.323561 20728 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:35.324107 20728 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.324633 15472 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 3 to 7, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:35.262368 15473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 349) took 50536 ms (client timeout 15000 ms). Trace:
W20260709 13:08:35.269496 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.274569 20893 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.339392 16274 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:35.281826 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:35.283177 21028 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.747s	user 0.002s	sys 0.002s
I20260709 13:08:35.283808 21031 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:35.284721 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:35.345578 15572 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:35.285148 20904 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:35.353749 20769 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:35.354717 20796 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:35.355010 15543 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:35.355273 20796 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.357208 20967 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.357607 20796 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:35.322782 20886 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:35.326450 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.279825 20902 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.003s
I20260709 13:08:35.281383 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.340178 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:35.341311 15577 raft_consensus.cc:2368] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:35.341307 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.389348 16277 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:35.346239 20893 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.351326 20945 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:35.351897 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:35.397336 16273 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:35.397521 15722 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:35.357633 20967 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:35.287175 20927 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:08:35.402110 20945 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.402410 20927 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:35.403626 15720 raft_consensus.cc:2410] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:35.404289 20945 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:35.360163 15725 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:35.359882 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:35.348460 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:35.368005 15647 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.364087 15543 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:35.362926 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:35.392478 15618 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:35.398005 15649 raft_consensus.cc:2410] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:08:35.384819 20410 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.004s
I20260709 13:08:35.400648 15573 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:35.404356 20927 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:35.405992 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 46191.4us
I20260709 13:08:35.385955 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:35.406003 15572 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:35.409423 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:35.427150 15655 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:35.458727 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:35.466056 15577 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:35.405292 20967 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.418213 20849 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:35.456840 20909 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:35.491544 16272 raft_consensus.cc:1275] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:35.494750 15543 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.457010 20877 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:35.493338 21023 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.487360 20909 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:35.488078 20849 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:35.511128 20939 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:35.326179 15473 rpcz_store.cc:269] 0709 13:07:44.726099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.726377 (+   278us) service_pool.cc:224] Handling call
0709 13:08:35.262132 (+50535755us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.439012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.442420 (+  3408us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.442469 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:08:25.442496 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:25.443135 (+   639us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.443238 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.443266 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:25.443660 (+   394us) tablet.cc:701] Row locks acquired
0709 13:08:25.443708 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:08:25.443869 (+   161us) write_op.cc:270] Start()
0709 13:08:25.444019 (+   150us) write_op.cc:276] Timestamp: P: 1783602505443809 usec, L: 0
0709 13:08:25.444041 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.449540 (+  5499us) log.cc:844] Serialized 1307 byte log entry
0709 13:08:26.146118 (+696578us) op_driver.cc:464] REPLICATION: finished
0709 13:08:26.779317 (+633199us) write_op.cc:301] APPLY: starting
0709 13:08:26.779416 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:26.781463 (+  2047us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:26.781594 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:26.944127 (+162533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:26.944345 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:08:26.944396 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:26.944667 (+   271us) log.cc:844] Serialized 41 byte log entry
0709 13:08:27.030344 (+ 85677us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.042872 (+ 12528us) write_op.cc:454] Released schema lock
0709 13:08:27.053665 (+ 10793us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:27.109794 (+ 56129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.111280 (+  1486us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1242,"reported_tablets":46,"spinlock_wait_cycles":8576,"child_traces":[["op",{"apply.queue_time_us":632886,"apply.run_cpu_time_us":13828,"apply.run_wall_time_us":302944,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":150922,"prepare.run_cpu_time_us":13172,"prepare.run_wall_time_us":88149,"raft.queue_time_us":495566,"raft.run_cpu_time_us":46489,"raft.run_wall_time_us":482032,"replication_time_us":644668,"thread_start_us":793452,"threads_started":5,"wal-append.queue_time_us":238010,"wal-append.run_cpu_time_us":26004,"wal-append.run_wall_time_us":2390951}]]}
I20260709 13:08:35.484289 20667 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:35.513666 21023 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.519730 20909 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.508283 20558 consensus_queue.cc:1048] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:35.524926 20939 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:35.540784 21023 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.418408 20606 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:35.562215 20900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.006s	sys 0.041s
W20260709 13:08:35.619159 16235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.569900 20902 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.584089 20900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.006s	sys 0.041s
I20260709 13:08:35.578541 20606 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:35.568058 20849 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:35.633111 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 481156us
I20260709 13:08:35.741362 16236 leader_election.cc:400] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
W20260709 13:08:35.687908 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.739861 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 320724us
W20260709 13:08:35.668560 21051 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:08:35.761473 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 303366us
W20260709 13:08:35.674575 21056 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:08:35.629652 21011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.023s	sys 0.019s
W20260709 13:08:35.625586 21053 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:08:35.691203 21036 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.020282 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.051024 15720 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:35.719121 20893 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:35.867777 21063 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.040242 15648 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:36.019608 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:36.049376 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:36.091984 21063 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.093124 15647 raft_consensus.cc:2393] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:36.043752 21011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.656s	user 0.023s	sys 0.031s
I20260709 13:08:35.653527 20902 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.103524 21031 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.106552 21055 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:08:36.106755 20606 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:36.108291 21066 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:36.109308 20967 consensus_meta.cc:287] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.000s
I20260709 13:08:36.045650 21025 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.098320 20939 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.114338 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2089) took 1205 ms. Trace:
I20260709 13:08:36.099395 21011 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:36.076445 20837 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:36.116036 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 373921us
I20260709 13:08:36.095173 20886 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.155277 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:36.098291 21036 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:36.106616 21057 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.337s	user 0.000s	sys 0.000s
W20260709 13:08:36.109735 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 53415.8us
I20260709 13:08:36.169054 21036 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.155714 20886 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.171173 20886 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:36.171775 20886 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:36.134474 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 368003us
I20260709 13:08:36.160930 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:36.158012 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:36.175822 20886 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:36.178352 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:36.180225 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:36.179085 21036 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.182430 21036 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.184881 21036 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.186206 21036 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.186988 21036 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.187690 21036 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.185485 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:36.191056 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:36.192785 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:36.193856 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.194681 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:36.195025 21036 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.195453 21036 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.195808 21036 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.149652 15578 rpcz_store.cc:276] 0709 13:08:34.908720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.909125 (+   405us) service_pool.cc:224] Handling call
0709 13:08:34.909463 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:34.909828 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.909859 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:34.910422 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:08:35.161369 (+250947us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:35.161410 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.161474 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.114104 (+952630us) raft_consensus.cc:1685] finished
0709 13:08:36.114135 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.114278 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4797,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":250499,"threads_started":1,"wal-append.queue_time_us":473007}
I20260709 13:08:36.118989 20893 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:36.205770 20939 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.153887 20967 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.226792 21004 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.225517 20893 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.244813 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2088) took 1336 ms. Trace:
I20260709 13:08:36.145790 21031 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.243827 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.247748 15576 rpcz_store.cc:276] 0709 13:08:34.908351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.918805 (+ 10454us) service_pool.cc:224] Handling call
0709 13:08:34.919127 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.919533 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.919566 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.920084 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.406680 (+486596us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:35.739606 (+332926us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.762843 (+ 23237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.762939 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.244547 (+481608us) raft_consensus.cc:1685] finished
0709 13:08:36.244578 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.244751 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32213,"prepare.queue_time_us":759496,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":25572,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":16527,"thread_start_us":761427,"threads_started":2,"wal-append.queue_time_us":740357}
I20260709 13:08:36.251329 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:36.255313 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.256026 15725 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 9.
I20260709 13:08:36.256587 15580 raft_consensus.cc:2393] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:36.240321 20622 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.223325 20837 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.268090 15574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35226 (request call id 1062) took 1177 ms. Trace:
I20260709 13:08:36.275091 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.223562 21025 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.249512 20893 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.258152 20939 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.275050 21011 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:36.286460 21064 log.cc:927] Time spent T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:08:36.323514 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.324954 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1761) took 1032 ms. Trace:
I20260709 13:08:36.325359 16276 rpcz_store.cc:276] 0709 13:08:35.292628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.308379 (+ 15751us) service_pool.cc:224] Handling call
0709 13:08:35.308800 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.309226 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.309267 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.309803 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.625332 (+315529us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:35.625382 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.625683 (+   301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.324739 (+699056us) raft_consensus.cc:1685] finished
0709 13:08:36.324761 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.324896 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13410,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":315165,"threads_started":1,"wal-append.queue_time_us":712332}
I20260709 13:08:36.329102 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.329775 16276 raft_consensus.cc:2376] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13. Re-sending same reply.
I20260709 13:08:36.331768 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.333770 20939 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.334431 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.334837 21063 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.337849 21044 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.263132 20911 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.293418 15646 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:36.246587 21080 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:36.299211 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.300148 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.343178 15654 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:08:36.301883 21070 log.cc:927] Time spent T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:36.302240 15650 raft_consensus.cc:1275] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:36.303414 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:36.304097 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57649fad66734a1786f0f9c09f4fa317" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:36.345359 15651 raft_consensus.cc:3060] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.304965 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.263726 21075 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.306054 21074 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.306947 20902 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.309448 21031 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.310730 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2094) took 1092 ms. Trace:
W20260709 13:08:36.312148 20969 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.004s
I20260709 13:08:36.316988 21058 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.317723 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.318990 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.319973 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.356945 16272 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.321295 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.358282 16277 raft_consensus.cc:2368] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 9. Current term is 10.
I20260709 13:08:36.322320 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.356659 16273 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:36.275825 15574 rpcz_store.cc:276] 0709 13:08:35.090950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.091075 (+   125us) service_pool.cc:224] Handling call
0709 13:08:35.095706 (+  4631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.101389 (+  5683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.101418 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.315566 (+214148us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b2c000014c8. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9430ca11 00007f2d9431c372 00007f2d95a4ea01 00007f2d95a1343a 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2
0709 13:08:35.316065 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.586136 (+270071us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:35.586167 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.586230 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.259573 (+673343us) raft_consensus.cc:1685] finished
0709 13:08:36.259599 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.268007 (+  8408us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16181,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":76772736,"thread_start_us":269664,"threads_started":1,"wal-append.queue_time_us":435375}
I20260709 13:08:36.339833 16276 raft_consensus.cc:2376] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13. Re-sending same reply.
W20260709 13:08:36.342495 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 90472.7us
I20260709 13:08:36.348847 15652 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
W20260709 13:08:36.285948 21023 consensus_meta.cc:287] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.000s
I20260709 13:08:36.350476 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.353258 15571 rpcz_store.cc:276] 0709 13:08:35.218306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.218440 (+   134us) service_pool.cc:224] Handling call
0709 13:08:35.218692 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.218988 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.219013 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.219428 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.584376 (+364948us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:35.584434 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.584523 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.310522 (+725999us) raft_consensus.cc:1685] finished
0709 13:08:36.310544 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.310671 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5904,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":364595,"threads_started":1,"wal-append.queue_time_us":1087984}
I20260709 13:08:36.277668 20622 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.373728 16275 raft_consensus.cc:2376] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13. Re-sending same reply.
I20260709 13:08:36.373005 15653 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:36.379339 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.380970 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:36.381558 15576 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:36.383508 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.348632 20907 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:36.338546 21044 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.384830 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.391812 15725 raft_consensus.cc:2393] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:36.393018 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.393671 15723 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:36.353041 21082 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.398414 15721 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:36.396121 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.396699 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.404111 15724 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:36.403184 15722 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:36.474114 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:36.475073 15574 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
I20260709 13:08:36.369614 20900 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.477273 15720 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:36.489327 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.388182 20911 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.480489 16278 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:08:36.387900 21031 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.356595 21036 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:36.499697 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 326916us
I20260709 13:08:36.493742 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.352648 21075 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.352274 21074 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.379042 21023 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.493064 20769 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.513679 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.527256 16276 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:36.528066 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.528614 16276 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:36.530064 20967 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.530339 15575 raft_consensus.cc:1240] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:36.531195 20769 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.531673 21036 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.397006 21078 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
W20260709 13:08:36.536564 15692 leader_election.cc:336] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.545s (SENT)
I20260709 13:08:36.537117 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:36.515483 20622 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:36.520596 15577 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:36.380640 21058 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.521116 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.543507 16273 raft_consensus.cc:2393] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:36.543926 21058 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.544344 16274 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:36.545457 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:36.545390 21090 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:36.546212 15576 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:36.548035 21074 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.548847 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:36.489248 21087 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:08:36.551009 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.551558 16273 raft_consensus.cc:2376] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13. Re-sending same reply.
I20260709 13:08:36.479490 21082 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.552357 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.552922 16274 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:08:36.552397 20909 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 1.000s	user 0.011s	sys 0.000s
I20260709 13:08:36.553906 20909 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.522732 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:36.522775 16270 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:36.555954 15655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2728) took 1645 ms (client timeout 1919 ms). Trace:
I20260709 13:08:36.556625 20909 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.558297 20837 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.479281 21081 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:36.501071 21031 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.521534 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.569903 16277 raft_consensus.cc:2410] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:36.532745 15575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41382 (request call id 2092) took 1527 ms. Trace:
I20260709 13:08:36.397745 20907 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.519038 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:36.556397 15655 rpcz_store.cc:269] 0709 13:08:34.911029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.935642 (+ 24613us) service_pool.cc:224] Handling call
0709 13:08:36.555726 (+1620084us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400155c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:36.555881 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064493440}
I20260709 13:08:36.538806 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.539337 16272 raft_consensus.cc:2410] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:08:36.505335 21086 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.554265 21082 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.570749 15575 rpcz_store.cc:276] 0709 13:08:35.005440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.005607 (+   167us) service_pool.cc:224] Handling call
0709 13:08:35.005921 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.530752 (+1524831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.532535 (+  1783us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400293954. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:36.532689 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3505404160}
I20260709 13:08:36.525784 15651 raft_consensus.cc:2468] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:36.495301 20900 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.577605 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.580456 16276 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:36.581498 15647 raft_consensus.cc:2368] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:36.581634 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:36.580972 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 322287us
I20260709 13:08:36.582973 15578 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:36.585680 15650 raft_consensus.cc:1275] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:36.587308 20796 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.556151 21023 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.599144 16271 raft_consensus.cc:2368] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11.
I20260709 13:08:36.597012 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:36.606293 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 55799.3us
I20260709 13:08:36.607203 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:36.608013 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 89414.6us
I20260709 13:08:36.608790 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.538430 20971 raft_consensus.cc:493] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.592175 21086 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.537592 20902 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:08:36.588796 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 205690us
I20260709 13:08:36.499797 20911 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.609418 15724 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:36.630153 16235 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:36.612351 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.634065 15721 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:36.614271 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:36.635191 15728 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:36.614718 15580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35226 (request call id 1065) took 1286 ms (client timeout 1611 ms). Trace:
I20260709 13:08:36.618461 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:36.636737 15646 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.628021 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:36.636960 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 100433us
I20260709 13:08:36.611485 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.597254 21091 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:36.639319 15692 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.557s (SENT)
I20260709 13:08:36.637925 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:36.635797 15580 rpcz_store.cc:269] 0709 13:08:35.328540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.329465 (+   925us) service_pool.cc:224] Handling call
0709 13:08:36.614538 (+1285073us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54000d4dd4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:36.614664 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956529536}
I20260709 13:08:36.652374 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:36.652689 15654 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:36.653277 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:36.654011 15729 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:36.615425 21063 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.658856 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:36.653380 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:36.661824 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:36.612133 21023 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.664857 15578 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
W20260709 13:08:36.664891 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43699.9us
I20260709 13:08:36.641233 20902 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:36.667654 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 60560us
I20260709 13:08:36.637040 20558 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.679639 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.687323 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.687501 21108 consensus_queue.cc:1048] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:36.688547 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.669667 21078 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.689203 21078 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.689657 21078 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.689842 20837 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.690531 20769 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.684651 21080 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:36.663800 21063 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.689359 15655 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:36.694816 15646 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:36.662478 21100 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:36.699836 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.709071 15646 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:36.710867 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:36.706240 15574 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:36.632158 20971 raft_consensus.cc:515] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.715281 15655 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:36.659462 21091 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.669464 21025 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:36.786059 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 77873.7us
I20260709 13:08:36.696322 21063 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.696393 21098 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.698199 20769 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:36.684964 21044 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:36.878587 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 52865.6us
I20260709 13:08:36.803557 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:36.879549 16277 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.802635 20893 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.815088 20971 leader_election.cc:290] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:36.816903 21097 log.cc:927] Time spent T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:08:36.682696 21023 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.870745 15726 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:36.685145 20558 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.891242 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:36.945192 16275 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:36.696691 21004 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 13:08:36.787237 20970 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:36.954120 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 275561us
W20260709 13:08:36.940930 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 301631us
W20260709 13:08:36.953511 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 267202us
W20260709 13:08:36.962198 15692 leader_election.cc:336] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.588s (SENT)
I20260709 13:08:36.962283 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:36.691316 21080 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.872089 21025 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:36.820616 21095 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.877300 21031 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:36.976703 15618 leader_election.cc:400] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:36.977205 15618 leader_election.cc:403] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.974061 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:36.977124 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 301485us
I20260709 13:08:36.963344 21112 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.784139 21100 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.884354 20769 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.993299 16277 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:36.985498 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:36.972296 21018 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.969588 21075 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.972123 21044 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:36.877790 21098 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:36.984354 21074 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:36.987336 21119 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.976049 21025 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:36.992554 20907 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:36.999053 20849 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:37.026661 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64496.3us
I20260709 13:08:36.968765 20970 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.002689 20766 raft_consensus.cc:2764] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:37.013814 21068 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:37.052255 15728 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
W20260709 13:08:37.054240 15692 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.615s (SENT)
W20260709 13:08:37.019616 21106 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:08:36.987748 21089 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:37.019567 20893 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.020081 21120 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:37.015451 21086 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:37.020195 21024 raft_consensus.cc:2749] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13.
I20260709 13:08:37.021656 21023 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.100039 21080 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.101094 21100 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.106781 21091 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.103204 21063 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.052567 21119 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.113201 21119 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.027714 21074 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.115492 21063 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.115944 21074 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.116135 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.116822 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.118412 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.119138 15579 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.013029 21099 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:08:37.062891 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 119614us
I20260709 13:08:37.055644 20849 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.122820 20849 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.124617 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.127377 21024 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.127895 21024 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.003077 21112 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.130580 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.131044 21118 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.131243 20969 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.131672 21118 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.051330 21114 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.132833 21114 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.133339 20728 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.020284 20862 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
W20260709 13:08:37.077252 21107 log.cc:927] Time spent T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:37.134999 21114 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.080504 21120 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.137311 21120 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.082571 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.138172 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.138521 15647 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:37.139213 21112 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:37.139272 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8995ef9978c446769377fc0e9a0cb9c1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:37.078071 21098 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.087162 20769 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.088709 20558 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.085726 20766 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:37.141126 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.141360 20766 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.142921 20911 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.143683 20766 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.088929 20915 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.144469 20915 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.062855 20902 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.090530 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:37.146085 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.146389 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.146739 15654 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:37.146950 15649 raft_consensus.cc:2393] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:37.091306 21025 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.069695 21068 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.147336 21024 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.147431 15649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51890 (request call id 2264) took 1207 ms. Trace:
I20260709 13:08:37.147939 15649 rpcz_store.cc:276] 0709 13:08:35.939983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.940108 (+   125us) service_pool.cc:224] Handling call
0709 13:08:37.145894 (+1205786us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800211e98. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa2b0ab 00007f2d9aa2b131 00007f2d9a9d90a0 00007f2d9a9d8984 00007f2d93f536d4 00007f2d93f53662
0709 13:08:37.147374 (+  1480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10102016}
I20260709 13:08:37.148445 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.149096 21068 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.016601 21044 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.151754 21044 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.006198 21018 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.153839 15619 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:37.138394 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.153978 21018 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.137949 20900 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.157548 21118 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.068887 21089 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.155681 21044 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.158161 21089 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.093281 20927 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.149689 21068 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.093863 21081 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.163152 21068 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:37.163249 21081 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.164021 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.164072 21068 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.165373 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.165640 21081 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:37.168534 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.169037 21081 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.169204 15572 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 19.
I20260709 13:08:37.169574 21081 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.168577 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.171881 15574 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:37.175022 21081 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:37.175515 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.177750 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.149626 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.092715 20970 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.162310 20927 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.182130 20927 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:37.094012 15692 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.616s (SENT)
I20260709 13:08:37.165995 15575 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.131770 20969 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.167024 20915 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.086621 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.168387 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.178187 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.178354 15726 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:37.178889 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.179872 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.185976 15651 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:08:37.186479 15725 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:37.187832 16272 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:08:37.188141 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.188707 16277 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:37.188848 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.191818 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:37.192427 15721 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:08:37.195271 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 45718.8us
I20260709 13:08:37.195300 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.196167 15544 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.179378 15618 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:37.183840 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 190150us
I20260709 13:08:37.186379 15651 pending_rounds.cc:85] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Aborting all ops after (but not including) 7
I20260709 13:08:37.202386 15651 pending_rounds.cc:107] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:08:37.202637 15651 raft_consensus.cc:2889] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:37.207264 15728 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:37.210623 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.211457 15646 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:37.215312 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.217586 15655 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:37.221431 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.222664 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.223690 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.224804 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.225421 15647 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:37.226409 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.232183 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.236402 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:37.237226 16274 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.240244 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.241425 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.244463 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:37.247195 21081 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:37.248037 21081 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.248441 21081 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:37.248306 20849 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:37.250164 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 52531.3us
I20260709 13:08:37.250295 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.250823 16273 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.250869 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.251672 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.252183 16273 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:37.253134 16236 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:37.254895 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.255467 15728 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.255775 15579 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.255957 16271 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:37.256091 15543 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.256546 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.249339 21081 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:37.257299 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 61209.4us
I20260709 13:08:37.259720 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.261564 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.263140 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:37.264845 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.267741 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.267998 21119 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.269188 21025 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:37.269265 21119 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.269719 21025 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.269865 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.224551 20915 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.270666 20915 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.270996 20915 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.271839 21089 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.272271 15721 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:37.270135 21025 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:37.276705 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.223039 21080 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.289615 15728 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.277662 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d98a5c01953408b8ad3eb550494fbf2" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.278357 20911 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.278717 15543 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.279892 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.280490 21098 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:37.221501 21118 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.297039 21098 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:37.297147 21118 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.298200 20911 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:37.297982 21098 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.298694 15578 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:37.299247 21118 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:37.299116 20911 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.293903 21080 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.300738 16275 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:37.300998 21080 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.283356 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:37.284859 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 190869us
I20260709 13:08:37.285921 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.293220 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.179111 21078 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.296197 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.296263 20862 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:37.303479 16276 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:37.308187 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:37.303694 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.308755 15726 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.308914 16271 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:37.304078 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:37.302443 15723 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 10.
I20260709 13:08:37.303148 16269 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:37.307535 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.310618 15728 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
W20260709 13:08:37.311514 15692 leader_election.cc:336] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.656s (SENT)
I20260709 13:08:37.312062 15692 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:37.313627 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:37.349550 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45552us
W20260709 13:08:37.351820 15692 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.666s (SENT)
W20260709 13:08:37.328014 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 64941.9us
I20260709 13:08:37.348831 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.352722 16236 leader_election.cc:400] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 9. Current term is 10.
I20260709 13:08:37.291224 20900 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:37.348155 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.354959 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.290791 21084 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.311007 21081 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.356823 16278 raft_consensus.cc:2393] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 11: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:37.302749 21089 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.309772 20606 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:37.353509 16274 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:37.314486 21024 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.358474 21079 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.290987 21088 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:37.366333 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.359719 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.365798 15544 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.327585 21076 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.375900 15720 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:37.376008 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.313926 20862 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.350282 21119 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.377043 15724 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:37.390694 15724 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:37.378645 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:37.392871 15728 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:37.380620 15726 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:37.376354 15720 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:37.357905 20900 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:37.396432 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 43817.6us
I20260709 13:08:37.388901 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:37.413619 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.416386 16276 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.391770 15724 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.313741 20902 consensus_queue.cc:1059] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:08:37.415711 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.358829 21084 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:37.438355 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.438678 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.439895 15724 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.422334 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.422797 15721 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:37.367488 20606 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.439234 15723 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:37.371531 21024 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:37.370370 20849 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:37.466282 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 46526.2us
I20260709 13:08:37.467499 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:37.450184 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 98387.2us
I20260709 13:08:37.449301 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:37.362257 20915 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.371793 21079 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:37.455498 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.456399 15728 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:37.396955 20862 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.395125 21085 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:37.359269 20667 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 13:08:37.519867 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 51036.9us
I20260709 13:08:37.479029 21116 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.485476 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:37.486677 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:37.528942 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.486860 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:37.495172 21078 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:37.396041 21119 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:37.502385 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.539307 15576 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:37.418190 20900 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:37.450268 20606 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.538786 21119 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.509105 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:37.465241 21024 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.512929 20969 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:37.535390 20769 raft_consensus.cc:493] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.562950 20769 raft_consensus.cc:515] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.535679 21074 raft_consensus.cc:3055] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:37.535879 21079 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.570411 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.571266 16275 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.571753 20915 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:37.516104 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 100909us
W20260709 13:08:37.518718 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 59248.3us
W20260709 13:08:37.526979 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 63513.9us
I20260709 13:08:37.443805 21084 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:37.526144 16269 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:37.566664 21074 raft_consensus.cc:740] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:37.565775 20769 leader_election.cc:290] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:37.604993 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 76157.5us
I20260709 13:08:37.606422 20911 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.575372 21116 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.614758 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.598524 21085 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
W20260709 13:08:37.621155 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 98956us
W20260709 13:08:37.622148 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 86287.3us
I20260709 13:08:37.623946 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.622435 20667 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:37.630822 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:37.632556 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:37.632928 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.618882 21116 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.636624 15724 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:37.657717 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.658557 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.627805 21067 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:37.667191 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.671556 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:37.678624 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47913.3us
I20260709 13:08:37.679751 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.682348 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:37.683295 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64327.5us
I20260709 13:08:37.655843 20915 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.628193 20909 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:37.690711 21085 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.699338 20915 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.699958 20915 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.668560 21067 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:37.701366 21067 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.703053 21081 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.703644 21081 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:37.704454 21081 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:37.662811 21090 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:08:37.714545 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 56907.7us
I20260709 13:08:37.716266 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.720875 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.722591 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:37.723338 16278 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:37.725523 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:37.727368 15618 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:37.698556 20869 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:37.732549 20869 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:37.719650 20969 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:37.733013 20869 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:37.736008 21143 log.cc:927] Time spent T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:08:37.736675 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 54621.1us
W20260709 13:08:37.737142 21137 log.cc:927] Time spent T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:37.737836 20911 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.739251 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.604378 21025 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.744094 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.729503 20902 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.747329 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:37.751645 21133 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.274s	user 0.003s	sys 0.000s
I20260709 13:08:37.754176 21004 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.755162 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:37.756745 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 49004.9us
I20260709 13:08:37.766463 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:37.722016 21078 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.724817 21031 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:37.669003 15692 connection.cc:256] RPC call timeout handler was delayed by -1.0186742100000856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:08:37.787039 15692 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.750s (SENT)
W20260709 13:08:37.791528 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 72125.5us
I20260709 13:08:37.744398 20766 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:37.794909 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:37.656335 21074 consensus_queue.cc:260] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:37.807969 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 91941.5us
I20260709 13:08:37.813104 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:37.783874 21068 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.786185 21063 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:37.798664 20766 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.831193 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44191.9us
W20260709 13:08:37.844296 15692 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.761s (SENT)
I20260709 13:08:37.844930 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:37.829365 21118 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.864002 15655 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:37.846794 20766 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:37.918780 21140 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:08:37.895998 21080 consensus_meta.cc:287] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:08:37.822857 20606 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:37.973105 21025 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:37.982343 21134 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
I20260709 13:08:37.954428 21080 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.006656 21036 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:38.010437 21136 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.493s	user 0.004s	sys 0.007s
I20260709 13:08:37.691633 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.054171 21089 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:38.054829 21089 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.058293 21122 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:38.058982 21122 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.061793 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:38.070930 21135 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.610s	user 0.003s	sys 0.000s
I20260709 13:08:38.091988 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:38.092747 16276 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.097345 16272 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:38.102427 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:38.145659 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc3f862b6ee4e76ab0d4372c4bcd7be" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:38.146512 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:38.171337 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 49699.5us
W20260709 13:08:38.180963 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 367924us
I20260709 13:08:38.192456 20886 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:38.193444 20886 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:38.194624 20886 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.201449 21098 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:38.222214 20606 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:38.242269 21079 consensus_meta.cc:287] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.003s
I20260709 13:08:38.242794 21079 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.245062 21079 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.246174 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.247545 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.248391 21074 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.249320 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:38.351271 15654 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.351655 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:38.351303 15650 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:38.254590 15579 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.258399 15648 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.260120 21122 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.260861 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.360399 15649 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:38.263628 20862 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 13:08:38.264493 21036 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:38.268253 21119 consensus_meta.cc:287] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.001s
I20260709 13:08:38.270516 21080 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:38.271059 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.272455 21116 consensus_meta.cc:287] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
W20260709 13:08:38.275516 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8995ef9978c446769377fc0e9a0cb9c1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:38.364331 15462 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 88891.5us
I20260709 13:08:38.279518 21089 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:38.308652 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 464338us
W20260709 13:08:38.293071 20869 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:08:38.300680 20728 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:38.401999 15650 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
W20260709 13:08:38.402575 15692 leader_election.cc:336] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.597s (SENT)
I20260709 13:08:38.403268 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.322544 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:38.326097 21085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.163s	sys 0.270s
I20260709 13:08:38.327217 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:38.327709 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.067s	sys 0.095s
W20260709 13:08:38.406694 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.067s	sys 0.095s
W20260709 13:08:38.323894 15695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.052s	sys 0.112s
W20260709 13:08:38.407368 15695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.053s	sys 0.112s
I20260709 13:08:38.358675 16276 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:38.370319 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:38.378937 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:38.408805 16273 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:38.355087 21024 consensus_meta.cc:287] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.000s
W20260709 13:08:38.361172 20900 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.815s	user 0.012s	sys 0.000s
W20260709 13:08:38.406996 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 738182us
W20260709 13:08:38.354877 21084 consensus_meta.cc:287] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
W20260709 13:08:38.358266 20915 consensus_meta.cc:287] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.006s
W20260709 13:08:38.421478 21085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.164s	sys 0.270s
I20260709 13:08:38.439738 21084 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.474295 21103 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.475209 21084 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.445493 15619 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.477329 15619 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.478403 15619 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:38.479137 20969 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.446144 20915 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.480098 20969 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.480857 20969 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:38.481268 20969 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.469362 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.470069 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:38.479172 15619 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.481309 20915 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:38.455611 21157 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:08:38.501160 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.465319 21077 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.506949 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:38.513258 15619 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:38.494581 21090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.101s	sys 0.247s
I20260709 13:08:38.483433 15544 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
W20260709 13:08:38.498310 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 175889us
I20260709 13:08:38.531594 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:38.400440 21119 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.520414 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:38.404793 20862 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:38.514814 21067 consensus_meta.cc:287] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.813s	user 0.011s	sys 0.000s
I20260709 13:08:38.521035 21084 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.407763 21116 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.530471 21099 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:38.536104 15472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 365) took 67837 ms (client timeout 15000 ms). Trace:
W20260709 13:08:38.533246 21090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.102s	sys 0.248s
W20260709 13:08:38.556620 21058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.010s	sys 0.013s
I20260709 13:08:38.558270 21099 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:38.558615 21058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.010s	sys 0.013s
I20260709 13:08:38.559599 21058 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:38.499238 20909 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:38.561198 20909 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:38.561664 20909 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.536011 21096 consensus_queue.cc:1048] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:38.533422 21103 raft_consensus.cc:2764] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:38.517207 20769 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.557705 21090 consensus_queue.cc:1243] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer 8995ef9978c446769377fc0e9a0cb9c1 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:08:38.540982 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57648.2us
I20260709 13:08:38.491706 15654 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:38.409672 20869 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.481842 20969 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.551023 21067 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.430280 21024 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.435204 20900 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.508143 21080 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:38.532840 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:38.529165 15649 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
I20260709 13:08:38.559556 21099 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.560554 16273 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
I20260709 13:08:38.427893 21036 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.499821 21078 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:38.565011 16274 raft_consensus.cc:1240] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.552985 20911 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:38.567078 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:38.574121 21058 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.587559 15575 raft_consensus.cc:606] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:38.587944 15575 raft_consensus.cc:614] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.588989 21058 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.590957 15721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51660
I20260709 13:08:38.591733 15721 raft_consensus.cc:606] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:38.592136 15721 raft_consensus.cc:614] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.595480 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89f37c80078841efa574af907a802c86"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:38.596045 15575 raft_consensus.cc:606] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:38.596374 15575 raft_consensus.cc:614] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.599169 15721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51660
I20260709 13:08:38.599839 15721 raft_consensus.cc:606] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:38.572094 15647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.000s	sys 0.023s
I20260709 13:08:38.572438 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:38.601094 15647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.000s	sys 0.023s
W20260709 13:08:38.573350 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.000s	sys 0.021s
W20260709 13:08:38.601927 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.000s	sys 0.022s
W20260709 13:08:38.602299 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 873903us
I20260709 13:08:38.602763 15618 leader_election.cc:304] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.602829 15575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:38.603523 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:38.603590 15575 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:38.552711 20915 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:38.604204 15575 raft_consensus.cc:614] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.604393 20915 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.605052 20915 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.574942 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:38.610410 15729 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.579114 15724 raft_consensus.cc:1240] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:38.618294 15579 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:38.620996 15646 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:38.622257 15725 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:38.625871 15655 raft_consensus.cc:1240] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:38.555044 15472 rpcz_store.cc:269] 0709 13:07:30.698463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.698737 (+   274us) service_pool.cc:224] Handling call
0709 13:08:38.536034 (+67837297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.309417 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.310148 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.310203 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:08:36.310222 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:36.311862 (+  1640us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.311977 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.312021 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:36.312494 (+   473us) tablet.cc:701] Row locks acquired
0709 13:08:36.312555 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:08:36.312753 (+   198us) write_op.cc:270] Start()
0709 13:08:36.312910 (+   157us) write_op.cc:276] Timestamp: P: 1783602516312677 usec, L: 0
0709 13:08:36.312949 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.313671 (+   722us) log.cc:844] Serialized 1616 byte log entry
0709 13:08:36.690941 (+377270us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.077890 (+386949us) write_op.cc:301] APPLY: starting
0709 13:08:37.078013 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:37.084125 (+  6112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:37.084264 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:37.194729 (+110465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:37.262370 (+ 67641us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:08:37.267773 (+  5403us) write_op.cc:312] APPLY: finished
0709 13:08:37.268087 (+   314us) log.cc:844] Serialized 41 byte log entry
0709 13:08:37.268275 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.268362 (+    87us) write_op.cc:454] Released schema lock
0709 13:08:37.268417 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.268820 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.268848 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1723695,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":381017,"apply.run_cpu_time_us":7788,"apply.run_wall_time_us":190950,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":774005,"prepare.run_cpu_time_us":17757,"prepare.run_wall_time_us":270727,"raft.queue_time_us":127120,"raft.run_cpu_time_us":17416,"raft.run_wall_time_us":306918,"replication_time_us":377818,"thread_start_us":914029,"threads_started":4,"wal-append.queue_time_us":226722,"wal-append.run_cpu_time_us":26553,"wal-append.run_wall_time_us":1716296}]]}
W20260709 13:08:38.638849 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55972.5us
I20260709 13:08:38.623438 15475 catalog_manager.cc:5697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 3 to 14, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 14 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:38.656026 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:38.636690 15720 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.657986 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:38.658095 15720 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.640424 15475 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.634414 21122 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.661196 15475 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:38.678777 20622 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:38.675273 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 272723us
I20260709 13:08:38.637418 20769 raft_consensus.cc:2749] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.679489 20622 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.637887 21078 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:38.661291 20766 consensus_meta.cc:287] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.781s	user 0.004s	sys 0.007s
I20260709 13:08:38.686954 15475 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.641443 20911 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:38.721311 15475 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 14, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 14 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.723477 15475 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 12, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.734712 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1808) took 1041 ms. Trace:
I20260709 13:08:38.735301 16274 rpcz_store.cc:276] 0709 13:08:37.693548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.693854 (+   306us) service_pool.cc:224] Handling call
0709 13:08:37.694195 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.584916 (+890721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.734368 (+149452us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54004a9054. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:38.734636 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002149760}
W20260709 13:08:38.723302 15692 leader_election.cc:336] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.931s (SENT)
I20260709 13:08:38.748170 15692 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:38.753566 15726 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:08:38.753741 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 198640us
I20260709 13:08:38.680575 20769 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:38.763002 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 75254.2us
I20260709 13:08:38.676932 21122 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:38.688987 21078 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:38.775180 15728 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:38.686462 21154 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:38.775740 15728 pending_rounds.cc:85] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:38.776206 15728 pending_rounds.cc:107] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:38.776499 15728 raft_consensus.cc:2889] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.691805 21103 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.725087 15475 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 7, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 7 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:38.783291 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 195378us
I20260709 13:08:38.807073 15543 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:38.784358 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:38.808135 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 235740us
I20260709 13:08:38.788692 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51890 (request call id 2282) took 1300 ms. Trace:
I20260709 13:08:38.814571 16236 leader_election.cc:400] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:38.786455 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
W20260709 13:08:38.778867 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 175359us
I20260709 13:08:38.815577 15646 rpcz_store.cc:276] 0709 13:08:37.488437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.489404 (+   967us) service_pool.cc:224] Handling call
0709 13:08:37.489699 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.621513 (+1131814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.788092 (+166579us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540017d754. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:38.788431 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601155456}
I20260709 13:08:38.820585 16236 leader_election.cc:403] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.823582 15618 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:38.825347 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 144338us
W20260709 13:08:38.829034 15692 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.972s (SENT) [suppressed 23 similar messages]
I20260709 13:08:38.738624 20766 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.762698 20769 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:38.804013 21090 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:38.833540 21161 log.cc:927] Time spent T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:08:38.839829 20622 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.779417 21172 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.845854 21036 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.846400 21119 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:38.850159 21122 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.851269 21116 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.853600 21074 consensus_queue.cc:1059] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:38.854928 21162 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.855386 20728 consensus_queue.cc:1059] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:38.856457 20766 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:38.863936 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 74808.3us
I20260709 13:08:38.874737 20769 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.872888 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.860239 21081 raft_consensus.cc:993] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:38.862152 20869 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.859952 20915 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.842371 20911 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.877156 21074 raft_consensus.cc:3055] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:38.877521 21074 raft_consensus.cc:740] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:38.877637 20915 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.861404 21024 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.803845 21154 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.856962 21077 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:38.863716 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56771.8us
I20260709 13:08:38.813215 15475 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 2 to 5, term changed from 5 to 11, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to <none>, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129), VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130), VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131), VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.857959 20862 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.821762 21118 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.844597 15729 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:38.894385 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:38.880626 15720 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:38.895579 15475 catalog_manager.cc:5697] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 14, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 14 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:38.896435 15720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2840) took 1521 ms. Trace:
I20260709 13:08:38.896781 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.897505 15475 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:38.902626 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:38.900143 15475 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 12, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:38.896797 15720 rpcz_store.cc:276] 0709 13:08:37.375357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.375506 (+   149us) service_pool.cc:224] Handling call
0709 13:08:37.375790 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.753196 (+377406us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4c00167f40. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d93cdfa20 00007f2d93cf0a29 00007f2d93cb6644 00007f2d93cddf2d 00007f2d93cddb93 00007f2d95a0e18b 00007f2d95a0ecb5 00007f2d95a09f30 00007f2d95a0b7de 00007f2d95a15b49 00007f2d95a16416
0709 13:08:38.633484 (+880288us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400049820. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d9599106f 00007f2d95a09f60 00007f2d95a0b7de 00007f2d95a15b49 00007f2d95a16416 00007f2d95a12d8f 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62
0709 13:08:38.896162 (+262678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.896366 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874875136}
I20260709 13:08:38.904845 15646 raft_consensus.cc:2393] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 12: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:38.904531 15475 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 13, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:38.780067 21078 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.906411 15475 catalog_manager.cc:5697] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 13, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:38.908458 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:38.909327 15720 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.908511 15475 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.893257 21090 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:38.911046 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:38.875880 21081 raft_consensus.cc:1081] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:38.911671 15653 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.915343 15475 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:38.917714 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:38.928902 16274 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.865958 20900 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:38.868507 21067 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:38.931589 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:38.864208 21031 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:38.935310 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 121018us
W20260709 13:08:38.936004 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.893451 21118 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:38.906682 21122 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:38.933807 15475 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 10, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 10 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:38.959723 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 149246us
I20260709 13:08:38.878435 21074 consensus_queue.cc:260] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:38.842962 21103 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:08:38.947844 15729 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:38.984552 15647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2769) took 1131 ms. Trace:
I20260709 13:08:38.972895 15720 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:38.903323 21156 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.912571 21089 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:38.959219 16274 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
W20260709 13:08:38.941115 21173 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.095s	user 0.005s	sys 0.001s
W20260709 13:08:38.940984 21165 log.cc:927] Time spent T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.005s
W20260709 13:08:38.941265 21168 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.006s
I20260709 13:08:39.007824 15619 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:38.985196 15647 rpcz_store.cc:276] 0709 13:08:37.853584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.853709 (+   125us) service_pool.cc:224] Handling call
0709 13:08:37.866761 (+ 13052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.872382 (+  5621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.872428 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.873004 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.601714 (+728710us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:38.601774 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.602010 (+   236us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.984303 (+382293us) raft_consensus.cc:1685] finished
0709 13:08:38.984328 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.984477 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1174,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5206,"thread_start_us":728357,"threads_started":1,"wal-append.queue_time_us":786172}
W20260709 13:08:38.950364 21135 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.013s
I20260709 13:08:38.939098 21170 raft_consensus.cc:3055] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:38.904716 20969 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:39.025676 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78262.3us
I20260709 13:08:39.027117 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:38.943086 21169 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:38.988255 15475 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 17, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 17 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:39.040257 15475 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 13, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 13 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:39.036726 15720 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.021082 15729 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:39.046288 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.048209 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.049448 15653 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:39.024473 21170 raft_consensus.cc:740] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:39.037590 21118 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.052280 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.052371 21178 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:08:39.053153 15723 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.055404 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.056154 20728 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:39.056641 20728 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:39.056746 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.058348 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.058990 15727 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.059518 21089 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:39.060755 21089 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.041874 15475 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.062891 21085 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.063578 21085 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.065125 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.065779 15729 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:08:39.072372 16236 connection.cc:256] RPC call timeout handler was delayed by -1.4020726540001078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:08:39.072834 16236 connection.cc:256] RPC call timeout handler was delayed by -1.3993726540001035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 13:08:39.073153 16236 connection.cc:256] RPC call timeout handler was delayed by -1.2112726540000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:08:39.076067 16236 connection.cc:256] RPC call timeout handler was delayed by -1.2022726540000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:08:39.070582 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.078622 15722 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 18: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:39.057629 20728 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.082357 16236 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.082656 20728 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:39.082873 21154 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:38.938954 21079 consensus_queue.cc:1059] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:08:39.085207 21079 raft_consensus.cc:3055] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:39.085647 21079 raft_consensus.cc:740] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:39.005862 21031 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:39.086658 21079 consensus_queue.cc:260] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.058894 20967 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:39.074878 21174 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:39.091379 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.051101 21170 consensus_queue.cc:260] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.062937 15475 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:39.024734 21155 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:39.096029 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:39.101009 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 57487us
I20260709 13:08:39.111022 16270 raft_consensus.cc:2368] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 15. Current term is 16.
W20260709 13:08:39.038964 21166 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:39.096311 15620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.098632 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.115548 16273 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:39.099074 15723 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:39.099766 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.108963 15720 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:39.109128 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 16.
I20260709 13:08:39.117547 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.117772 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:39.119065 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.119611 15649 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:39.098654 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 49353.1us
I20260709 13:08:39.120944 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.121937 16277 raft_consensus.cc:2393] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 13: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:39.115756 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.122478 15475 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 14, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 14 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:39.126395 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.127246 16273 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:39.128284 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:39.128461 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 299451us
W20260709 13:08:39.129069 15692 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.009s (SENT)
W20260709 13:08:39.094146 21164 log.cc:927] Time spent T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.314s	user 0.004s	sys 0.000s
I20260709 13:08:39.088162 21074 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.133140 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.137178 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.129825 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:39.135159 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 315117us
I20260709 13:08:39.089263 21063 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.147027 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.110492 20915 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.052287 21118 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.086884 21031 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.098672 21175 raft_consensus.cc:2764] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:39.135442 15475 catalog_manager.cc:5697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:39.016641 21156 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.112725 21085 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.094972 20886 consensus_queue.cc:1048] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:08:39.160490 15475 catalog_manager.cc:5697] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 13, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:39.165760 21090 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:39.167899 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.136546 15653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51890
I20260709 13:08:39.101164 20967 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.173146 15619 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:39.174578 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45533.5us
W20260709 13:08:39.201762 15692 leader_election.cc:336] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.100s (SENT)
I20260709 13:08:39.202314 15692 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:39.175697 15618 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.177326 16272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1815) took 1026 ms. Trace:
I20260709 13:08:39.177901 16276 raft_consensus.cc:1217] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
W20260709 13:08:39.176759 20909 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.003s
W20260709 13:08:39.183327 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71157.8us
I20260709 13:08:39.183475 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.209328 15654 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:39.187140 15653 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.149494 21063 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.157902 21067 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.159852 21170 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.204231 16276 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:39.180045 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:39.136036 20769 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.206857 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.203198 16272 rpcz_store.cc:276] 0709 13:08:38.150940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.151668 (+   728us) service_pool.cc:224] Handling call
0709 13:08:38.152090 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:38.152555 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.152606 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:38.158167 (+  5561us) log.cc:844] Serialized 52 byte log entry
0709 13:08:38.556979 (+398812us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:38.557019 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.557078 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.177074 (+619996us) raft_consensus.cc:1685] finished
0709 13:08:39.177101 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.177263 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":910,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":40382,"thread_start_us":287995,"threads_started":1,"wal-append.queue_time_us":407499}
I20260709 13:08:39.210215 15653 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:39.227023 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 51416.7us
I20260709 13:08:39.188678 15475 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.228135 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.210456 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:39.178472 20915 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.221849 15727 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:39.203549 21090 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.199210 21084 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:39.224367 20967 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:39.224766 15694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.225509 21185 log.cc:927] Time spent T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:39.217585 21086 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:08:39.230751 15692 leader_election.cc:336] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.170s (SENT)
W20260709 13:08:39.239184 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.266436 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55661.3us
I20260709 13:08:39.241415 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:39.242247 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.266523 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.261286 15653 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.250244 15619 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:39.219972 21186 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:39.263582 15546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.269471 15618 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:39.232247 20900 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.238785 21154 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:39.271893 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.209652 21175 consensus_queue.cc:1059] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:39.274482 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.229705 21119 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:39.275628 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.217801 20909 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.277191 15728 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.276400 21154 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.278626 15653 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.280650 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.285077 15725 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:39.285487 15725 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:39.287745 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57016.2us
W20260709 13:08:39.288444 15692 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.442s (SENT)
I20260709 13:08:39.288995 15692 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.293090 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.280296 21090 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:39.235147 21078 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.270331 21183 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.283192 21154 raft_consensus.cc:3060] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.295661 15725 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.310151 15725 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.278019 21178 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:39.277835 20766 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.276132 21024 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:39.278476 20886 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.283447 20969 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.317366 15728 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:39.271485 20911 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:39.336035 20766 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.316165 21090 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.322937 21024 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:39.337569 21024 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.337432 20766 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.299168 21084 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:39.343488 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55066.3us
W20260709 13:08:39.344485 15692 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.568s (SENT)
I20260709 13:08:39.345037 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.345299 21156 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.316538 21194 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:39.312187 21178 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:39.347786 21178 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:39.348778 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.308146 21018 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.351840 15723 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.334180 16278 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:39.362072 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 69095us
I20260709 13:08:39.364964 15544 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:39.366878 15725 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
W20260709 13:08:39.369980 21187 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:08:39.371583 21191 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:08:39.375767 20769 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.376995 21063 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.377781 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.378444 15726 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.335055 20915 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.352496 21090 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.390544 15726 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
W20260709 13:08:39.399536 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55099.7us
I20260709 13:08:39.400565 15692 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.401889 15692 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.359290 20967 raft_consensus.cc:493] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:39.411144 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.413343 20909 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.414472 20909 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:39.414652 21199 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.414990 20909 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.360792 21068 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:39.423261 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.417790 21090 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.465193 21078 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.420307 21156 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:39.422704 21077 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.459658 21170 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.476927 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.479056 15580 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.479578 15543 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:39.480840 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.481086 15575 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.481468 15580 raft_consensus.cc:3060] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.480896 15574 raft_consensus.cc:1240] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:39.483309 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:39.483889 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.484666 16273 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.489156 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.489859 15578 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:39.495376 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.501922 15693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.504293 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.420100 21085 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:08:39.517144 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.511914 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.517865 16270 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.510797 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.518319 15575 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.510634 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.520380 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.520982 16269 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.522135 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:39.525018 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 87339us
I20260709 13:08:39.526865 16273 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:39.534952 21024 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.421927 20967 raft_consensus.cc:515] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.500556 21186 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.538414 20909 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.539501 15572 raft_consensus.cc:1240] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:39.543325 15575 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:39.545706 16270 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:39.489162 21091 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:39.555356 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.556444 21096 raft_consensus.cc:3055] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:39.595443 21096 raft_consensus.cc:740] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:39.596330 21096 consensus_queue.cc:260] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.597321 21096 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.489202 21103 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.559024 15653 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:39.598733 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.566671 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:39.598465 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 44746.3us
I20260709 13:08:39.599568 15577 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 18: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:39.600641 21186 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.509560 21203 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.547171 20728 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.583345 15618 leader_election.cc:304] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.598534 21103 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.609190 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.610147 15576 raft_consensus.cc:1240] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:39.611850 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.617072 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.617779 15646 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.617913 15571 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 14: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:39.620780 15578 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 20.
I20260709 13:08:39.621683 15574 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:39.633992 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.635313 20967 leader_election.cc:290] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.638355 21091 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.638903 21091 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.639539 21178 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.641449 20728 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.642488 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.641734 21091 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.644616 20728 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.602957 21154 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:39.646703 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63483.8us
I20260709 13:08:39.647254 21177 raft_consensus.cc:2749] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:39.648756 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.655984 15653 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:39.648725 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.651162 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.657081 16270 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:39.657548 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:39.659224 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:39.659256 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.655296 21176 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:39.662662 21176 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:39.663863 21122 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 13:08:39.664898 21176 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.662195 21162 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:39.666215 21162 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.667079 21162 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.668411 21162 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:39.668931 21163 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.885s	user 0.000s	sys 0.008s
I20260709 13:08:39.670359 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.664040 20902 consensus_queue.cc:1059] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:39.672940 21091 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.674269 21091 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.631088 21203 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.676719 21203 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.677018 21091 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:39.678277 21177 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.678380 15573 raft_consensus.cc:3060] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:39.678884 21177 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.679783 21177 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.684310 16269 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:39.615136 21078 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:39.690647 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.687846 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:39.693387 16269 raft_consensus.cc:2393] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:39.694167 15580 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:39.699355 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.700902 21208 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:39.702630 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.727231 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:39.728873 15692 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.701s (SENT)
I20260709 13:08:39.735803 15573 raft_consensus.cc:2468] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
W20260709 13:08:39.737314 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45825.4us
I20260709 13:08:39.740229 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.743999 20728 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:39.745906 15692 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 1.866s (SENT)
I20260709 13:08:39.701969 21178 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.747110 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:39.746300 20915 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:39.696769 21078 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.749429 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.750274 16277 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:39.750916 21078 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:39.755003 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.758306 20728 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:39.758663 15692 leader_election.cc:336] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Timed out: RequestConsensusVote RPC to 127.14.34.132:39301 timed out after 2.865s (SENT)
W20260709 13:08:39.759606 15692 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.761927 21024 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:39.763569 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.769745 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:39.773157 21154 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:39.775203 21154 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.775781 21079 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:39.775705 21154 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.778147 21154 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:39.780194 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.780620 21103 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:39.781778 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.788578 21181 raft_consensus.cc:3055] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:08:39.788861 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:39.789072 21181 raft_consensus.cc:740] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.790071 21181 consensus_queue.cc:260] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.791095 21181 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.792410 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.792912 15654 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:39.793218 15653 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:39.793457 15649 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.793545 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:39.794620 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:39.797757 21067 consensus_queue.cc:1059] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.798702 21067 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:39.811367 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.813273 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.813282 15618 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:39.821095 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.821502 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.823163 16278 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:39.825260 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:39.826758 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.828815 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.828644 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.830004 15721 raft_consensus.cc:2410] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:39.831164 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.831930 15728 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:39.832930 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.833642 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:39.836959 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.839730 15692 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:39.840190 15725 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.840983 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:39.841588 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.826917 20728 raft_consensus.cc:3055] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:39.841003 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:39.837097 20902 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:39.860241 20902 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.860653 15723 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:39.861243 20902 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.847074 21086 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.839639 21081 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:39.851374 21195 log.cc:927] Time spent T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.487s	user 0.001s	sys 0.002s
I20260709 13:08:39.854631 21214 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.839424 21154 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:39.865923 21154 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:39.866441 21154 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.871116 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:39.873374 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.874127 15618 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:39.874846 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.876151 15647 raft_consensus.cc:2468] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:39.840726 21088 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:39.836053 21084 raft_consensus.cc:2804] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.878877 15693 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:39.880429 15579 raft_consensus.cc:2393] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 13: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:39.844956 20728 raft_consensus.cc:740] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:39.873493 21153 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:39.893859 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.899485 15572 raft_consensus.cc:1240] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:39.880466 21099 raft_consensus.cc:2804] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:39.882368 21214 raft_consensus.cc:2804] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:39.898422 21080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.015s	sys 0.009s
W20260709 13:08:39.902302 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.895748 21084 raft_consensus.cc:697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
W20260709 13:08:39.908911 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 67432us
I20260709 13:08:39.900233 21153 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.911652 21153 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.904291 21099 raft_consensus.cc:697] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:39.914902 21099 consensus_queue.cc:237] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.904521 21214 raft_consensus.cc:697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
W20260709 13:08:39.902871 21080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.015s	sys 0.009s
I20260709 13:08:39.922336 21214 consensus_queue.cc:237] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.925866 21084 consensus_queue.cc:237] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.939678 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:39.942184 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.942826 15573 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:39.944816 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:39.945567 15573 raft_consensus.cc:2393] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 14: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:39.945465 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.948812 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:39.948071 21086 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:39.954144 15577 raft_consensus.cc:1240] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 LEADER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:39.952966 21081 consensus_queue.cc:1059] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:39.930399 20728 consensus_queue.cc:260] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:39.956964 20728 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:39.961328 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 93742.8us
I20260709 13:08:39.963088 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:39.963491 21131 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:39.964074 21131 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.964807 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.966355 21131 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:39.925849 21154 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:39.976159 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:39.976662 15651 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:39.981403 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:39.984333 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:39.986096 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.006383 21154 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:40.007609 15619 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.007825 21081 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:40.009753 21177 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.009773 20902 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:40.019069 21180 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.021054 21119 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.021454 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.022606 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.023597 21156 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.024262 21156 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.024297 21077 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:40.025484 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.016s
W20260709 13:08:40.025810 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.016s
W20260709 13:08:40.026314 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 661377us
I20260709 13:08:40.027413 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:40.030191 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 148977us
I20260709 13:08:40.024600 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.031548 21170 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.032222 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.034914 21131 consensus_queue.cc:1059] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:40.036698 21131 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.037382 21058 raft_consensus.cc:3055] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.037832 21058 raft_consensus.cc:740] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:40.038781 21058 consensus_queue.cc:260] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:40.039505 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 55281us
I20260709 13:08:40.040169 21058 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.040495 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.042253 20886 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.043071 20886 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.011360 21162 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.041983 16236 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:40.058008 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 45127.6us
I20260709 13:08:40.072293 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.072638 16272 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:40.081822 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.013397 21103 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:40.085563 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.087288 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.089782 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.064441 20909 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:40.092018 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.091058 21182 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:40.093869 21118 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.084890 21078 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.094139 21177 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:40.066504 21170 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:40.126816 21213 raft_consensus.cc:3055] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.091086 21180 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.092428 21119 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.134649 16236 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.142912 15579 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:40.143594 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.144541 15579 pending_rounds.cc:85] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 8
I20260709 13:08:40.144778 15579 pending_rounds.cc:107] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:40.145023 15579 raft_consensus.cc:2889] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.138877 21176 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.157496 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.140165 21213 raft_consensus.cc:740] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:40.160190 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:40.168781 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.096125 21103 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.162851 21179 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.163318 21079 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.167176 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.170926 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.140980 21182 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:40.159613 21175 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:40.149878 21085 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.181249 15724 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:40.185662 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:40.188401 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.186348 16270 raft_consensus.cc:2368] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 15. Current term is 16.
I20260709 13:08:40.210171 21119 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:40.210796 21119 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.211716 16274 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.215042 16271 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.192133 21212 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.224973 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.227965 15721 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:08:40.234277 15721 pending_rounds.cc:85] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 11
I20260709 13:08:40.234545 15721 pending_rounds.cc:107] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:40.234787 15721 raft_consensus.cc:2889] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.229908 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.236313 15720 raft_consensus.cc:2468] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:40.237236 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.238685 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.240242 15720 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:40.182528 21178 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:40.248559 15728 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:08:40.246263 15720 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.247022 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.251493 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.254215 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.218532 20969 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:08:40.217248 21085 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:40.249004 21212 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:40.233295 21079 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:40.254348 21119 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:40.284332 20969 consensus_queue.cc:1243] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:40.292758 16277 raft_consensus.cc:1275] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:40.293120 21169 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.294864 15579 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:40.298359 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.305648 15646 raft_consensus.cc:1240] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:40.243858 21176 consensus_queue.cc:1059] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:40.306826 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796cbc2fdf89418ea0827815b500d50a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.318620 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:40.275434 21213 consensus_queue.cc:260] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.288650 21182 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.285903 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:40.309934 21228 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:40.316079 15720 pending_rounds.cc:85] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting all ops after (but not including) 8
I20260709 13:08:40.326689 15720 pending_rounds.cc:107] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:40.326992 15720 raft_consensus.cc:2889] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.285766 21004 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.328187 15647 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:40.329603 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.327843 21213 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.308499 21169 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:40.337643 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8652a740787d4ef6a541ee7ee4b5a7c0" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.305045 20606 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:40.345522 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.350800 15647 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:40.352710 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:40.445256 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 92952.2us
I20260709 13:08:40.330371 21089 raft_consensus.cc:2764] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:40.431800 15573 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:08:40.396368 16273 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:08:40.410660 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.316224 21212 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.328295 21176 consensus_queue.cc:1243] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:40.328020 21182 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.470172 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.477881 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.349303 20969 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:08:40.463471 21228 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:40.471148 21103 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:40.476995 21118 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.466795 21186 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:40.518301 15647 raft_consensus.cc:1240] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.481729 21170 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:40.524811 16272 raft_consensus.cc:2410] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:40.515902 15574 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.531541 15573 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:40.543521 15646 raft_consensus.cc:1240] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Rejecting Update request from peer 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:40.543426 15647 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:40.500789 21250 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:40.555312 15573 raft_consensus.cc:1275] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:40.557014 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:40.562826 21179 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.567910 21081 consensus_queue.cc:1059] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:40.569087 21081 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:40.570619 21228 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.512678 21080 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:40.555015 21085 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:40.588193 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.589433 21169 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.590531 21182 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:40.591584 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.595780 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:40.599990 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 96625.5us
W20260709 13:08:40.609855 21244 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:08:40.610800 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.601887 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.534075 21170 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.612632 21086 consensus_queue.cc:1048] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:08:40.635749 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 75823.8us
I20260709 13:08:40.645519 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.648576 21249 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:40.649302 21249 consensus_queue.cc:1059] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:40.662120 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.663266 15544 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.668851 21089 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:40.669355 21089 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:40.675109 21086 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:40.675669 21086 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.675957 15544 leader_election.cc:304] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.677088 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.678256 21253 raft_consensus.cc:2749] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:40.678481 15544 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:40.677807 21085 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:40.693246 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.679836 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.678966 21253 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.681411 21257 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.670172 21089 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.681558 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:40.671224 21247 log.cc:927] Time spent T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:08:40.683854 21170 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:40.681537 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:40.686911 21058 consensus_meta.cc:287] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.000s
I20260709 13:08:40.672236 21250 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.688362 21079 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:40.698071 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.677764 21086 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:40.701181 21090 raft_consensus.cc:3055] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:40.707706 15648 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:40.712215 21090 raft_consensus.cc:740] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:40.715732 21090 consensus_queue.cc:260] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.717387 21090 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.699419 21080 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:40.724506 21235 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.634s	user 0.000s	sys 0.010s
W20260709 13:08:40.730067 21251 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:40.731736 15544 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:40.732604 21079 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:40.735088 21238 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.455s	user 0.006s	sys 0.005s
I20260709 13:08:40.719230 20667 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:08:40.766258 15651 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.722698 21089 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:40.774999 21090 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.775564 21090 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.777820 21090 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:40.783272 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.750893 21179 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.787560 21179 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.794930 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.815945 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.821045 15728 raft_consensus.cc:1275] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:40.827566 15721 raft_consensus.cc:1240] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:40.829552 15724 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:40.830657 15728 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:40.841634 15720 raft_consensus.cc:1275] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:40.817337 21194 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:40.832367 21172 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.856765 21172 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:40.839440 20969 consensus_queue.cc:1048] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:40.830371 21215 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.881624 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44649us
I20260709 13:08:40.907634 21213 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.909021 21213 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:40.866611 21215 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.879055 21179 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:40.914299 21270 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:08:40.919008 21215 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:40.921154 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.921928 15648 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 13.
I20260709 13:08:40.924717 21213 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:40.925343 21169 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:40.910240 21170 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.927649 21170 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.929560 15544 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:40.930963 21172 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:40.907014 21176 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.931016 21215 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:40.931757 21215 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.932273 21215 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.931701 21176 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.935745 21176 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:40.937438 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.938455 15573 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:40.939499 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:40.940968 21176 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:40.941345 21176 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.941675 21176 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:40.944932 21230 log.cc:927] Time spent T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.852s	user 0.004s	sys 0.008s
I20260709 13:08:40.949353 21176 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.950398 21237 consensus_queue.cc:1059] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:40.951850 20969 raft_consensus.cc:3055] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:40.952214 20969 raft_consensus.cc:740] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:40.952989 20969 consensus_queue.cc:260] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:40.954371 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:40.954934 15573 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.957523 20969 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.958992 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.959646 15574 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:40.959740 21176 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:40.964999 21264 log.cc:927] Time spent T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:08:40.970723 21177 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:40.975180 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.975839 16276 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:40.976675 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.977246 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:40.979539 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:40.980103 15574 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 20.
I20260709 13:08:40.984683 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:40.985584 16275 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:40.993860 16274 raft_consensus.cc:1275] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:40.997927 15721 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:41.001209 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.002354 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.002975 15652 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:41.003098 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:41.001821 15654 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:41.003962 15650 raft_consensus.cc:3060] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:41.006421 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.006944 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:41.007828 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:41.010192 15692 leader_election.cc:400] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 15. Current term is 16.
I20260709 13:08:41.010506 15692 leader_election.cc:403] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.026831 15650 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:41.019376 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.019419 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:40.929932 21170 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:41.071058 15573 raft_consensus.cc:2468] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:41.038424 21178 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.021562 21215 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.066457 21242 consensus_queue.cc:1048] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:41.089855 16271 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:08:41.172397 16271 pending_rounds.cc:85] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Aborting all ops after (but not including) 11
I20260709 13:08:41.172749 16271 pending_rounds.cc:107] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:41.173048 16271 raft_consensus.cc:2889] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:41.098556 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.107661 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:41.108160 15695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.110107 21269 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:41.111698 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:41.054925 21176 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.060115 21214 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:41.027740 21084 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:08:41.073220 21156 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:41.176363 15726 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:41.163558 16235 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:41.199376 15720 raft_consensus.cc:1240] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Rejecting Update request from peer 681370bcf39d46b189ec8e9a5957f93d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:08:41.178596 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 46487.3us
I20260709 13:08:41.229353 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:41.182586 21214 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.186288 21081 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 15. Current term is 16.
W20260709 13:08:41.247637 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.196869 21156 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.176862 21178 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.208025 21118 raft_consensus.cc:2804] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.207072 21213 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:41.288735 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:41.252341 21214 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.301326 15723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44464 (request call id 2868) took 1076 ms. Trace:
I20260709 13:08:41.185515 21176 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.280642 21156 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:41.301718 15723 rpcz_store.cc:276] 0709 13:08:40.224575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.224708 (+   133us) service_pool.cc:224] Handling call
0709 13:08:40.251867 (+ 27159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.254574 (+  2707us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:40.352594 (+ 98020us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.511030 (+158436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.512662 (+  1632us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.512809 (+   147us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:40.729482 (+216673us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:41.072524 (+343042us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b180039b740. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9b7eede1 00007f2d9b7fb5b1 00007f2d928a0c0a 00007f2d9bfe0219 00007f2d92928a40 00007f2d929234e4 00007f2d92923455 00007f2d9940b3c7 00007f2d95a1d9a7 00007f2d95a2d0bf 00007f2d95a2d038
0709 13:08:41.072784 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.300997 (+228213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.301084 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.301129 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:41.301142 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.301271 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621902,"prepare.queue_time_us":820354,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":119558,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":22043,"spinlock_wait_cycles":11626496,"thread_start_us":462000,"threads_started":3,"wal-append.queue_time_us":255631}
I20260709 13:08:41.341658 16271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39946 (request call id 1412) took 1026 ms. Trace:
I20260709 13:08:41.342921 16271 rpcz_store.cc:276] 0709 13:08:40.315261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.317095 (+  1834us) service_pool.cc:224] Handling call
0709 13:08:40.330410 (+ 13315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.173580 (+843170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.341400 (+167820us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540044d9d4. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a13e01 00007f2d95a1283e 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:41.341605 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745534848}
W20260709 13:08:41.353118 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 344494us
I20260709 13:08:41.301196 21118 raft_consensus.cc:697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:41.345307 21175 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.369134 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 359081us
I20260709 13:08:41.370746 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:41.371915 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:41.299255 21213 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:41.408783 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 387609us
I20260709 13:08:41.405601 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:41.431629 21267 log.cc:927] Time spent T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:41.432467 21248 log.cc:927] Time spent T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:41.374225 21175 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:41.452281 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 248257us
I20260709 13:08:41.444370 21215 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:41.447353 21172 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.467218 21170 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.447505 21177 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:41.445407 21280 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.447700 21270 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:08:41.447197 21118 consensus_queue.cc:237] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:41.535835 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 73907.6us
I20260709 13:08:41.508730 21237 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:41.550279 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:41.581323 16275 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.544459 21176 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:41.554128 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:41.588703 15579 raft_consensus.cc:2410] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:08:41.547205 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 141683us
I20260709 13:08:41.589701 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:41.507196 21177 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.539368 21018 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:41.586052 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:41.594684 15725 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
W20260709 13:08:41.616819 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 68223.8us
I20260709 13:08:41.618738 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:41.619393 15573 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:41.598865 21213 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:41.636029 21277 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:08:41.636647 21286 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:08:41.671087 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 131221us
W20260709 13:08:41.655561 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 64496.2us
I20260709 13:08:41.635104 16275 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:41.678272 15543 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:41.675767 15619 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:41.636055 21276 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:08:41.776047 21311 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:41.777127 21298 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:08:41.778004 21299 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:08:41.779531 16237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.778090 21024 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.766225 21254 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:08:41.780704 20886 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:41.803689 20915 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:41.779824 21316 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:41.807425 16269 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:41.781709 21175 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:41.685546 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f37c80078841efa574af907a802c86" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.848577 21301 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:41.878857 21316 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.881091 21316 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:41.881783 21206 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:41.881589 21301 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.882392 21206 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:41.884325 21301 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:41.884662 21206 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:41.854674 21311 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:41.885772 21311 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.888863 15646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2814) took 1018 ms. Trace:
I20260709 13:08:41.889074 21300 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
W20260709 13:08:41.889531 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 8995ef9978c446769377fc0e9a0cb9c1 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:41.890458 21285 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:41.889312 15646 rpcz_store.cc:276] 0709 13:08:40.870927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.871122 (+   195us) service_pool.cc:224] Handling call
0709 13:08:40.879881 (+  8759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.885161 (+  5280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.885192 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.885629 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.185263 (+299634us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.185323 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.185420 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.888621 (+703201us) raft_consensus.cc:1685] finished
0709 13:08:41.888645 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.888793 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5613,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3079,"thread_start_us":270259,"threads_started":1,"wal-append.queue_time_us":367398}
I20260709 13:08:41.891305 21177 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:41.812891 21176 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:41.892078 21176 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.812508 21290 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:41.894253 21176 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:41.894622 21290 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.897270 21290 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:41.917735 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.918464 15646 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:41.889621 21300 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.925623 21300 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:41.871416 20886 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:41.857244 20915 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.934130 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:41.943003 21214 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.006s
I20260709 13:08:41.955720 21214 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:41.945755 21314 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.946050 21179 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:41.946316 20915 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.958441 15724 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:41.970377 16236 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:41.979254 21300 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:41.979761 21300 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.977416 21301 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.980334 21300 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.987280 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.990013 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:41.993592 15651 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:41.995424 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.995600 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:41.996217 15646 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:41.998013 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.998402 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:41.970829 21309 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:41.957976 21214 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.006160 15651 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 14: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:41.965648 20886 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:42.022444 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.028s	sys 0.027s
W20260709 13:08:42.022956 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.028s	sys 0.027s
W20260709 13:08:42.024326 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 560004us
I20260709 13:08:41.811892 21024 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:42.006496 21156 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.005s
I20260709 13:08:41.977960 21179 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.038218 21179 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.038143 21084 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.980481 21301 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.038653 21309 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.040391 21301 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.040674 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.043268 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.045895 15646 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:42.040686 21309 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.049890 21084 consensus_queue.cc:1048] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:41.978237 21314 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.046979 21156 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.048888 21153 consensus_queue.cc:1048] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:42.098917 16235 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:41.185058 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.104514 21310 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.110216 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.111107 15579 raft_consensus.cc:2393] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 16: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:42.112797 15720 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:42.114682 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.066591 21249 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:42.125131 21179 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.125737 21179 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.127904 21179 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.128516 21179 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.129052 21179 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.136299 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.099963 21309 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.139076 21309 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.140005 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.142083 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.145505 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.148535 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.149281 15651 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:42.152383 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:42.160984 21237 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.161706 21237 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.164354 21237 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.166317 21263 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:42.167025 21263 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.172703 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.173247 21263 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.178680 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.181856 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.188090 21249 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.195959 21249 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.196337 20886 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.196838 20886 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.197196 20886 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.181864 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.199038 21314 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.182667 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.206699 16272 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:42.211917 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.150012 21301 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.218299 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.213444 21249 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.227051 15573 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:42.227751 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.231366 16277 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:42.222451 16272 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:42.211968 21084 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.217844 21178 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.243451 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:42.214501 21036 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:08:42.249009 20766 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.248971 20915 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.249724 20766 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.250118 20766 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.251178 15647 raft_consensus.cc:2368] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15.
I20260709 13:08:42.234719 21179 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.235483 21156 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 21 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.233912 21314 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:42.221172 21301 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.265722 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.268072 21249 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:42.278780 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 689148us
I20260709 13:08:42.279681 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:42.281170 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.282223 21170 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.282922 21170 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:42.283129 20915 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.283289 21170 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.283753 21170 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.286252 21090 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.286741 21090 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.286979 21300 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.287698 15721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2657) took 1285 ms. Trace:
I20260709 13:08:42.288715 21090 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.289070 21300 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.289189 15722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44462 (request call id 2651) took 1296 ms. Trace:
I20260709 13:08:42.261976 21024 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.289599 15722 rpcz_store.cc:276] 0709 13:08:40.992373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.992503 (+   130us) service_pool.cc:224] Handling call
0709 13:08:40.992740 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.992910 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:41.411319 (+418409us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.600448 (+189129us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.288882 (+688434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.288934 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:42.288977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.289039 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.289142 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845577,"prepare.queue_time_us":308393,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":2702,"raft.queue_time_us":56158,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5270,"thread_start_us":485729,"threads_started":2}
I20260709 13:08:42.291839 16275 raft_consensus.cc:2368] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 16. Current term is 17.
I20260709 13:08:42.292343 21214 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.293018 20969 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:42.293629 21237 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.297181 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:42.297781 15572 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.286288 21301 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.299861 21283 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.300400 21283 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.300958 21090 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.301522 15693 leader_election.cc:400] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15.
I20260709 13:08:42.301435 21090 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.302177 21172 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.302434 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.302670 21172 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.303062 15579 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:42.303508 21090 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.304209 20606 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.304661 21172 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.292861 21214 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.306392 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.307027 15653 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 18.
I20260709 13:08:42.297719 15727 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:42.307457 21214 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.308254 21287 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.288074 15721 rpcz_store.cc:276] 0709 13:08:41.002725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.002849 (+   124us) service_pool.cc:224] Handling call
0709 13:08:41.003148 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:41.282691 (+279543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.282734 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:41.298139 (+ 15405us) log.cc:844] Serialized 52 byte log entry
0709 13:08:41.576610 (+278471us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:41.599799 (+ 23189us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.287377 (+687578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.287465 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.287509 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:42.287522 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.287647 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":696981,"prepare.queue_time_us":22105,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":776683,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":22912,"thread_start_us":521844,"threads_started":2,"wal-append.queue_time_us":338948}
I20260709 13:08:42.309680 15723 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:42.304699 20606 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.311708 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:42.311921 20606 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.314579 21283 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.315696 15692 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:42.317315 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.318342 21300 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.318831 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.319698 21301 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:42.323596 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.325188 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.326237 21314 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:42.326769 21314 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.327173 21314 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.327837 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.329643 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.330169 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.301869 15693 leader_election.cc:403] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.333871 15572 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:42.335107 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.336269 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.335316 16235 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:42.336565 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:42.337150 15653 raft_consensus.cc:3060] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:42.330760 15655 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:42.338487 16274 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 14: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:42.339658 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.341418 15693 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:42.342880 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.347854 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.349531 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.349790 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.354331 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.356189 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.343628 15720 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:42.358666 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.359048 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:42.359292 15655 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
I20260709 13:08:42.358666 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.360270 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.360540 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.360845 15651 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
W20260709 13:08:42.363211 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56850.4us
I20260709 13:08:42.384353 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.386256 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.386864 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:42.383607 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.387991 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.384569 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:42.389061 16274 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.389338 15693 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:42.390429 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.391139 16236 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.386163 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:42.393110 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.348665 21301 raft_consensus.cc:2804] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:42.405993 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.337217 21283 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.411020 21172 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.411212 15729 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:42.411573 21172 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.337059 21214 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.412693 21214 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.414765 21214 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.407519 15580 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 18.
I20260709 13:08:42.416702 21282 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.417184 21282 raft_consensus.cc:493] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.417517 21282 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.420009 21175 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:42.420351 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.421500 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:42.353016 21280 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.421597 21263 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:42.424666 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.424659 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.413717 21172 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.429288 21288 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.429695 20886 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.429888 21288 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.432037 20886 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.432178 21288 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.432857 16272 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:42.433295 21309 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.433969 21302 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.434548 21302 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.435269 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.436378 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.436935 16272 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:42.437268 21302 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.383494 21300 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:42.439047 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:42.458974 16270 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:42.441834 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.407557 15653 raft_consensus.cc:2468] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:42.444603 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.440694 21263 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.456081 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.455925 21170 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.394822 21118 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.464720 16236 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.465137 15649 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:42.465583 16274 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:42.466049 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.464496 16270 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:42.363518 21303 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:42.471673 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.478389 15618 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:42.480170 15692 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.482182 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.489073 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.513271 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.513585 15618 leader_election.cc:400] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 16. Current term is 17.
I20260709 13:08:42.514088 15618 leader_election.cc:403] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.515200 21178 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301) with higher term. Message: Invalid argument: T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a for earlier term 16. Current term is 17.
I20260709 13:08:42.517073 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.518929 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.519165 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.520299 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.520437 15727 raft_consensus.cc:1240] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:42.521096 15579 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:42.522858 15692 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.458694 21301 raft_consensus.cc:697] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:42.464192 21263 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.522362 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.468530 21118 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.471891 21303 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.472589 21309 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.488337 21214 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.565287 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.478117 21310 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.509817 21153 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:42.477641 21119 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.522367 21090 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.507150 21283 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.524322 21156 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:42.468432 21300 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.524040 21317 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:42.534150 21081 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.558290 21086 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:42.558195 21169 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.564356 21178 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.559285 21118 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.564226 21303 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:42.577981 21286 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:42.580133 21335 log.cc:927] Time spent T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:42.579723 21322 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:42.577386 21213 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.593868 21283 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.594955 21317 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:42.619354 21317 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.620260 21283 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.589900 21309 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:42.603642 21086 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.588074 21090 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.623301 21086 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.623750 21090 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:42.610168 21215 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:42.624729 21339 log.cc:927] Time spent T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:08:42.624477 21215 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.626683 21215 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.591861 21175 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.579424 21310 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.636358 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.609563 20862 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.633816 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.634423 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.653259 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.654942 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:42.659574 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.664407 15544 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.612018 21178 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.658073 21179 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.672519 15646 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:42.676936 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.682623 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.638114 21322 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:42.684567 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 165700us
I20260709 13:08:42.690797 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.650383 21080 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:42.616303 21301 consensus_queue.cc:237] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:42.732905 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 167591us
I20260709 13:08:42.736397 15692 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.665555 21228 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.665248 21208 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:42.740034 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.740701 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:42.670164 20606 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.665669 21250 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.692013 21290 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.750859 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 60299us
W20260709 13:08:42.752491 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 58548.7us
I20260709 13:08:42.757740 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.757846 15576 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:42.696550 21170 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.759792 16236 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.753149 21122 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.759053 21309 raft_consensus.cc:2749] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.746850 21090 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:42.772818 15692 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.774675 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:42.777781 15653 raft_consensus.cc:3060] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.748136 21208 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:42.753058 21119 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.778582 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.784003 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:42.745810 21314 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.817911 16273 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:42.818310 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.819821 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.821044 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:42.823063 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:42.819144 15722 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 14.
I20260709 13:08:42.797405 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
W20260709 13:08:42.816939 21346 log.cc:927] Time spent T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 13:08:42.758828 21153 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:42.824463 15649 raft_consensus.cc:606] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:42.780534 21170 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.761204 21290 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.842161 15653 raft_consensus.cc:2468] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:42.847718 15720 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:08:42.850443 15720 raft_consensus.cc:1240] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:42.838465 21279 raft_consensus.cc:3055] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:42.873855 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:42.874126 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 95663.7us
I20260709 13:08:42.838958 21300 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.785296 21353 raft_consensus.cc:2749] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:42.877279 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:42.776998 21122 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.882594 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:42.826885 21282 raft_consensus.cc:515] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.888820 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:42.889117 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.875329 21283 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:42.876607 21279 raft_consensus.cc:740] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:42.899534 15729 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:42.892927 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 122945us
I20260709 13:08:42.893146 21237 consensus_queue.cc:1059] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:42.887362 21090 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:42.890062 21287 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:42.899374 21178 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.866714 21208 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:42.919257 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:42.897164 21310 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:42.908769 21090 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.929441 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:42.931304 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554babfb4498479a98f58801621b0dac"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:42.931906 15573 raft_consensus.cc:606] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:42.910764 21280 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for earlier term 14. Current term is 15.
I20260709 13:08:42.909669 21287 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:42.930866 21348 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:42.972505 15723 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:42.987004 21290 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.987768 21122 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:42.988353 21350 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:42.917379 21311 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:08:42.999466 21282 leader_election.cc:290] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:42.962813 21215 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:43.001407 21351 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:08:42.895385 21153 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:42.962530 21090 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:42.965255 21208 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:42.968607 21287 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.010108 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.014873 16277 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 10.
I20260709 13:08:43.018283 21263 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.021350 21263 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.006724 21253 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:08:42.968024 21177 consensus_queue.cc:1175] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" responder_term: 21 status { last_received { term: 19 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 20. Current term is 21. Ops: [20.10-20.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:42.964887 21360 consensus_queue.cc:1059] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:08:43.025265 21360 raft_consensus.cc:3055] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:43.025635 21360 raft_consensus.cc:740] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:43.026521 21360 consensus_queue.cc:260] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.027734 21360 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.028956 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.030205 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:43.030905 20766 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.005s
I20260709 13:08:43.031435 20766 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.034821 15655 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:43.041095 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.039065 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.042135 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.044389 16270 raft_consensus.cc:2410] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:08:43.046144 16273 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:43.046979 16236 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:43.048344 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.048750 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.049013 15722 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 18.
I20260709 13:08:43.046567 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:42.966588 21279 consensus_queue.cc:260] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.050289 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:43.053742 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.055085 15692 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.032912 21321 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:43.057005 21356 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.054484 21300 raft_consensus.cc:2804] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.074589 21300 raft_consensus.cc:697] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:43.075848 21300 consensus_queue.cc:237] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.058246 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.060895 16236 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:43.079023 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.079813 21170 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:43.063814 21321 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.080683 21170 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.068290 21303 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.071233 21279 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.079995 21358 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:43.051452 20766 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:43.109279 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 141214us
I20260709 13:08:43.112473 15619 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.116484 15726 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 19: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:43.121565 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.122690 15721 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:43.122794 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.135439 21305 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.143589 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.146723 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:43.152987 15721 raft_consensus.cc:2393] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 18: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:43.114423 21287 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.118371 21118 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.166549 21212 consensus_queue.cc:1059] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:43.168913 21303 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:43.225354 15618 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.169373 21318 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:43.226011 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:43.171936 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.227033 15579 raft_consensus.cc:2393] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 19: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:43.172462 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:43.175770 21317 consensus_meta.cc:287] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
I20260709 13:08:43.142302 21321 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:43.176167 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 518802us
I20260709 13:08:43.230309 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.190356 21358 raft_consensus.cc:2764] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:08:43.234654 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 104286us
W20260709 13:08:43.178664 21349 log.cc:927] Time spent T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.295s	user 0.000s	sys 0.003s
I20260709 13:08:43.188567 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.237890 16272 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:43.189530 15655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:43.210307 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.214736 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.215349 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.217463 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.242830 15646 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.224387 21363 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.229254 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.235724 15653 raft_consensus.cc:1275] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:43.247901 21118 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.235100 21317 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.251849 21186 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:43.252671 21186 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.235251 21179 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:43.256807 21179 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.263175 21321 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.266615 21318 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.266772 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:43.267211 21318 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.271056 16275 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.273753 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.274376 15720 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.277107 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.285897 16275 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:43.219184 21305 raft_consensus.cc:493] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:43.289808 15653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:43.293807 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.314309 15651 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.300046 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.315183 15647 raft_consensus.cc:2368] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:43.302839 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eba092a851143659b8e87e62bb71b1c" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.303349 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.251839 21317 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.279913 21253 raft_consensus.cc:3055] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:43.338399 21253 raft_consensus.cc:740] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:43.305688 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.316290 15650 raft_consensus.cc:2393] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:43.317056 15646 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 19.
I20260709 13:08:43.327769 21179 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.329346 15720 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:43.292740 20862 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:43.354796 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 46331.5us
I20260709 13:08:43.363379 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.341764 21186 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.376274 16236 leader_election.cc:400] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:43.376713 16236 leader_election.cc:403] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.381464 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:43.351681 21310 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:43.403272 15693 leader_election.cc:304] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.356793 20862 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.417358 16236 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:43.356284 21119 consensus_queue.cc:1048] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:08:43.403782 21317 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 14. Current term is 15.
I20260709 13:08:43.427207 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.416625 20862 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.421711 21300 raft_consensus.cc:2804] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:43.422806 21302 raft_consensus.cc:2749] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.422699 21287 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.347030 21305 raft_consensus.cc:515] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.454469 21237 raft_consensus.cc:993] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:43.455037 21237 raft_consensus.cc:1081] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:43.288018 21363 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.421020 21090 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.465191 21305 leader_election.cc:290] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.467273 21090 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.453271 21300 raft_consensus.cc:697] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:43.468066 15727 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:43.473205 21369 log.cc:927] Time spent T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
I20260709 13:08:43.475845 21322 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.476588 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.477608 16275 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:43.479242 21363 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.468803 21300 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.453033 21318 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.484056 21318 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 election: Requested vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.452152 21253 consensus_queue.cc:260] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.485917 20862 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.489532 20862 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.491338 21314 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.498764 21179 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.510602 21253 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:43.563510 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 130922us
W20260709 13:08:43.571803 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 302277us
I20260709 13:08:43.572150 15478 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.576550 15478 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:43.587512 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:43.590996 15475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 372) took 9005 ms. Trace:
I20260709 13:08:43.592747 15478 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 6 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 12 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:43.596434 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 157823us
I20260709 13:08:43.598709 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.606050 15653 raft_consensus.cc:2368] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 18. Current term is 19.
I20260709 13:08:43.611598 15654 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:43.612596 15655 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:43.655599 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.616590 15692 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.660106 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:43.617955 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.662774 15651 raft_consensus.cc:2393] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 15: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:43.662585 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.597538 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:43.663590 15720 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 11.
I20260709 13:08:43.663856 15577 raft_consensus.cc:3060] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:43.664397 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:43.625367 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:43.635437 16271 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.666368 15649 raft_consensus.cc:606] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.636490 16275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f560ec7039940e59212368b2f12385e"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:08:43.666793 15649 raft_consensus.cc:614] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.667256 16275 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.667755 16275 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.669978 15722 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:43.636703 15621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.671829 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.672755 16277 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.636868 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:43.673825 16273 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:43.665717 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.674568 15720 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.594532 15573 raft_consensus.cc:1275] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:43.676625 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.674651 15478 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 8 to 9, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:43.590003 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:43.691143 15478 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.683818 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:43.703683 15649 raft_consensus.cc:606] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:43.707067 20915 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:43.706712 15478 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.708729 15478 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:43.712158 20915 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:43.689236 15720 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 19.
I20260709 13:08:43.582058 15544 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:43.642220 15475 rpcz_store.cc:276] 0709 13:08:34.585791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.586372 (+   581us) service_pool.cc:224] Handling call
0709 13:08:43.590751 (+9004379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:39.766169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:39.766757 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:39.766793 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:39.766811 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:39.768644 (+  1833us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:39.768715 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:39.768745 (+    30us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:08:39.797547 (+ 28802us) tablet.cc:701] Row locks acquired
0709 13:08:39.797570 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:08:39.797728 (+   158us) write_op.cc:270] Start()
0709 13:08:39.797852 (+   124us) write_op.cc:276] Timestamp: P: 1783602519797674 usec, L: 0
0709 13:08:39.797876 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:39.798802 (+   926us) log.cc:844] Serialized 9483 byte log entry
0709 13:08:40.193541 (+394739us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.429062 (+235521us) write_op.cc:301] APPLY: starting
0709 13:08:40.429172 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:40.578266 (+149094us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:40.578405 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:40.737472 (+159067us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:40.737814 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 13:08:40.737866 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:40.738335 (+   469us) log.cc:844] Serialized 212 byte log entry
0709 13:08:40.739085 (+   750us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.739274 (+   189us) write_op.cc:454] Released schema lock
0709 13:08:40.739337 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:40.739694 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.739723 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":428738,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":214417,"apply.run_cpu_time_us":30460,"apply.run_wall_time_us":310616,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":277595,"prepare.run_cpu_time_us":34566,"prepare.run_wall_time_us":135207,"raft.queue_time_us":199186,"raft.run_cpu_time_us":25594,"raft.run_wall_time_us":275411,"replication_time_us":372091,"thread_start_us":660717,"threads_started":4,"wal-append.queue_time_us":119440,"wal-append.run_cpu_time_us":24436,"wal-append.run_wall_time_us":1856709}]]}
I20260709 13:08:43.713969 21024 raft_consensus.cc:993] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:43.685086 16236 leader_election.cc:400] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 18. Current term is 19.
I20260709 13:08:43.716403 16236 leader_election.cc:403] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.718701 16277 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 19.
I20260709 13:08:43.717744 16275 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.724627 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:43.726245 15649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c036f4b115e847feb37d916989af7159"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:43.726475 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.727475 15649 raft_consensus.cc:606] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:43.727995 15649 raft_consensus.cc:614] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.732489 15577 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:43.733307 16273 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:43.721938 15478 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 11 to 12, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 12 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:43.734236 21312 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:43.739542 21356 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:43.740131 21356 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:43.740546 21356 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:43.741032 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.739447 21086 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.744347 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.742411 21090 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:43.753407 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:43.777339 15722 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:43.754951 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 70313.4us
I20260709 13:08:43.756282 21119 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 18. Current term is 19.
I20260709 13:08:43.757800 21357 raft_consensus.cc:1081] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
W20260709 13:08:43.759096 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 101083us
I20260709 13:08:43.784243 15618 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:43.786688 21363 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:43.787448 21363 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:43.788887 21363 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.761730 15619 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:43.762750 20766 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:43.790815 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67565.7us
I20260709 13:08:43.770960 20862 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:43.774144 21321 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:43.795462 21280 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:43.795409 21119 consensus_queue.cc:1048] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:43.796303 21280 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.790907 20766 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:43.796702 15721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:08:43.798992 20766 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:43.799437 15721 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.799901 15721 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.800258 20766 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.799851 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:43.802313 15651 raft_consensus.cc:606] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:43.802711 15651 raft_consensus.cc:614] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.799794 21090 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:43.803985 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.804401 21090 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.805086 21119 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:43.806452 21280 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.806860 21090 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.804003 21086 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:43.808100 21086 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:43.819558 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:43.821841 21086 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:43.822441 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.823727 15651 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:43.826797 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:43.793130 20862 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:43.828539 20862 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.830205 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.833738 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.834690 15721 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.838431 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:43.839107 15573 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:43.849186 15722 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:43.851676 16276 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:43.856765 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.857424 15651 raft_consensus.cc:3055] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:43.857854 15651 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:43.858362 15721 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:43.857291 15618 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:43.861461 15573 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:43.861490 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2176261a314ecdb0b1c0ff764de958" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.918581 16275 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:43.932678 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:43.932456 21356 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.922411 15728 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:43.934796 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 77678.9us
I20260709 13:08:43.938566 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.938966 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.940140 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.940852 21317 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:43.941704 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 57167.5us
W20260709 13:08:43.922484 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 346801us
I20260709 13:08:43.923296 21305 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:43.943192 15478 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:43.950839 15579 raft_consensus.cc:1240] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:43.946404 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:43.953025 15571 raft_consensus.cc:2393] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 12: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
I20260709 13:08:43.954478 15692 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:43.955973 15725 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:43.959333 21356 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:43.961093 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.967373 15545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.973804 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:43.950908 15651 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:43.984647 15651 raft_consensus.cc:3060] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:43.988978 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 104328us
W20260709 13:08:44.006402 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48021.4us
I20260709 13:08:44.008814 15618 leader_election.cc:304] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:44.009617 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 8995ef9978c446769377fc0e9a0cb9c1 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:44.015661 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:44.001303 21356 raft_consensus.cc:2804] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:44.019927 21392 log.cc:927] Time spent T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.140s	user 0.004s	sys 0.000s
I20260709 13:08:43.995934 21305 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.023667 15478 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:44.040093 15650 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:44.024768 21305 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:44.001709 15649 raft_consensus.cc:3055] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.041231 15649 raft_consensus.cc:740] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:44.026180 20869 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:44.026623 15724 raft_consensus.cc:1275] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:44.026954 21270 raft_consensus.cc:2749] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.036298 15729 raft_consensus.cc:1240] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:44.039419 15478 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 7 to 10, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 10 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:44.025333 21024 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.981419 21363 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.041986 20869 raft_consensus.cc:3055] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.055316 21356 raft_consensus.cc:697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:44.041981 15649 consensus_queue.cc:260] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.056555 15649 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.056397 21356 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:44.057404 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:44.058264 15725 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:44.060320 21175 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.053414 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.068897 15579 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:44.071761 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 63054.9us
I20260709 13:08:44.069926 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.068868 21270 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:44.062261 21086 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:44.055364 20869 raft_consensus.cc:740] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:44.090256 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:44.090914 15725 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.094403 21213 raft_consensus.cc:2749] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:44.094646 21090 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:44.081163 21086 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.096946 21322 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:44.098730 21086 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:44.098768 21322 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:44.079633 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.114554 15651 raft_consensus.cc:2468] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:44.115648 15649 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:44.119189 15618 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.130748 16275 raft_consensus.cc:1240] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:44.111505 21086 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:44.134735 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:44.128986 15478 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.132907 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:44.152704 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:44.155033 15692 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.156085 15728 raft_consensus.cc:3060] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.118778 21321 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:08:44.175256 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 59784us
I20260709 13:08:44.174561 15478 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 8 to 9, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:44.153410 20915 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:44.170290 15725 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:44.135990 21175 consensus_queue.cc:1048] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:08:44.173511 21213 raft_consensus.cc:2749] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:44.187084 15724 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:44.188060 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.193339 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:44.200673 15579 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:44.205291 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:44.207938 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:44.207780 21250 consensus_queue.cc:1059] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:44.209354 16236 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:44.212946 21179 raft_consensus.cc:2804] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:44.213585 21179 raft_consensus.cc:697] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:44.214668 21179 consensus_queue.cc:237] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.225026 21312 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:44.176559 21322 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:44.231828 16277 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:44.284335 15478 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 5 to 7, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:44.287936 21018 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.288543 21018 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:44.293119 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:44.294997 21018 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:44.296161 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:44.296555 15728 raft_consensus.cc:2468] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:44.297255 15725 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:44.307111 15544 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:44.312747 15619 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:44.317233 15478 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.346203 21291 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:44.346695 21291 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.356509 15478 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.358785 15478 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 7 to 9, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 9 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:44.346192 21228 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:44.347074 21291 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:44.381379 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 193391us
I20260709 13:08:44.390089 21119 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.395437 21228 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:44.410285 21228 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.463795 20869 consensus_queue.cc:260] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.465521 20869 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:44.483281 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:44.490139 21024 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.500597 15727 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:44.502111 16271 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:44.505786 16269 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:44.542186 15654 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:44.543206 21322 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:44.549048 21399 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:08:44.541864 15655 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:44.556169 15725 raft_consensus.cc:1275] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:44.556559 15729 raft_consensus.cc:1275] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:44.554075 15726 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:44.589067 21024 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:44.590234 21256 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:44.602192 21305 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:44.574162 21357 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.700754 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 65408.4us
W20260709 13:08:44.701766 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 71568.8us
I20260709 13:08:44.583540 21270 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:08:44.567023 21282 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:08:44.584630 21291 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:44.722070 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 102524us
I20260709 13:08:44.727216 21374 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:08:44.727938 21401 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:44.729496 21414 consensus_queue.cc:1048] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:44.725397 21213 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.738620 21356 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.794070 21321 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:44.797511 20915 consensus_meta.cc:287] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.000s
I20260709 13:08:44.794668 21291 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:44.808068 20667 consensus_queue.cc:1059] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:44.794817 21321 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:44.804062 21213 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:44.754767 21357 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:44.814706 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45927.3us
I20260709 13:08:44.826422 21290 consensus_queue.cc:1048] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:08:44.838603 21291 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.839354 21291 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:44.842351 21405 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 13:08:44.846536 21357 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:44.809551 21401 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:44.887069 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 102040us
W20260709 13:08:44.884721 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 93443.8us
I20260709 13:08:44.812175 20915 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:44.913882 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 103853us
I20260709 13:08:44.801401 21356 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:44.929152 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 94644.7us
I20260709 13:08:44.922236 21253 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:44.945000 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:44.950567 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 73764.5us
I20260709 13:08:44.958732 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
W20260709 13:08:44.976181 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 128410us
I20260709 13:08:44.999904 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:45.003620 15576 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:45.003774 21324 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:45.004405 21324 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:45.015396 21422 log.cc:927] Time spent T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:08:45.021474 21213 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:45.024591 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.033648 15651 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12.
I20260709 13:08:45.049808 15654 raft_consensus.cc:2410] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:08:45.059926 21321 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:45.061444 21401 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:45.007752 21215 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:44.978585 21253 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:45.062976 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.100090 21356 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:45.105659 21215 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:45.107163 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 188309us
I20260709 13:08:45.112895 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:45.124460 15573 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:45.127554 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:45.128573 15728 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:45.153168 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.152689 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.153841 15654 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:45.158722 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:45.156193 15650 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:45.157733 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:45.121402 21324 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:45.159683 15578 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 20.
I20260709 13:08:45.161573 16269 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:45.167271 21215 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:45.168243 21253 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:45.098500 21086 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:08:45.155880 21421 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:45.198078 21421 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.200868 21421 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:45.181114 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:45.183069 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:45.202457 15729 raft_consensus.cc:2393] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 17: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:45.185632 15721 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:45.201905 15722 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 21: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:45.188194 21424 raft_consensus.cc:3055] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:45.189002 15573 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 18.
I20260709 13:08:45.193112 21447 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.214574 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:45.204722 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.204988 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:45.209209 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 85139us
I20260709 13:08:45.215602 15654 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 21.
I20260709 13:08:45.218851 15650 raft_consensus.cc:2368] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 17. Current term is 18.
I20260709 13:08:45.221465 15649 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:45.230967 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:45.209141 21424 raft_consensus.cc:740] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:45.248307 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.249224 15650 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:45.246515 15693 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:45.259992 15721 raft_consensus.cc:1240] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:45.258502 21215 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:45.266801 16275 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:45.267848 21437 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:45.268306 21437 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:45.268707 21437 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:45.240314 21447 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.272598 21424 consensus_queue.cc:260] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.273808 21424 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:45.275664 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 150089us
I20260709 13:08:45.278555 15693 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:45.286265 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:45.277230 21282 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:45.288291 21280 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:45.331239 21280 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.331691 21280 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.337494 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:45.349726 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:45.335062 15618 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:45.386643 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:45.387594 15579 raft_consensus.cc:2410] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:08:45.387349 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47055.9us
W20260709 13:08:45.399236 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 61844.9us
I20260709 13:08:45.400144 15544 leader_election.cc:400] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 17. Current term is 18.
I20260709 13:08:45.400491 15544 leader_election.cc:403] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.401871 16236 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:08:45.443014 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 108091us
I20260709 13:08:45.326174 21447 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:45.449990 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.453009 21263 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:45.446528 21450 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:45.441700 21324 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871) with higher term. Message: Invalid argument: T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 17. Current term is 18.
W20260709 13:08:45.534296 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 76532.7us
I20260709 13:08:45.455065 21263 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:45.540323 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:45.419195 21119 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:08:45.546265 21433 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:45.457552 21450 raft_consensus.cc:493] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:45.535298 21356 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.543658 21263 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:45.595448 21431 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:45.604161 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 68005.3us
I20260709 13:08:45.568222 21450 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.606775 21086 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:45.590955 21356 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:45.678344 21400 log.cc:927] Time spent T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:45.692175 21449 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.692850 21449 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:45.696121 21448 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:08:45.698863 21452 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:45.710237 21462 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.710913 21462 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.713340 21462 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:45.803678 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 78960.6us
I20260709 13:08:45.677206 21086 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:45.862329 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 218157us
W20260709 13:08:45.835781 21321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.032s
I20260709 13:08:45.818641 21090 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:45.909741 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.873025 21321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.000s	sys 0.033s
I20260709 13:08:45.932070 21356 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:45.932690 21356 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:45.933107 21086 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:45.933197 21356 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.917114 21090 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:45.876546 21324 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:45.953328 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:45.984858 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 55732.3us
W20260709 13:08:45.954416 21280 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:08:45.984197 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:45.943523 21437 consensus_meta.cc:287] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
W20260709 13:08:45.940447 21424 consensus_meta.cc:287] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:08:45.990733 20667 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.008371 21472 raft_consensus.cc:493] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:46.012287 21431 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.014166 21291 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.015970 21464 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:08:46.016927 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 808439us
I20260709 13:08:45.938174 21416 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:45.951064 21417 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.027238 21090 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.017376 21280 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.080988 21280 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.030660 21356 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.032573 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.039040 21321 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.033732 20667 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.059288 21464 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.061363 21449 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.054239 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.093603 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:46.053063 21439 log.cc:927] Time spent T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.994s	user 0.006s	sys 0.010s
I20260709 13:08:46.094483 15722 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:46.100948 15721 raft_consensus.cc:1275] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:46.031719 21437 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.107353 15724 raft_consensus.cc:2368] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
I20260709 13:08:46.089007 21253 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
W20260709 13:08:46.105718 15544 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.34.130:44871 timed out after 1.781s (SENT) [suppressed 2 similar messages]
I20260709 13:08:46.088438 21321 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.092499 21280 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.130120 15578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41396 (request call id 2344) took 1171 ms. Trace:
I20260709 13:08:46.037555 21450 raft_consensus.cc:515] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.091974 21018 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.131569 15578 rpcz_store.cc:276] 0709 13:08:44.944540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.944740 (+   200us) service_pool.cc:224] Handling call
0709 13:08:46.115511 (+1170771us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400175f54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:46.115612 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491987840}
I20260709 13:08:46.132819 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.134768 15721 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:46.136292 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.064162 21431 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.035893 21472 raft_consensus.cc:515] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.082333 21417 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.081609 21416 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.148373 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.139036 21215 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.153247 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.155619 21463 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.159307 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.162886 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.143915 21465 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.170840 15654 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:46.176240 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.129766 21253 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.172712 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.187444 21321 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.188832 21416 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.189023 21437 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.164036 21215 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.190640 20667 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.191565 21253 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:46.193430 21263 consensus_meta.cc:287] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.001s
I20260709 13:08:46.193903 21263 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.194231 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.196034 21263 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 21 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.199373 21472 leader_election.cc:290] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.200069 15655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2860) took 1590 ms. Trace:
I20260709 13:08:46.200879 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.202117 21431 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:46.179395 15651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2850) took 1968 ms (client timeout 1781 ms). Trace:
I20260709 13:08:46.203049 21464 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.204569 21450 leader_election.cc:290] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.207943 21417 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:46.170717 21463 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.210757 21463 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:46.145754 21018 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.224615 21018 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.227573 21215 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:46.202848 15651 rpcz_store.cc:269] 0709 13:08:44.201227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.207662 (+  6435us) service_pool.cc:224] Handling call
0709 13:08:46.169663 (+1962001us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400155c54. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a172fa 00007f2d9a9d8b17 00007f2d93f536d4 00007f2d93f53662 00007f2d93f53591 00007f2d93f5350c 00007f2d93f527c2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:46.169814 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643348224}
I20260709 13:08:46.179062 21465 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.230868 21465 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.151043 21280 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.233124 21280 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.184376 16236 leader_election.cc:400] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
W20260709 13:08:46.234493 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 50321.8us
I20260709 13:08:46.235275 16236 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:46.161223 21086 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.236162 21086 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.238487 21086 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.160238 21470 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.239159 21470 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.241240 21470 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.222334 21440 consensus_queue.cc:1048] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:46.245594 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 139902us
I20260709 13:08:46.261998 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.262895 16272 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:46.267210 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.267951 15727 raft_consensus.cc:3060] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.269837 15618 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:46.200479 15655 rpcz_store.cc:276] 0709 13:08:44.609665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.616983 (+  7318us) service_pool.cc:224] Handling call
0709 13:08:44.635268 (+ 18285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.806519 (+171251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.806564 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.812303 (+  5739us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.957836 (+145533us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:44.957884 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.957964 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:46.052506 (+1094542us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b4400022b4c. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d9284cc85 00007f2d9284d6a2 00007f2d955bf1db 00007f2d955baaaf 00007f2d955ae86e 00007f2d955adbb6 00007f2d955ad7d8 00007f2d955b7221 00007f2d955b71d9 00007f2d955b7169
0709 13:08:46.174143 (+121637us) raft_consensus.cc:1685] finished
0709 13:08:46.174173 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.199982 (+ 25809us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47283,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19408,"spinlock_wait_cycles":10895232,"thread_start_us":141964,"threads_started":2,"wal-append.queue_time_us":173159}
I20260709 13:08:46.274606 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.275484 15722 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 21.
I20260709 13:08:46.278172 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.279083 15728 raft_consensus.cc:2393] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 17: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:46.284230 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:46.284789 16271 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.311604 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:46.311848 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.314638 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:46.325709 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.323529 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3913ed9e5b4674a9091483756deadf" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.327533 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.328117 15728 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:46.336301 15618 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:46.338892 15650 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 15.
I20260709 13:08:46.306429 21472 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.344926 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.349308 21445 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.349786 21445 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.350157 21445 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.340821 21018 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.352417 15652 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 21.
I20260709 13:08:46.352777 21018 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.354185 21363 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:08:46.354545 21475 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:08:46.345208 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.303170 20667 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.358347 20667 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.360627 20667 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.363780 21018 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.335222 21256 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:46.366439 21256 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.369364 21256 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.370599 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.370972 15692 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.373235 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.373813 21282 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.373921 16272 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:46.374301 21477 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.374413 21282 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.374886 21477 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.375723 21086 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:46.376659 21282 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.377013 21477 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.378129 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.379658 21402 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.380224 21402 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.373350 21463 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.382958 21463 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.385316 21402 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.393460 21470 raft_consensus.cc:493] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.394013 21470 raft_consensus.cc:515] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.400110 15618 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.402760 21420 raft_consensus.cc:3060] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:46.403117 15654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2872) took 1066 ms. Trace:
I20260709 13:08:46.403559 15654 rpcz_store.cc:276] 0709 13:08:45.337003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.337123 (+   120us) service_pool.cc:224] Handling call
0709 13:08:46.170402 (+833279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.171490 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.402920 (+231430us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400155c50. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a128ad 00007f2d9a9d7419 00007f2d93f4ebd4 00007f2d93f4eb62 00007f2d93f4ea91 00007f2d93f4ea0c 00007f2d93f4dcc2 00007f2d93d4e48c 00007f2d93d4d8c6 00007f2d93d4d26f
0709 13:08:46.403059 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915696000}
I20260709 13:08:46.334487 21458 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.419752 21458 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.422802 21472 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.332459 21024 raft_consensus.cc:2804] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:46.456044 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 56031us
I20260709 13:08:46.458920 16271 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:46.459050 16236 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:46.471931 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.472684 15654 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:46.477109 21463 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:46.478665 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.475121 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.479418 15574 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:46.480485 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.481699 15574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.482699 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.483892 15577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.484935 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.485572 15571 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 17.
I20260709 13:08:46.495339 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.500171 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.507659 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.508384 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.509109 15728 raft_consensus.cc:2393] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 15: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:46.509248 15619 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:46.510068 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.511312 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:46.507016 15729 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:46.515054 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.515386 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.516642 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.522945 15729 raft_consensus.cc:2368] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
I20260709 13:08:46.524547 15578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.532487 15571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.525535 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.526991 15575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.529003 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:46.529165 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.526924 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.528247 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.534909 15579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.535415 15576 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:46.531183 15692 leader_election.cc:304] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:46.544617 21463 raft_consensus.cc:2804] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:46.545334 21463 raft_consensus.cc:697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:46.546859 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.546574 21463 consensus_queue.cc:237] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.548131 21417 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.550448 16236 leader_election.cc:400] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
I20260709 13:08:46.550823 16236 leader_election.cc:403] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.552786 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.505908 21466 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:46.564080 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.580227 21434 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.580431 21270 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:46.581000 21270 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.580940 21434 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.581413 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.581538 21270 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.600059 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.572382 21179 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:46.554046 21429 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.611497 15692 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.612500 15729 raft_consensus.cc:2393] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 21: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:46.633442 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.635869 21434 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.637009 21472 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.585606 21417 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333) with higher term. Message: Invalid argument: T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 16. Current term is 17.
I20260709 13:08:46.596239 21024 raft_consensus.cc:697] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:46.644438 21374 raft_consensus.cc:493] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:46.670863 21374 raft_consensus.cc:515] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.671780 21363 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.672257 21363 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:46.614825 21179 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:46.682516 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.683353 15723 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 17.
I20260709 13:08:46.644620 21483 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.641664 21482 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.640319 21458 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.645421 21470 leader_election.cc:290] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:46.663403 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 154106us
I20260709 13:08:46.685920 21179 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.649024 21429 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.735870 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:08:46.736776 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 255206us
I20260709 13:08:46.741667 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.744037 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:46.729697 15693 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
W20260709 13:08:46.733680 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 122273us
I20260709 13:08:46.751061 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:46.763906 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.765149 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.756984 15693 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.768162 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.769629 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.772912 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.773218 15693 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.755000 21431 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:46.759683 21482 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:46.774886 21401 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:46.789604 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.766299 21478 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.779649 21090 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.799314 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.788553 21431 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.804733 21431 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:46.781275 21497 raft_consensus.cc:493] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:46.805604 21497 raft_consensus.cc:515] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.782462 21482 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.807992 21482 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.805852 15572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:46.782929 21402 raft_consensus.cc:2749] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.786355 21280 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:46.818204 15727 consensus_meta.cc:287] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.015s
I20260709 13:08:46.821360 15727 raft_consensus.cc:2468] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 18.
I20260709 13:08:46.822525 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.830854 21445 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.832149 16275 raft_consensus.cc:2393] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 16: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:46.833705 21445 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.835492 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:46.836148 15580 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.837652 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "363fa81d735347758e73efea5dc3fae6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:46.840556 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.792595 21024 consensus_queue.cc:237] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.858348 15580 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:46.860605 16235 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:46.862797 15727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.863632 15727 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:46.874490 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.862159 21374 leader_election.cc:290] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:46.884577 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b413aeb892643a1af655defc3b03c4d" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.885262 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:46.863044 21445 raft_consensus.cc:2804] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:46.887895 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73e75e796664f8198da4aa0a96ea07a" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.889773 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.890404 15651 raft_consensus.cc:2468] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 14.
I20260709 13:08:46.885838 15648 raft_consensus.cc:2376] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 12. Re-sending same reply.
I20260709 13:08:46.896200 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9faf7687b644b6871b03c7adb9f3e3" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.897681 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.904867 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:46.906500 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.908409 21256 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:46.881464 21482 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.893169 21270 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:46.928153 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.919203 21324 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.919912 21256 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.930374 21256 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.932050 21497 leader_election.cc:290] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.933892 15722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.922358 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.937980 15544 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.940320 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.942307 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.943037 21463 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:46.943455 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.944177 21488 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:46.944852 15693 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.945559 21488 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:46.953044 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:46.953826 15728 raft_consensus.cc:2393] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 13: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:46.954797 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:46.955551 15580 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:46.956394 21270 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.956769 21280 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.958487 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:46.918785 21445 raft_consensus.cc:697] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:46.957280 21280 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:46.957468 21437 raft_consensus.cc:2764] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:46.975509 15544 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:46.978896 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 67887.5us
I20260709 13:08:46.978300 15544 leader_election.cc:304] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.980907 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.981305 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7551fe74b4949e1b7ca08793d185c8f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.981855 15729 raft_consensus.cc:2376] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 18. Re-sending same reply.
I20260709 13:08:46.985000 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:46.989705 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:46.990329 15721 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:46.995524 15580 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:46.998716 15692 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:47.000584 21463 raft_consensus.cc:2804] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:47.001067 21463 raft_consensus.cc:697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:47.001597 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.002205 21441 raft_consensus.cc:493] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:47.002390 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:47.003100 15728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:47.037359 15728 raft_consensus.cc:3060] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:46.984195 21402 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.006048 21429 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:46.990892 21415 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:46.981819 20862 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.001902 21463 consensus_queue.cc:237] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:47.017097 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:47.026647 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.039353 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:46.979990 21363 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:47.045130 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 66946.9us
I20260709 13:08:47.041388 15721 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 18.
I20260709 13:08:47.051509 21450 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.069777 21280 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:47.106611 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:47.107316 15580 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:47.069895 21445 consensus_queue.cc:237] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:47.074385 21256 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:47.112537 21256 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:47.076406 21118 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:47.078626 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:47.114790 15650 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:47.079658 15544 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:47.116030 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:47.116549 15544 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:47.116882 21488 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:47.117368 21488 raft_consensus.cc:493] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.117730 21488 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.082193 21496 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.118707 21324 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:47.119241 21324 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:47.120122 21324 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.123454 21425 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:47.124004 21425 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:47.124833 21425 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.126197 20862 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:47.126694 21420 consensus_meta.cc:287] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: Time spent flushing consensus metadata: real 0.723s	user 0.017s	sys 0.010s
I20260709 13:08:47.049384 21467 raft_consensus.cc:2749] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.050350 21441 raft_consensus.cc:515] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:47.139093 21441 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:47.139832 16273 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 11.
I20260709 13:08:47.092880 21363 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 22 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:47.060870 21179 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:47.146498 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 85319.4us
I20260709 13:08:47.129065 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.063069 21482 leader_election.cc:290] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:47.149904 15544 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:47.129479 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 60252.1us
I20260709 13:08:47.131376 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:47.135994 21488 raft_consensus.cc:515] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.142560 15728 raft_consensus.cc:2468] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
W20260709 13:08:47.142935 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 98421.9us
I20260709 13:08:47.144510 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:47.154685 15580 raft_consensus.cc:2368] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13.
I20260709 13:08:47.152145 16274 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:47.160737 16235 leader_election.cc:400] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13.
I20260709 13:08:47.161077 16235 leader_election.cc:403] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.166760 21488 leader_election.cc:290] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:47.167418 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:47.168004 15721 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:47.168308 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:47.168897 15650 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.170089 15544 leader_election.cc:304] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.169802 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6936bd27314fcb82914d68a6cae45e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:47.178830 15618 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.143718 21420 raft_consensus.cc:2749] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:47.183838 15721 raft_consensus.cc:2468] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 22.
I20260709 13:08:47.178939 21431 raft_consensus.cc:3060] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:47.206938 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:47.174221 15543 leader_election.cc:304] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:47.218039 21423 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.153167 21256 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.226464 21179 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:47.227861 15580 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 18: Already voted for candidate 8995ef9978c446769377fc0e9a0cb9c1 in this term.
W20260709 13:08:47.228472 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 54348.3us
I20260709 13:08:47.229717 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b3d9415f6fb48709a2c4782cbf5ed31" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:47.230139 21212 raft_consensus.cc:2764] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:47.234462 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:47.233700 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96efb5d87b14ca19297799c72e797f0" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:47.238503 16274 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
W20260709 13:08:47.246819 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 65985.4us
I20260709 13:08:47.171170 21424 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:47.252444 15619 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.259927 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.260619 15650 raft_consensus.cc:2468] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:47.261816 15693 leader_election.cc:304] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.283808 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:47.300375 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 52831.6us
I20260709 13:08:47.303900 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:47.304956 15721 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 18: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:47.309345 15618 leader_election.cc:304] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:47.310737 21364 raft_consensus.cc:2749] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.312963 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:47.306146 21290 raft_consensus.cc:2804] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:47.314702 21290 raft_consensus.cc:697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:47.315609 21290 consensus_queue.cc:237] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.304103 21280 raft_consensus.cc:2804] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:47.320359 21280 raft_consensus.cc:697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:47.321285 21280 consensus_queue.cc:237] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.338171 15654 raft_consensus.cc:2468] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:47.277252 21497 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.345027 16275 raft_consensus.cc:1240] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Rejecting Update request from peer 680390d3f0884c91bf1f22ba914b438a for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:47.348611 21291 raft_consensus.cc:2749] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.350265 15648 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:47.352821 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 90992us
I20260709 13:08:47.363324 15646 raft_consensus.cc:2393] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8995ef9978c446769377fc0e9a0cb9c1 in current term 18: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
I20260709 13:08:47.360180 21431 raft_consensus.cc:2749] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) with higher term. Message: Invalid argument: T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d for earlier term 12. Current term is 13.
W20260709 13:08:47.396564 15478 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 350) took 28946 ms (client timeout 15000 ms). Trace:
W20260709 13:08:47.397037 15478 rpcz_store.cc:269] 0709 13:08:18.468636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.479354 (+ 10718us) service_pool.cc:224] Handling call
0709 13:08:47.396442 (+28917088us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.715589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.716338 (+   749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.716392 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:44.716414 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:44.753240 (+ 36826us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.753383 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.753426 (+    43us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:44.766625 (+ 13199us) tablet.cc:701] Row locks acquired
0709 13:08:44.766696 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:08:44.766938 (+   242us) write_op.cc:270] Start()
0709 13:08:44.767133 (+   195us) write_op.cc:276] Timestamp: P: 1783602524766855 usec, L: 0
0709 13:08:44.767185 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.827431 (+ 60246us) log.cc:844] Serialized 6754 byte log entry
0709 13:08:44.951772 (+124341us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.173214 (+221442us) write_op.cc:301] APPLY: starting
0709 13:08:45.173325 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.453095 (+279770us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.453218 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.582592 (+129374us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597c571 00007f2d95a0ee28 00007f2d99449581 00007f2d99448d58 00007f2d9944d9f1 00007f2d9944d9a9 00007f2d9944d939 00007f2d9944d901 00007f2d9944cb2d 000000000038f354 000000000038f199
0709 13:08:46.416603 (+834011us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:46.417018 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:08:46.417082 (+    64us) write_op.cc:312] APPLY: finished
0709 13:08:46.417521 (+   439us) log.cc:844] Serialized 156 byte log entry
0709 13:08:46.522597 (+105076us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.572270 (+ 49673us) write_op.cc:454] Released schema lock
0709 13:08:46.595182 (+ 22912us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:46.632801 (+ 37619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:46.632835 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55174,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":207267,"apply.run_cpu_time_us":38371,"apply.run_wall_time_us":1460900,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":115947,"prepare.run_cpu_time_us":50026,"prepare.run_wall_time_us":867243,"raft.queue_time_us":2798,"raft.run_cpu_time_us":76594,"raft.run_wall_time_us":115830,"replication_time_us":184422,"spinlock_wait_cycles":13479296,"thread_start_us":400612,"threads_started":5,"wal-append.queue_time_us":413541,"wal-append.run_cpu_time_us":5057,"wal-append.run_wall_time_us":1009288}]]}
I20260709 13:08:47.368728 21482 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 13:08:47.439746 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 239528us
I20260709 13:08:47.440541 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.443519 15476 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.451421 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:47.459285 21450 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.459676 15476 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 4 to 6, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 6 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.460373 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:47.461041 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f560ec7039940e59212368b2f12385e" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:47.461941 21242 consensus_queue.cc:1059] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:47.475286 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:47.446244 21440 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:47.483896 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:47.485028 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:47.483027 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:47.498538 16277 raft_consensus.cc:1275] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:47.498584 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:47.501413 15692 leader_election.cc:304] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:47.506579 21402 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:47.521102 15476 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 11 to 8, leader changed from <none> to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 8 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.524489 16275 raft_consensus.cc:2468] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
W20260709 13:08:47.526475 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 124989us
W20260709 13:08:47.538369 21507 log.cc:927] Time spent T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:47.513108 21356 raft_consensus.cc:2749] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.542201 15723 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:08:47.543633 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 47377.4us
I20260709 13:08:47.551052 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.584548 20862 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:47.551910 21291 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:47.550998 21356 consensus_queue.cc:1048] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 13:08:47.592115 21515 log.cc:927] Time spent T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:08:47.598502 15721 raft_consensus.cc:1240] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:47.598687 15573 raft_consensus.cc:1275] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:47.607357 21374 consensus_queue.cc:1059] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:08:47.617630 21374 consensus_queue.cc:1243] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 0afe96ac1d4a48728e3ac0814d8867b1 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:47.618131 21513 raft_consensus.cc:3055] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.606835 21421 consensus_queue.cc:1048] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:47.618618 21513 raft_consensus.cc:740] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:47.619488 21513 consensus_queue.cc:260] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.628051 21363 raft_consensus.cc:3055] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:47.628558 21363 raft_consensus.cc:740] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:47.629305 21363 consensus_queue.cc:260] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:47.642555 21513 raft_consensus.cc:3060] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.662254 21363 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:47.667129 16275 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:47.678050 21090 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:47.681237 16236 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:47.696795 21450 raft_consensus.cc:2749] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:47.732367 15646 raft_consensus.cc:1240] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 LEADER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:47.753221 15580 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:47.755681 21212 consensus_queue.cc:1059] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:47.756575 21212 consensus_queue.cc:1243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Peer 680390d3f0884c91bf1f22ba914b438a log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:47.757063 21472 raft_consensus.cc:3055] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:47.757547 21472 raft_consensus.cc:740] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:47.758687 21472 consensus_queue.cc:260] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:47.760408 21472 raft_consensus.cc:3060] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:47.762786 21441 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:47.769471 15723 raft_consensus.cc:1275] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:47.778808 21179 consensus_queue.cc:1048] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:47.827979 15580 raft_consensus.cc:1275] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:47.861685 21090 consensus_queue.cc:1048] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:47.892969 15651 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:47.899560 21488 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:47.909148 15721 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:08:47.913058 15579 raft_consensus.cc:1275] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:08:47.913496 15579 pending_rounds.cc:85] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 9
I20260709 13:08:47.913731 15579 pending_rounds.cc:107] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:08:47.914057 15579 raft_consensus.cc:2889] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:47.918284 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 63843.9us
I20260709 13:08:47.933671 21280 consensus_queue.cc:1048] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:47.949072 21420 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:48.001699 15572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:48.002353 15572 raft_consensus.cc:606] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.037528 15579 raft_consensus.cc:1275] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 22 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:08:48.038014 15579 pending_rounds.cc:85] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting all ops after (but not including) 10
I20260709 13:08:48.038262 15579 pending_rounds.cc:107] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:08:48.038506 15579 raft_consensus.cc:2889] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.041388 21363 consensus_queue.cc:1048] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:48.065887 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:48.066967 15651 raft_consensus.cc:606] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.074177 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:48.074775 15651 raft_consensus.cc:606] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:48.079437 15651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:38248
I20260709 13:08:48.080052 15651 raft_consensus.cc:606] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.087284 21290 raft_consensus.cc:993] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.087806 21290 raft_consensus.cc:1081] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.092751 16272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:08:48.093325 16272 raft_consensus.cc:493] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.093688 16272 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.093326 15580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa9aad2b798480db18c5b0e3bac6a57"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:48.094667 15580 raft_consensus.cc:606] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.095001 15580 raft_consensus.cc:614] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:48.095800 21524 log.cc:927] Time spent T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:48.096964 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:48.098592 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:48.151706 21290 raft_consensus.cc:993] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:48.152283 21420 raft_consensus.cc:1081] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:48.153973 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:08:48.154557 15723 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.154886 15723 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:48.160812 15462 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 8995ef9978c446769377fc0e9a0cb9c1 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.172142 15723 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:48.176069 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:48.176793 15573 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.179315 16272 raft_consensus.cc:515] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.182334 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:48.182981 15647 raft_consensus.cc:3055] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:48.183279 15647 raft_consensus.cc:740] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:48.184247 15647 consensus_queue.cc:260] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.185930 15647 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.205679 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:48.206470 15646 raft_consensus.cc:3055] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:48.206774 15646 raft_consensus.cc:740] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:48.207139 15723 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:48.207530 15646 consensus_queue.cc:260] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:48.208767 15646 raft_consensus.cc:3060] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.218645 15646 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:48.222939 15693 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:48.223793 21488 raft_consensus.cc:2804] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.224360 21488 raft_consensus.cc:697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:48.225245 21488 consensus_queue.cc:237] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:48.208750 15573 raft_consensus.cc:2468] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:08:48.248919 15471 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.251200 15471 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.258144 21215 raft_consensus.cc:993] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.258739 21256 raft_consensus.cc:1081] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.260509 16275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39940
I20260709 13:08:48.261042 16275 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.261353 16275 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.264998 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7a0379477ed4600a60cd9fde8f2867a" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:48.265681 15723 raft_consensus.cc:3060] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.268446 16272 leader_election.cc:290] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:48.270150 16275 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.270925 15471 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 8, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 8 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.276278 15471 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:48.277498 15647 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:48.280277 16236 leader_election.cc:304] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:48.277760 15471 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.281371 21466 raft_consensus.cc:2804] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:48.282380 21466 raft_consensus.cc:697] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:48.286068 21466 consensus_queue.cc:237] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.287710 16275 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:48.288460 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:48.281678 15471 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.289052 15573 raft_consensus.cc:3055] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:48.289417 15573 raft_consensus.cc:740] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:48.290172 15573 consensus_queue.cc:260] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.289901 15471 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 15 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:48.291504 15573 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:48.291452 15471 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 17, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 17 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
W20260709 13:08:48.273041 15476 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 254) took 35601 ms (client timeout 15000 ms). Trace:
I20260709 13:08:48.296434 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:48.297043 15729 raft_consensus.cc:3060] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:48.294181 15476 rpcz_store.cc:269] 0709 13:08:12.671718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.672014 (+   296us) service_pool.cc:224] Handling call
0709 13:08:12.773352 (+101338us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5400310010. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928ef0b2 00007f2d9b868a89 00007f2d9b800da6 00007f2d9b7d2088 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc
0709 13:08:48.272954 (+35499602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:47.717447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:47.717977 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:47.718012 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:47.718051 (+    39us) tablet.cc:662] Decoding operations
0709 13:08:47.718570 (+   519us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:47.718644 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:47.718669 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:47.718999 (+   330us) tablet.cc:701] Row locks acquired
0709 13:08:47.719020 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:47.719141 (+   121us) write_op.cc:270] Start()
0709 13:08:47.719253 (+   112us) write_op.cc:276] Timestamp: P: 1783602527719097 usec, L: 0
0709 13:08:47.719275 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:47.736156 (+ 16881us) log.cc:844] Serialized 1361 byte log entry
0709 13:08:48.047063 (+310907us) op_driver.cc:464] REPLICATION: finished
0709 13:08:48.118932 (+ 71869us) write_op.cc:301] APPLY: starting
0709 13:08:48.119018 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.121106 (+  2088us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.121200 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:48.123747 (+  2547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:48.123938 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:08:48.123988 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:48.124192 (+   204us) log.cc:844] Serialized 41 byte log entry
0709 13:08:48.125101 (+   909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.125194 (+    93us) write_op.cc:454] Released schema lock
0709 13:08:48.125234 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.125641 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.125670 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":156965,"reported_tablets":43,"spinlock_wait_cycles":7637376,"child_traces":[["op",{"apply.queue_time_us":71611,"apply.run_cpu_time_us":5254,"apply.run_wall_time_us":6674,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":110116,"prepare.run_cpu_time_us":56177,"prepare.run_wall_time_us":234790,"raft.queue_time_us":40804,"raft.run_cpu_time_us":2719,"raft.run_wall_time_us":38897,"replication_time_us":327607,"thread_start_us":350038,"threads_started":4,"wal-append.queue_time_us":253965}]]}
I20260709 13:08:48.308933 15723 raft_consensus.cc:2468] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:48.311090 15573 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:48.322764 15729 raft_consensus.cc:2468] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:08:48.293017 15471 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.328272 16235 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:48.332278 21441 raft_consensus.cc:2804] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:48.332841 21441 raft_consensus.cc:697] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:48.333772 21441 consensus_queue.cc:237] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.335286 15471 catalog_manager.cc:5697] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 14, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 14 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.344228 15471 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 14, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 14 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.345876 15471 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.348524 15471 catalog_manager.cc:5697] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 14, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 14 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:48.355722 15471 catalog_manager.cc:5697] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 15, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.359381 15471 catalog_manager.cc:5697] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 15, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 15 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:48.368819 15471 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 14, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 14 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.376075 15471 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 6 to 11, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.382678 15471 catalog_manager.cc:5697] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 13, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.387938 15471 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 13, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.403260 15471 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 13, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.404968 15471 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.410480 21290 raft_consensus.cc:993] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.414093 21290 raft_consensus.cc:1081] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:48.416352 16272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:08:48.417953 16272 raft_consensus.cc:493] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.418334 16272 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.414345 15471 catalog_manager.cc:5697] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.430262 15471 catalog_manager.cc:5697] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.431869 15471 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.433259 15471 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:48.476037 16272 raft_consensus.cc:515] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.483812 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:48.484459 15647 raft_consensus.cc:3055] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:48.484779 15647 raft_consensus.cc:740] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:48.498320 16272 leader_election.cc:290] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:48.502875 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a514609784146e8a8b6917d543f83e7" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:48.503489 15723 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.485559 15647 consensus_queue.cc:260] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.517868 15647 raft_consensus.cc:3060] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:48.553622 15723 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:48.561389 16236 leader_election.cc:304] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:48.566560 15647 raft_consensus.cc:2468] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:48.562783 21466 raft_consensus.cc:2804] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:48.569793 21466 raft_consensus.cc:697] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:48.597724 21466 consensus_queue.cc:237] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.794726 15647 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:48.798182 15573 raft_consensus.cc:1275] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:48.799664 21488 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.812716 21488 consensus_queue.cc:1048] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.838299 21488 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:48.838871 21488 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.841332 21488 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:48.843586 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:48.844352 15651 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:48.844370 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:48.845300 16272 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:48.848237 15693 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.854862 21488 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:48.855322 21488 raft_consensus.cc:493] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:48.855702 21488 raft_consensus.cc:3060] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:48.865437 21488 raft_consensus.cc:515] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.882268 21488 leader_election.cc:290] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:48.882970 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:48.883935 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1128bef1224facb3c1a31e94fb0379" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:48.884694 16272 raft_consensus.cc:2393] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 16: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:48.888069 15651 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:48.889575 21445 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.896479 15647 raft_consensus.cc:2468] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:48.916759 15693 leader_election.cc:304] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:48.922755 15729 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:48.925635 15729 raft_consensus.cc:1275] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:48.929009 21402 raft_consensus.cc:2804] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:48.929553 21402 raft_consensus.cc:697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:48.928750 21440 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:48.931113 21441 consensus_queue.cc:1048] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:48.930456 21402 consensus_queue.cc:237] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:48.961905 15573 raft_consensus.cc:1275] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:48.982545 21445 consensus_queue.cc:1048] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:49.006687 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44946.6us
I20260709 13:08:49.018813 15646 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:08:49.028564 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 87767.7us
I20260709 13:08:49.025949 21445 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:49.074998 15729 raft_consensus.cc:1275] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:49.083215 21557 consensus_queue.cc:1048] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 13:08:49.087466 21554 log.cc:927] Time spent T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:49.099818 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:49.168424 21556 log.cc:927] Time spent T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:08:49.215037 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 83212.8us
W20260709 13:08:49.232914 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 85200.5us
W20260709 13:08:49.315017 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 85431.2us
I20260709 13:08:49.315724 15471 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 373) took 2385 ms. Trace:
W20260709 13:08:49.318167 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 85412.5us
I20260709 13:08:49.316164 15471 rpcz_store.cc:276] 0709 13:08:46.930492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.930723 (+   231us) service_pool.cc:224] Handling call
0709 13:08:49.315632 (+2384909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:48.627333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:48.633539 (+  6206us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:48.633841 (+   302us) write_op.cc:435] Acquired schema lock
0709 13:08:48.633862 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:48.636099 (+  2237us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:48.636187 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:48.636219 (+    32us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:08:48.670403 (+ 34184us) tablet.cc:701] Row locks acquired
0709 13:08:48.670423 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:48.670568 (+   145us) write_op.cc:270] Start()
0709 13:08:48.670696 (+   128us) write_op.cc:276] Timestamp: P: 1783602528670518 usec, L: 0
0709 13:08:48.670721 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:48.675860 (+  5139us) log.cc:844] Serialized 9896 byte log entry
0709 13:08:48.736105 (+ 60245us) op_driver.cc:464] REPLICATION: finished
0709 13:08:48.831168 (+ 95063us) write_op.cc:301] APPLY: starting
0709 13:08:48.831792 (+   624us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.930873 (+ 99081us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.940050 (+  9177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.081695 (+141645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.107177 (+ 25482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:08:49.107222 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:49.107662 (+   440us) log.cc:844] Serialized 220 byte log entry
0709 13:08:49.107826 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.108032 (+   206us) write_op.cc:454] Released schema lock
0709 13:08:49.108094 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.108462 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.108491 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":137131,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":94108,"apply.run_cpu_time_us":31306,"apply.run_wall_time_us":277943,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":139014,"prepare.run_cpu_time_us":6862,"prepare.run_wall_time_us":48832,"replication_time_us":65207,"thread_start_us":132338,"threads_started":2}]]}
I20260709 13:08:49.319227 15474 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 4 to 7, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 7 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.327257 15474 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.330955 15474 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.352521 21429 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.353223 21429 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:49.356164 21429 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:49.360985 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:49.361624 16277 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
W20260709 13:08:49.369201 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 50390.3us
I20260709 13:08:49.385274 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:49.385946 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
I20260709 13:08:49.393107 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:49.393756 15647 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 18.
I20260709 13:08:49.415879 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:49.416931 21257 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:49.417333 21257 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.417728 21257 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.425769 21257 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:49.434909 21257 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:49.435089 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:49.435770 16275 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.444060 15729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:49.444747 15729 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.448088 16275 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 19.
I20260709 13:08:49.456869 15651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:49.457526 15651 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:49.515017 15729 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 19.
I20260709 13:08:49.518397 15471 catalog_manager.cc:5697] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 15 to 16, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 16 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.547806 15471 catalog_manager.cc:5697] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 15 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.519682 16275 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:49.529934 15474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 366) took 50946 ms (client timeout 15000 ms). Trace:
I20260709 13:08:49.552002 21549 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:49.550310 15474 rpcz_store.cc:269] 0709 13:07:58.637180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.682014 (+ 44834us) service_pool.cc:224] Handling call
0709 13:08:00.588482 (+1906468us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:49.529863 (+48941381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.377254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.377755 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.377789 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:49.377805 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:49.378346 (+   541us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.378417 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.378441 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:49.378736 (+   295us) tablet.cc:701] Row locks acquired
0709 13:08:49.378756 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:49.378946 (+   190us) write_op.cc:270] Start()
0709 13:08:49.379066 (+   120us) write_op.cc:276] Timestamp: P: 1783602529378836 usec, L: 0
0709 13:08:49.379086 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.379697 (+   611us) log.cc:844] Serialized 1302 byte log entry
0709 13:08:49.435733 (+ 56036us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.436030 (+   297us) write_op.cc:301] APPLY: starting
0709 13:08:49.436118 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.437937 (+  1819us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.438049 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.439960 (+  1911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.440152 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:08:49.440204 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:49.440429 (+   225us) log.cc:844] Serialized 41 byte log entry
0709 13:08:49.440612 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.440720 (+   108us) write_op.cc:454] Released schema lock
0709 13:08:49.440762 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.477606 (+ 36844us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.477643 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3605,"reported_tablets":46,"spinlock_wait_cycles":68755328,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":5082,"apply.run_wall_time_us":41502,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":38043,"prepare.run_cpu_time_us":2679,"prepare.run_wall_time_us":2737,"replication_time_us":56505,"thread_start_us":47033,"threads_started":1}]]}
I20260709 13:08:49.554901 15647 raft_consensus.cc:1275] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:49.549602 15471 catalog_manager.cc:5697] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 15 to 18, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 18 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:49.556699 21402 consensus_queue.cc:1048] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:49.556960 15471 catalog_manager.cc:5697] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.558826 15471 catalog_manager.cc:5697] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.496004 15651 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8995ef9978c446769377fc0e9a0cb9c1 in term 19.
I20260709 13:08:49.582311 15544 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:49.568984 15471 catalog_manager.cc:5697] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 9 to 16, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 16 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.598894 15471 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.603420 15471 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.612774 21563 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:49.623018 21563 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 LEADER]: Becoming Leader. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:49.632496 21563 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:49.631011 15471 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.637424 15471 catalog_manager.cc:5697] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 17, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 17 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.638815 15471 catalog_manager.cc:5697] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 22, leader changed from 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 22 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } }
I20260709 13:08:49.639849 15471 catalog_manager.cc:5697] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 12 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.640709 15471 catalog_manager.cc:5697] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 16, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 16 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.641567 15471 catalog_manager.cc:5697] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 12, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 12 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.642485 15471 catalog_manager.cc:5697] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:49.705886 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 61369.1us
I20260709 13:08:49.802970 15472 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.804935 15472 catalog_manager.cc:5697] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 13 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.806880 15472 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.809626 15472 catalog_manager.cc:5697] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.811347 15472 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.813663 15472 catalog_manager.cc:5697] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 7 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 13 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.817145 15472 catalog_manager.cc:5697] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.818554 15472 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 11 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 15 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.836988 15472 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 5 to 12, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 12 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.839280 15472 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 9 to 13, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129). New cstate: current_term: 13 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:49.959374 15472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 351) took 9660 ms. Trace:
I20260709 13:08:49.963902 15473 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 10 to 11, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 11 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.959846 15472 rpcz_store.cc:276] 0709 13:08:40.299377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.299544 (+   167us) service_pool.cc:224] Handling call
0709 13:08:49.959294 (+9659750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.856389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.856979 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.857016 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:08:49.857039 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:49.858128 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.858187 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.858217 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:49.859100 (+   883us) tablet.cc:701] Row locks acquired
0709 13:08:49.859120 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:49.859270 (+   150us) write_op.cc:270] Start()
0709 13:08:49.859392 (+   122us) write_op.cc:276] Timestamp: P: 1783602529859223 usec, L: 0
0709 13:08:49.859419 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.860107 (+   688us) log.cc:844] Serialized 3980 byte log entry
0709 13:08:49.895243 (+ 35136us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.895679 (+   436us) write_op.cc:301] APPLY: starting
0709 13:08:49.895763 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.900813 (+  5050us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.900903 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.906996 (+  6093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.907227 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:08:49.907278 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:49.907592 (+   314us) log.cc:844] Serialized 97 byte log entry
0709 13:08:49.907744 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.907878 (+   134us) write_op.cc:454] Released schema lock
0709 13:08:49.907924 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.908260 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.908291 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":12352,"apply.run_wall_time_us":12516,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41800,"num_ops":10,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":4035,"prepare.run_wall_time_us":4034,"replication_time_us":35681}]]}
W20260709 13:08:50.075125 15473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 255) took 13120 ms (client timeout 15000 ms). Trace:
W20260709 13:08:50.102180 15473 rpcz_store.cc:269] 0709 13:08:36.954821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.965262 (+ 10441us) service_pool.cc:224] Handling call
0709 13:08:49.996660 (+13031398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.996686 (+    26us) write_op.cc:454] Released schema lock
0709 13:08:50.075049 (+ 78363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.988438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.989080 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.989124 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:08:49.989143 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:49.989535 (+   392us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.989598 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.989629 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:49.989826 (+   197us) tablet.cc:701] Row locks acquired
0709 13:08:49.989845 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:49.990016 (+   171us) write_op.cc:270] Start()
0709 13:08:49.990148 (+   132us) write_op.cc:276] Timestamp: P: 1783602529989970 usec, L: 0
0709 13:08:49.990169 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.990805 (+   636us) log.cc:844] Serialized 536 byte log entry
0709 13:08:49.992805 (+  2000us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.993222 (+   417us) write_op.cc:301] APPLY: starting
0709 13:08:49.993301 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.994125 (+   824us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.994224 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.994932 (+   708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.995104 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:08:49.995154 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:49.995347 (+   193us) log.cc:844] Serialized 25 byte log entry
0709 13:08:49.995522 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.995610 (+    88us) write_op.cc:454] Released schema lock
0709 13:08:49.995649 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":11183,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":2693,"apply.run_wall_time_us":2691,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":1626,"prepare.run_cpu_time_us":2669,"prepare.run_wall_time_us":2667,"replication_time_us":2515}]]}
I20260709 13:08:50.119508 15648 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:50.120761 15475 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.125279 21562 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:50.133226 15475 catalog_manager.cc:5697] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:50.135716 15580 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:50.135249 15475 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.139040 15475 catalog_manager.cc:5697] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 12 to 16, leader changed from 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 16 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:50.149205 15475 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:50.169242 15477 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 367) took 25791 ms (client timeout 15000 ms). Trace:
W20260709 13:08:50.169961 15477 rpcz_store.cc:269] 0709 13:08:24.373596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.379256 (+  5660us) service_pool.cc:224] Handling call
0709 13:08:50.164918 (+25785662us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7957,"mutex_wait_us":93337,"reported_tablets":46}
I20260709 13:08:50.234905 16275 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:08:50.274624 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 70903.7us
W20260709 13:08:50.315798 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 64123us
I20260709 13:08:50.295802 21580 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:08:50.352598 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106797us
W20260709 13:08:50.367059 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 71485.4us
I20260709 13:08:50.370934 15648 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:50.374330 21429 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:50.379386 15723 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:50.458859 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:50.414183 21572 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:08:50.527978 16277 consensus_queue.cc:237] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:50.543753 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 111583us
W20260709 13:08:50.556908 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 90042.8us
I20260709 13:08:50.564138 16272 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:50.567716 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 104670us
I20260709 13:08:50.583777 15580 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:50.581869 21582 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 13:08:50.607177 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 47620.4us
I20260709 13:08:50.615792 21607 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:50.647730 15728 raft_consensus.cc:1275] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:50.649677 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 140930us
I20260709 13:08:50.656098 21466 consensus_queue.cc:1048] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:08:50.865003 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 210225us
W20260709 13:08:50.979663 21597 log.cc:927] Time spent T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.286s	user 0.002s	sys 0.009s
I20260709 13:08:50.977007 21572 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:51.106525 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 48991us
W20260709 13:08:51.178545 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 132193us
W20260709 13:08:51.178748 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 52849.7us
W20260709 13:08:51.183370 15619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.032s	sys 0.126s
W20260709 13:08:51.194931 15619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.033s	sys 0.126s
W20260709 13:08:51.189478 15618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.009s
W20260709 13:08:51.196405 15618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.006s	sys 0.009s
W20260709 13:08:51.197139 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 518231us
W20260709 13:08:51.255719 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 52538.6us
W20260709 13:08:51.255388 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54662us
W20260709 13:08:51.289676 15543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.093s	sys 0.116s
W20260709 13:08:51.290118 15543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.093s	sys 0.116s
W20260709 13:08:51.290534 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 607285us
W20260709 13:08:51.305572 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 105317us
W20260709 13:08:51.319878 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 46641.5us
W20260709 13:08:51.340983 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 68365.5us
I20260709 13:08:51.303196 21587 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:51.362344 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 70806.2us
I20260709 13:08:51.362809 21587 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.405738 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:51.406438 15573 raft_consensus.cc:606] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:51.408838 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
W20260709 13:08:51.414363 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 89158.7us
W20260709 13:08:51.416648 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 158958us
I20260709 13:08:51.422178 21587 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.426232 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:51.429311 15693 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:51.430083 21646 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.434115 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233f2755fc484e7fb202702622c7b652"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:51.434821 15573 raft_consensus.cc:606] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:51.443526 16277 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:51.452364 15651 raft_consensus.cc:2955] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:51.487615 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 72146.3us
I20260709 13:08:51.490299 21594 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:51.501965 15574 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:51.515151 21643 raft_consensus.cc:993] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:51.515722 21643 raft_consensus.cc:1081] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:51.523725 15573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:51.524322 15573 raft_consensus.cc:606] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:51.534936 15580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c036f4b115e847feb37d916989af7159"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:51.535590 15580 raft_consensus.cc:606] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:51.538519 15647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:08:51.539294 15647 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.539716 15647 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.571210 15647 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.574361 15647 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.574841 15651 raft_consensus.cc:1240] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:51.575928 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:51.578704 15580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:51.579313 15580 raft_consensus.cc:606] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Received request to transfer leadership to TS 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:51.580778 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:51.581413 15576 raft_consensus.cc:3055] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:51.546162 21594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59412 (request call id 0) took 1020 ms. Trace:
I20260709 13:08:51.582113 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:51.583468 16277 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.581712 15576 raft_consensus.cc:740] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:51.616245 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:51.619608 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.582011 21596 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:51.623196 15472 catalog_manager.cc:5697] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:51.634778 15576 consensus_queue.cc:260] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.640727 15576 raft_consensus.cc:3060] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:51.618153 21572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48250 (request call id 10) took 1482 ms. Trace:
W20260709 13:08:51.641490 21636 consensus_queue.cc:1175] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "680390d3f0884c91bf1f22ba914b438a" responder_term: 19 status { last_received { term: 18 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:51.586089 21594 rpcz_store.cc:276] 0709 13:08:50.522145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.522288 (+   143us) service_pool.cc:224] Handling call
0709 13:08:50.531703 (+  9415us) log.cc:844] Serialized 501 byte log entry
0709 13:08:51.542444 (+1010741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2971,"raft.queue_time_us":6811,"raft.run_cpu_time_us":1203,"raft.run_wall_time_us":1201,"thread_start_us":36443,"threads_started":1,"wal-append.queue_time_us":35044}
I20260709 13:08:51.669061 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 361bd26d633f474ba34078d9cf76f22f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.675552 16277 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 19.
I20260709 13:08:51.633388 21596 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.665100 21572 rpcz_store.cc:276] 0709 13:08:50.132901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.133064 (+   163us) service_pool.cc:224] Handling call
0709 13:08:50.140049 (+  6985us) log.cc:844] Serialized 501 byte log entry
0709 13:08:51.614952 (+1474903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1818,"raft.queue_time_us":53225,"raft.run_cpu_time_us":1518,"raft.run_wall_time_us":107556,"spinlock_wait_cycles":13568,"thread_start_us":218241,"threads_started":2,"wal-append.queue_time_us":127123,"wal-append.run_cpu_time_us":1622,"wal-append.run_wall_time_us":1010330}
I20260709 13:08:51.681619 21596 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.686245 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78d5d462c9e4427f934553b90818efd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.686297 15618 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:51.687284 20862 raft_consensus.cc:993] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:51.706952 20862 raft_consensus.cc:1081] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Signalling peer 680390d3f0884c91bf1f22ba914b438a to start an election
I20260709 13:08:51.708156 21621 raft_consensus.cc:2804] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:51.689182 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:51.708716 21621 raft_consensus.cc:697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:51.694370 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:51.709615 21621 consensus_queue.cc:237] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.712374 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:51.713268 21596 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:51.700135 15475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 368) took 7730 ms. Trace:
I20260709 13:08:51.702584 15729 raft_consensus.cc:2955] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 5 to 12, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:51.722112 15475 rpcz_store.cc:276] 0709 13:08:43.969946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.970155 (+   209us) service_pool.cc:224] Handling call
0709 13:08:51.700039 (+7729884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:50.191685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:50.192231 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:50.192288 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:08:50.192314 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:50.193205 (+   891us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:50.193284 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:50.193325 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:50.209781 (+ 16456us) tablet.cc:701] Row locks acquired
0709 13:08:50.231082 (+ 21301us) write_op.cc:260] PREPARE: finished
0709 13:08:50.242155 (+ 11073us) write_op.cc:270] Start()
0709 13:08:50.253217 (+ 11062us) write_op.cc:276] Timestamp: P: 1783602530238989 usec, L: 0
0709 13:08:50.254593 (+  1376us) op_driver.cc:348] REPLICATION: starting
0709 13:08:50.255501 (+   908us) log.cc:844] Serialized 2132 byte log entry
0709 13:08:50.280708 (+ 25207us) op_driver.cc:464] REPLICATION: finished
0709 13:08:50.281286 (+   578us) write_op.cc:301] APPLY: starting
0709 13:08:50.281381 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:50.507069 (+225688us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:50.507160 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:50.615711 (+108551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:50.655032 (+ 39321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:08:50.670655 (+ 15623us) write_op.cc:312] APPLY: finished
0709 13:08:50.696822 (+ 26167us) log.cc:844] Serialized 57 byte log entry
0709 13:08:51.018368 (+321546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.027886 (+  9518us) write_op.cc:454] Released schema lock
0709 13:08:51.029774 (+  1888us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:51.063607 (+ 33833us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:51.068302 (+  4695us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21011,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":334,"apply.run_cpu_time_us":16315,"apply.run_wall_time_us":758094,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":4395,"prepare.run_wall_time_us":64164,"replication_time_us":25933}]]}
I20260709 13:08:51.746964 15576 raft_consensus.cc:2468] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 19.
I20260709 13:08:51.750336 15647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20"
dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:08:51.750964 15647 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.751346 15647 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.759651 15647 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.773236 15647 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.812186 21636 raft_consensus.cc:993] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:51.812717 21643 raft_consensus.cc:1081] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
W20260709 13:08:51.833709 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 81297.3us
I20260709 13:08:51.840564 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:51.841295 15576 raft_consensus.cc:3055] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:51.841399 21599 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:51.841691 15576 raft_consensus.cc:740] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:51.842082 21599 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } attrs { replace: true } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.842629 15576 consensus_queue.cc:260] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.844332 15576 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.847308 21572 raft_consensus.cc:993] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:51.848861 21643 raft_consensus.cc:1081] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:51.835301 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:08:51.855336 15724 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.856621 15573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:51.859018 15729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:08:51.859575 15729 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.859902 15729 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.863281 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:51.866197 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:51.866816 16275 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:51.867902 15576 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:51.864696 21562 raft_consensus.cc:993] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:51.874650 15619 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:51.875766 21599 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.876224 21622 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.878305 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:51.884734 21562 raft_consensus.cc:1081] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:51.885946 15729 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.888643 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:51.889195 15580 raft_consensus.cc:3055] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:51.889499 15580 raft_consensus.cc:740] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:51.890246 15580 consensus_queue.cc:260] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.891136 15723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233f2755fc484e7fb202702622c7b652"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:08:51.891798 15723 raft_consensus.cc:493] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.892203 15723 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.896215 15729 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.897214 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:51.897833 16277 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.891328 15580 raft_consensus.cc:3060] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.905766 16277 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:51.907049 15692 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:51.908613 15721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c036f4b115e847feb37d916989af7159"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:08:51.908877 21590 raft_consensus.cc:2804] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:51.909329 15721 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.909766 15721 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.909806 21590 raft_consensus.cc:697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:51.912107 21590 consensus_queue.cc:237] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.914054 15724 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:51.914754 15720 raft_consensus.cc:1240] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:51.917621 15619 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:51.918231 16275 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:51.918720 21618 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:51.919365 21618 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:51.920406 21618 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.925187 15723 raft_consensus.cc:515] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.908638 15580 raft_consensus.cc:2468] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:51.927282 15723 leader_election.cc:290] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:51.927301 15725 raft_consensus.cc:1240] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:51.930855 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:51.931429 16277 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.929972 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f2755fc484e7fb202702622c7b652" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:51.934325 15580 raft_consensus.cc:3055] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:51.934661 15580 raft_consensus.cc:740] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:51.935750 15580 consensus_queue.cc:260] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:51.929494 15721 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:51.946211 16277 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:51.949898 15580 raft_consensus.cc:3060] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.948324 15692 leader_election.cc:304] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:51.961244 15580 raft_consensus.cc:2468] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 9.
I20260709 13:08:51.962975 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:51.964681 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:51.965438 15646 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:51.964552 15721 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:51.982286 15646 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:51.985587 15580 raft_consensus.cc:3055] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:51.986001 15580 raft_consensus.cc:740] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:51.984154 15693 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:51.988061 21606 raft_consensus.cc:2804] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:51.969805 21590 raft_consensus.cc:2804] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:51.990279 21590 raft_consensus.cc:697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:51.992902 15646 raft_consensus.cc:1240] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Rejecting Update request from peer 8995ef9978c446769377fc0e9a0cb9c1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:52.001706 15580 consensus_queue.cc:260] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:52.003504 21606 raft_consensus.cc:697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:52.004179 21636 consensus_queue.cc:1059] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:52.014915 21590 consensus_queue.cc:237] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:52.096472 15544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.099327 15580 raft_consensus.cc:3060] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:52.118369 21659 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:52.075420 21606 consensus_queue.cc:237] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:52.150666 15580 raft_consensus.cc:2468] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:08:52.156144 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:52.298596 15472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 352) took 2248 ms. Trace:
I20260709 13:08:52.299124 15472 rpcz_store.cc:276] 0709 13:08:50.049820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.049981 (+   161us) service_pool.cc:224] Handling call
0709 13:08:52.298533 (+2248552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:51.762352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.762906 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.762940 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:51.762959 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:51.763292 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.763364 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.763395 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:51.763581 (+   186us) tablet.cc:701] Row locks acquired
0709 13:08:51.763602 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:51.763747 (+   145us) write_op.cc:270] Start()
0709 13:08:51.763864 (+   117us) write_op.cc:276] Timestamp: P: 1783602531763699 usec, L: 0
0709 13:08:51.763886 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.764585 (+   699us) log.cc:844] Serialized 536 byte log entry
0709 13:08:51.898479 (+133894us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.051787 (+153308us) write_op.cc:301] APPLY: starting
0709 13:08:52.053962 (+  2175us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.072441 (+ 18479us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.078457 (+  6016us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:52.134507 (+ 56050us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:52.134687 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:08:52.134731 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:52.134918 (+   187us) log.cc:844] Serialized 25 byte log entry
0709 13:08:52.136378 (+  1460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.136468 (+    90us) write_op.cc:454] Released schema lock
0709 13:08:52.136514 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:52.160170 (+ 23656us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.175618 (+ 15448us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":113161,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":120554,"apply.run_cpu_time_us":4056,"apply.run_wall_time_us":86392,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":63698,"prepare.run_cpu_time_us":2549,"prepare.run_wall_time_us":2550,"replication_time_us":134409,"thread_start_us":118927,"threads_started":2}]]}
I20260709 13:08:52.315244 15473 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48528 (request call id 376) took 1652 ms. Trace:
I20260709 13:08:52.326373 15473 rpcz_store.cc:276] 0709 13:08:50.651750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.652081 (+   331us) service_pool.cc:224] Handling call
0709 13:08:51.446174 (+794093us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5400310010. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928ef0b2 00007f2d9b868a89 00007f2d9b800da6 00007f2d9b7d2088 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc
0709 13:08:52.304415 (+858241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:52.190377 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:52.197810 (+  7433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:52.197857 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:08:52.197875 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:52.198248 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:52.198304 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:52.198333 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:52.198502 (+   169us) tablet.cc:701] Row locks acquired
0709 13:08:52.198519 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:52.198656 (+   137us) write_op.cc:270] Start()
0709 13:08:52.198772 (+   116us) write_op.cc:276] Timestamp: P: 1783602532198607 usec, L: 0
0709 13:08:52.198801 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:52.199403 (+   602us) log.cc:844] Serialized 599 byte log entry
0709 13:08:52.201206 (+  1803us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.201636 (+   430us) write_op.cc:301] APPLY: starting
0709 13:08:52.201722 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.221187 (+ 19465us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.221300 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:52.222205 (+   905us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:52.222414 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:08:52.222467 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:52.222655 (+   188us) log.cc:844] Serialized 25 byte log entry
0709 13:08:52.222825 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.222901 (+    76us) write_op.cc:454] Released schema lock
0709 13:08:52.222939 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:52.223326 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.223359 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":156325,"reported_tablets":1,"spinlock_wait_cycles":71363328,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":3258,"apply.run_wall_time_us":21644,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2550,"prepare.run_wall_time_us":12175,"replication_time_us":2294}]]}
I20260709 13:08:52.367169 15475 catalog_manager.cc:5697] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 5 to 12, VOTER 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) evicted. New cstate: current_term: 14 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:52.385941 15580 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:52.387660 16275 raft_consensus.cc:1275] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:08:52.397190 21661 log.cc:927] Time spent T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:08:52.414680 21662 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:52.419540 21621 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:52.430562 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 129238us
I20260709 13:08:52.445040 15475 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 3 to 10, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 12 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.449689 21622 consensus_queue.cc:1048] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:08:52.480050 15720 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:52.509790 15576 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:52.523542 21606 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:52.518582 15477 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 361bd26d633f474ba34078d9cf76f22f with cas_config_opid_index 5: aborting the task: latest config opid_index 12; task opid_index 5
I20260709 13:08:52.523449 21671 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:52.545101 15574 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:52.546669 15477 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 256) took 2221 ms. Trace:
I20260709 13:08:52.538749 15472 catalog_manager.cc:5697] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 9, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.547195 15477 rpcz_store.cc:276] 0709 13:08:50.325019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.325219 (+   200us) service_pool.cc:224] Handling call
0709 13:08:52.546593 (+2221374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93799,"reported_tablets":32}
I20260709 13:08:52.554418 21622 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:52.562079 15472 catalog_manager.cc:5697] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 8 to 9, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 9 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:52.562721 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 108962us
I20260709 13:08:52.564514 15472 catalog_manager.cc:5697] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 15 to 16, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 16 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.581045 16277 raft_consensus.cc:1275] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:52.604601 16277 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:52.606423 21605 consensus_queue.cc:1048] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:52.608119 21671 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:52.615490 15573 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:52.621872 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.646454 21402 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:08:52.747267 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 74558.9us
I20260709 13:08:52.848240 15648 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:52.855768 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 55493.1us
I20260709 13:08:52.889278 15576 raft_consensus.cc:1275] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:08:52.894990 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 92770.2us
I20260709 13:08:52.885972 21605 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:08:52.938983 21675 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:08:52.944581 21677 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:08:52.976313 21686 log.cc:927] Time spent T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:08:52.977114 21679 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:08:53.006835 21693 consensus_queue.cc:1048] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:53.015654 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 54872.2us
I20260709 13:08:53.019879 15573 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:53.013496 15473 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 11 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.025642 15475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48508 (request call id 369) took 1122 ms. Trace:
I20260709 13:08:53.026216 15475 rpcz_store.cc:276] 0709 13:08:51.903286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.903609 (+   323us) service_pool.cc:224] Handling call
0709 13:08:51.965800 (+ 62191us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54003ac354. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:08:53.025570 (+1059770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:52.498806 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:52.499323 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:52.499358 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:52.499370 (+    12us) tablet.cc:662] Decoding operations
0709 13:08:52.499745 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:52.499802 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:52.499826 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:52.500144 (+   318us) tablet.cc:701] Row locks acquired
0709 13:08:52.500160 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:52.500299 (+   139us) write_op.cc:270] Start()
0709 13:08:52.500413 (+   114us) write_op.cc:276] Timestamp: P: 1783602532500245 usec, L: 0
0709 13:08:52.500428 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:08:52.501037 (+   609us) log.cc:844] Serialized 919 byte log entry
0709 13:08:52.502995 (+  1958us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.503400 (+   405us) write_op.cc:301] APPLY: starting
0709 13:08:52.503480 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.507933 (+  4453us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.508047 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:52.509288 (+  1241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:52.509460 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:08:52.509502 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:52.509684 (+   182us) log.cc:844] Serialized 33 byte log entry
0709 13:08:52.509860 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.509942 (+    82us) write_op.cc:454] Released schema lock
0709 13:08:52.509981 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:52.510937 (+   956us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.510966 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":113249,"reported_tablets":22,"spinlock_wait_cycles":108519296,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":3917,"apply.run_wall_time_us":7498,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":629,"prepare.run_cpu_time_us":2513,"prepare.run_wall_time_us":2514,"replication_time_us":2456}]]}
W20260709 13:08:53.063102 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 46763.6us
W20260709 13:08:53.054411 21673 log.cc:927] Time spent T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:08:53.097426 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 135931us
W20260709 13:08:53.099654 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53905.5us
I20260709 13:08:53.114246 16270 raft_consensus.cc:1275] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:53.147006 15473 catalog_manager.cc:5697] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 18 to 19, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 19 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:53.235739 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 72636.4us
I20260709 13:08:53.168942 21663 consensus_queue.cc:1048] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 13:08:53.278264 21697 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:08:53.425845 16269 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:53.442256 21625 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:53.456092 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 218225us
I20260709 13:08:53.466686 15650 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Refusing update from remote peer 8995ef9978c446769377fc0e9a0cb9c1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:53.545094 15645 tablet_service.cc:1558] Processing DeleteTablet for tablet 361bd26d633f474ba34078d9cf76f22f with delete_type TABLET_DATA_TOMBSTONED (TS 680390d3f0884c91bf1f22ba914b438a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58092
W20260709 13:08:53.605368 21728 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:08:53.606827 21729 log.cc:927] Time spent T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:53.591477 21713 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:08:53.639441 21711 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 7 to 13, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:53.649662 21693 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:53.650331 21693 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } attrs { replace: true } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:53.653203 21693 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:53.653434 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1" is_pre_election: true
I20260709 13:08:53.644129 16269 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 7 to 13, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:53.656286 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:53.656891 15648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:53.659162 15692 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:53.666302 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5d462c9e4427f934553b90818efd6 with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36626
I20260709 13:08:53.666986 21730 tablet_replica.cc:333] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:08:53.665169 21590 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.685732 21730 raft_consensus.cc:2243] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.686652 21730 raft_consensus.cc:2272] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.690147 21730 ts_tablet_manager.cc:1916] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.713169 15473 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48518 (request call id 353) took 1279 ms. Trace:
I20260709 13:08:53.723245 15477 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46872 (request call id 257) took 1057 ms. Trace:
I20260709 13:08:53.724234 15477 rpcz_store.cc:276] 0709 13:08:52.660639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.660826 (+   187us) service_pool.cc:224] Handling call
0709 13:08:53.717985 (+1057159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348566,"reported_tablets":4}
I20260709 13:08:53.722388 15473 rpcz_store.cc:276] 0709 13:08:52.433456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.438168 (+  4712us) service_pool.cc:224] Handling call
0709 13:08:53.713102 (+1274934us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:53.343063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:53.473883 (+130820us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:53.473918 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:53.473937 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:53.474425 (+   488us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:53.474533 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:53.474562 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:53.474910 (+   348us) tablet.cc:701] Row locks acquired
0709 13:08:53.474931 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:53.475105 (+   174us) write_op.cc:270] Start()
0709 13:08:53.475226 (+   121us) write_op.cc:276] Timestamp: P: 1783602533475054 usec, L: 0
0709 13:08:53.475249 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:53.475949 (+   700us) log.cc:844] Serialized 982 byte log entry
0709 13:08:53.667283 (+191334us) op_driver.cc:464] REPLICATION: finished
0709 13:08:53.705297 (+ 38014us) write_op.cc:301] APPLY: starting
0709 13:08:53.705388 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:53.707258 (+  1870us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:53.707366 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:53.708587 (+  1221us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:53.708767 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:08:53.708814 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:53.709012 (+   198us) log.cc:844] Serialized 33 byte log entry
0709 13:08:53.709185 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:53.709273 (+    88us) write_op.cc:454] Released schema lock
0709 13:08:53.709314 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:53.709697 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:53.709731 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":315819,"reported_tablets":4,"spinlock_wait_cycles":20992,"child_traces":[["op",{"apply.queue_time_us":37726,"apply.run_cpu_time_us":4232,"apply.run_wall_time_us":4383,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":155440,"prepare.run_cpu_time_us":3284,"prepare.run_wall_time_us":156056,"replication_time_us":191873,"thread_start_us":129378,"threads_started":2}]]}
I20260709 13:08:53.742712 15462 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 554babfb4498479a98f58801621b0dac with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.753955 15654 raft_consensus.cc:2955] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 7 to 13, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:53.769822 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index 7 to 13, VOTER 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131) evicted. New cstate: current_term: 19 leader_uuid: "8995ef9978c446769377fc0e9a0cb9c1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.790997 21733 tablet_replica.cc:333] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:08:53.792280 21733 raft_consensus.cc:2243] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.793081 21733 raft_consensus.cc:2272] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.817866 15712 tablet_service.cc:1558] Processing DeleteTablet for tablet 554babfb4498479a98f58801621b0dac with delete_type TABLET_DATA_TOMBSTONED (TS 0afe96ac1d4a48728e3ac0814d8867b1 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36626
I20260709 13:08:53.820498 21733 ts_tablet_manager.cc:1916] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.869601 21730 ts_tablet_manager.cc:1929] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:08:53.870383 21730 log.cc:1199] T 361bd26d633f474ba34078d9cf76f22f P 680390d3f0884c91bf1f22ba914b438a: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/wals/361bd26d633f474ba34078d9cf76f22f
I20260709 13:08:53.891601 21733 ts_tablet_manager.cc:1929] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:08:53.892190 21733 log.cc:1199] T 78d5d462c9e4427f934553b90818efd6 P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/78d5d462c9e4427f934553b90818efd6
I20260709 13:08:53.917740 15463 catalog_manager.cc:5028] TS 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): tablet 361bd26d633f474ba34078d9cf76f22f (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:08:54.038664 21733 tablet_replica.cc:333] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:08:54.040189 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 78d5d462c9e4427f934553b90818efd6 (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:08:54.160481 15721 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:08:54.211210 15654 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:54.212973 21633 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:54.219091 15576 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:54.225193 21596 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:54.244302 21733 raft_consensus.cc:2243] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.245893 21733 raft_consensus.cc:2272] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.250005 15692 consensus_peers.cc:597] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301): Couldn't send request to peer 681370bcf39d46b189ec8e9a5957f93d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a425ca03b12f47b49b434d40007e90b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.252769 21733 ts_tablet_manager.cc:1916] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.267328 21716 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:08:54.289808 15576 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:08:54.294170 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.340368 15654 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:08:54.364416 21733 ts_tablet_manager.cc:1929] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:08:54.381394 21733 log.cc:1199] T 554babfb4498479a98f58801621b0dac P 0afe96ac1d4a48728e3ac0814d8867b1: Deleting WAL directory at /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/wals/554babfb4498479a98f58801621b0dac
I20260709 13:08:54.383817 15463 catalog_manager.cc:5028] TS 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): tablet 554babfb4498479a98f58801621b0dac (table test-workload [id=1d37ea52136e4b2d8b48a3fee3fc418a]) successfully deleted
I20260709 13:08:54.398319 15473 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 reported cstate change: config changed from index -1 to 10, NON_VOTER 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) added. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } } }
I20260709 13:08:54.641489 15576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:54.642377 15576 raft_consensus.cc:606] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Received request to transfer leadership to TS 0afe96ac1d4a48728e3ac0814d8867b1
I20260709 13:08:54.647830 15576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6"
dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
mode: GRACEFUL
new_leader_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:43846
I20260709 13:08:54.648418 15576 raft_consensus.cc:606] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Received request to transfer leadership to TS 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:54.649734 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:54.651564 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:54.702261 21711 raft_consensus.cc:993] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:54.702754 21711 raft_consensus.cc:1081] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Signalling peer 681370bcf39d46b189ec8e9a5957f93d to start an election
I20260709 13:08:54.704679 16277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6"
dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
 from {username='slave'} at 127.0.0.1:39940
I20260709 13:08:54.705369 16277 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.705760 16277 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.726269 16277 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:54.728431 16277 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:54.731702 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:54.732484 15654 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.736397 15576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:54.736986 15576 raft_consensus.cc:3055] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:54.737262 15576 raft_consensus.cc:740] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:54.738125 15576 consensus_queue.cc:260] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:54.739435 15576 raft_consensus.cc:3060] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:54.763836 15576 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:54.764130 21743 ts_tablet_manager.cc:933] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Initiating tablet copy from peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:54.765213 16235 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:54.777025 21666 raft_consensus.cc:2804] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:54.777606 21666 raft_consensus.cc:697] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:54.778620 21666 consensus_queue.cc:237] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:54.766068 15654 raft_consensus.cc:2468] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:54.807682 15475 catalog_manager.cc:5697] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 12 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 13 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.827721 21743 tablet_copy_client.cc:323] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.34.131:34333
I20260709 13:08:54.833709 15738 tablet_copy_service.cc:140] P 0afe96ac1d4a48728e3ac0814d8867b1: Received BeginTabletCopySession request for tablet a425ca03b12f47b49b434d40007e90b5 from peer 681370bcf39d46b189ec8e9a5957f93d ({username='slave'} at 127.0.0.1:34148)
I20260709 13:08:54.834347 15738 tablet_copy_service.cc:161] P 0afe96ac1d4a48728e3ac0814d8867b1: Beginning new tablet copy session on tablet a425ca03b12f47b49b434d40007e90b5 from peer 681370bcf39d46b189ec8e9a5957f93d at {username='slave'} at 127.0.0.1:34148: session id = 681370bcf39d46b189ec8e9a5957f93d-a425ca03b12f47b49b434d40007e90b5
I20260709 13:08:54.845875 15738 tablet_copy_source_session.cc:215] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.854933 21743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a425ca03b12f47b49b434d40007e90b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.942123 21743 tablet_copy_client.cc:806] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.943102 21743 tablet_copy_client.cc:670] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:54.948294 21743 tablet_copy_client.cc:538] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.979523 21743 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap starting.
I20260709 13:08:55.073853 21713 raft_consensus.cc:993] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: : Instructing follower 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:55.074486 21713 raft_consensus.cc:1081] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Signalling peer 0afe96ac1d4a48728e3ac0814d8867b1 to start an election
I20260709 13:08:55.076591 15725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6043256b63964d729edc1a480d265404"
dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
 from {username='slave'} at 127.0.0.1:44464
I20260709 13:08:55.086524 15725 raft_consensus.cc:493] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.087514 15725 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.122278 15725 raft_consensus.cc:515] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:55.139932 15725 leader_election.cc:290] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:55.145603 15580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "8995ef9978c446769377fc0e9a0cb9c1"
I20260709 13:08:55.146293 15580 raft_consensus.cc:3055] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:55.146646 15580 raft_consensus.cc:740] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8995ef9978c446769377fc0e9a0cb9c1, State: Running, Role: LEADER
I20260709 13:08:55.147604 15580 consensus_queue.cc:260] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:55.149019 15580 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.156250 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6043256b63964d729edc1a480d265404" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:55.181351 21743 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.205557 16272 raft_consensus.cc:3060] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:55.206540 21743 tablet_bootstrap.cc:492] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Bootstrap complete.
I20260709 13:08:55.207379 21743 ts_tablet_manager.cc:1403] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent bootstrapping tablet: real 0.228s	user 0.033s	sys 0.012s
I20260709 13:08:55.210881 15647 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:55.210584 21743 raft_consensus.cc:359] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:08:55.211441 21743 raft_consensus.cc:740] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Initialized, Role: LEARNER
I20260709 13:08:55.212198 21743 consensus_queue.cc:260] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:08:55.212452 21707 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:55.215716 21743 ts_tablet_manager.cc:1434] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:55.223744 16272 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:55.225816 15738 tablet_copy_service.cc:342] P 0afe96ac1d4a48728e3ac0814d8867b1: Request end of tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a425ca03b12f47b49b434d40007e90b5 received from {username='slave'} at 127.0.0.1:34148
I20260709 13:08:55.226424 15738 tablet_copy_service.cc:434] P 0afe96ac1d4a48728e3ac0814d8867b1: ending tablet copy session 681370bcf39d46b189ec8e9a5957f93d-a425ca03b12f47b49b434d40007e90b5 on tablet a425ca03b12f47b49b434d40007e90b5 with peer 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:55.258313 15580 raft_consensus.cc:2468] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:55.322536 15692 leader_election.cc:304] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1; no voters: 
I20260709 13:08:55.340770 21590 raft_consensus.cc:2804] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:55.365105 15576 raft_consensus.cc:1275] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:55.383005 21753 consensus_queue.cc:1048] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:55.394181 21590 raft_consensus.cc:697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:55.396378 21590 consensus_queue.cc:237] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:55.433480 15475 catalog_manager.cc:5697] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 13 to 14, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 14 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.652689 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.789341 16272 raft_consensus.cc:1217] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:08:55.845918 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
W20260709 13:08:55.867434 15692 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:08:55.889245 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.892711 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.905957 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.942754 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.996177 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 64631.1us
I20260709 13:08:56.022437 16277 raft_consensus.cc:1275] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:56.047397 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 68265.6us
I20260709 13:08:56.050803 21754 consensus_queue.cc:1048] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:08:56.062148 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.065398 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.068071 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.070443 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.075398 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.079862 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.103024 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.157661 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.158352 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.158959 15618 consensus_peers.cc:597] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.167563 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.172276 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.171386 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.174190 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.189528 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.190296 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.209190 15692 consensus_peers.cc:597] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.223711 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.226962 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.257611 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.261559 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.262240 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.262307 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.269307 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.273309 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:56.274176 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.276461 14474 tablet_replica.cc:333] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.277550 14474 raft_consensus.cc:2243] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.278868 14474 raft_consensus.cc:2272] T b1059a62c94747b0b296ee50ba126991 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.281916 14474 tablet_replica.cc:333] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
W20260709 13:08:56.282457 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.283005 14474 raft_consensus.cc:2243] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.283735 14474 raft_consensus.cc:2272] T 796cbc2fdf89418ea0827815b500d50a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.286656 14474 tablet_replica.cc:333] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.287513 14474 raft_consensus.cc:2243] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.288242 14474 raft_consensus.cc:2272] T 89f37c80078841efa574af907a802c86 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:56.297133 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.302888 14474 tablet_replica.cc:333] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.303795 14474 raft_consensus.cc:2243] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.304405 14474 raft_consensus.cc:2272] T c7551fe74b4949e1b7ca08793d185c8f P 8995ef9978c446769377fc0e9a0cb9c1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.307124 14474 tablet_replica.cc:333] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.307976 14474 raft_consensus.cc:2243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.308701 14474 raft_consensus.cc:2272] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 8995ef9978c446769377fc0e9a0cb9c1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.311740 14474 tablet_replica.cc:333] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.312570 14474 raft_consensus.cc:2243] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.313799 14474 raft_consensus.cc:2272] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.333106 14474 tablet_replica.cc:333] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.333963 14474 raft_consensus.cc:2243] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.334640 14474 raft_consensus.cc:2272] T 1c3913ed9e5b4674a9091483756deadf P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.337476 14474 tablet_replica.cc:333] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.338414 14474 raft_consensus.cc:2243] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.339190 14474 raft_consensus.cc:2272] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.341970 14474 tablet_replica.cc:333] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.342790 14474 raft_consensus.cc:2243] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.343458 14474 raft_consensus.cc:2272] T 8f9faf7687b644b6871b03c7adb9f3e3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.346582 14474 tablet_replica.cc:333] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.347393 14474 raft_consensus.cc:2243] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.348600 14474 raft_consensus.cc:2272] T b42acde8d7184571acdbe8d34af2df1f P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.351605 14474 tablet_replica.cc:333] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.352451 14474 raft_consensus.cc:2243] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.353338 14474 raft_consensus.cc:2272] T 8d98a5c01953408b8ad3eb550494fbf2 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.356142 14474 tablet_replica.cc:333] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.356880 14474 raft_consensus.cc:2243] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.357601 14474 raft_consensus.cc:2272] T 2b413aeb892643a1af655defc3b03c4d P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.360229 14474 tablet_replica.cc:333] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.361007 14474 raft_consensus.cc:2243] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.361572 14474 raft_consensus.cc:2272] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.364632 14474 tablet_replica.cc:333] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.365450 14474 raft_consensus.cc:2243] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.366174 14474 raft_consensus.cc:2272] T 57649fad66734a1786f0f9c09f4fa317 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.374605 21754 raft_consensus.cc:1064] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: attempting to promote NON_VOTER 681370bcf39d46b189ec8e9a5957f93d to VOTER
I20260709 13:08:56.377561 21754 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:56.407138 15648 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:56.436081 14474 tablet_replica.cc:333] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.437309 14474 raft_consensus.cc:2243] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.438787 14474 raft_consensus.cc:2272] T 6043256b63964d729edc1a480d265404 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.452961 14474 tablet_replica.cc:333] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.453747 14474 raft_consensus.cc:2243] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.454969 14474 raft_consensus.cc:2272] T 78b5c231d4c74287b7bcdae567611bea P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.457769 14474 tablet_replica.cc:333] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.458573 14474 raft_consensus.cc:2243] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.459676 14474 raft_consensus.cc:2272] T 836934bdc16146549eca0b7b8b6f3bbe P 8995ef9978c446769377fc0e9a0cb9c1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.460273 15721 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:56.462320 14474 tablet_replica.cc:333] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.462493 21634 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:56.463130 14474 raft_consensus.cc:2243] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.464213 14474 raft_consensus.cc:2272] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.473333 14474 tablet_replica.cc:333] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.474303 14474 raft_consensus.cc:2243] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.474934 14474 raft_consensus.cc:2272] T f73e75e796664f8198da4aa0a96ea07a P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.476003 16272 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEARNER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.480721 16272 raft_consensus.cc:1275] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:56.482788 21622 consensus_queue.cc:1048] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:56.489596 15648 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:56.508865 21770 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:56.512212 21769 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:56.514056 14474 tablet_replica.cc:333] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.514995 14474 raft_consensus.cc:2243] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.515625 14474 raft_consensus.cc:2272] T dfa9aad2b798480db18c5b0e3bac6a57 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:56.541522 15692 consensus_peers.cc:597] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.627615 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 57134.9us
I20260709 13:08:56.821211 14474 tablet_replica.cc:333] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.822161 14474 raft_consensus.cc:2243] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.845847 14474 raft_consensus.cc:2272] T 233f2755fc484e7fb202702622c7b652 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:56.840996 21782 log.cc:927] Time spent T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:08:56.862737 21775 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Append to log took a long time: real 0.347s	user 0.002s	sys 0.003s
W20260709 13:08:56.895642 21774 log.cc:927] Time spent T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: Append to log took a long time: real 0.392s	user 0.000s	sys 0.002s
I20260709 13:08:56.920032 21752 raft_consensus.cc:493] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:56.920719 21752 raft_consensus.cc:515] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:56.922278 21719 raft_consensus.cc:493] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:56.922932 21719 raft_consensus.cc:515] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:56.935173 21752 leader_election.cc:290] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:56.936704 14474 tablet_replica.cc:333] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:56.938012 14474 raft_consensus.cc:2243] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.939195 14474 raft_consensus.cc:2272] T 0e2176261a314ecdb0b1c0ff764de958 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.925662 21719 leader_election.cc:290] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:56.974400 21719 raft_consensus.cc:493] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:56.975140 21719 raft_consensus.cc:515] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:56.977932 21719 leader_election.cc:290] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.003830 21752 raft_consensus.cc:493] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:57.004426 21752 raft_consensus.cc:515] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.007781 21752 leader_election.cc:290] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.011823 15646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.012130 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.013790 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.014845 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.044768 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88df0ea72a7846ebb2982ffb2d948734" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.025588 21798 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:57.050689 21798 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:57.023068 21719 raft_consensus.cc:493] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:57.056692 15726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1e42035c3d46ac90631305fec02672" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.057823 21752 raft_consensus.cc:493] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:57.058111 21798 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:57.058560 21752 raft_consensus.cc:515] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.059345 21797 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:57.060029 21797 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.056800 21719 raft_consensus.cc:515] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:57.078845 21719 leader_election.cc:290] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:57.081096 21752 leader_election.cc:290] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.073256 21797 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.082293 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.084468 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a81a07de3df43208a6b3b6331e8c158" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.088464 15652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.088907 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.089972 15544 leader_election.cc:304] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:57.091622 21752 raft_consensus.cc:2749] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:57.100006 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d7922f778044c7b5600f9d4024c1b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.100108 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.101752 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5d462c9e4427f934553b90818efd6" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.104462 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.104735 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.107168 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e251fb313da4e75911104bd3aedca42" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.110368 15543 leader_election.cc:304] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.110474 15649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291273c09814d929a78b8c6da15ad25" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.111919 15543 leader_election.cc:304] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.112718 21798 raft_consensus.cc:2749] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.112962 14474 tablet_replica.cc:333] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.113438 21799 raft_consensus.cc:2749] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:57.113869 14474 raft_consensus.cc:2243] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.113973 15543 leader_election.cc:304] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.125003 15543 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.126485 21797 raft_consensus.cc:2749] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.127566 21797 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:57.128527 15543 leader_election.cc:304] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.129277 14474 raft_consensus.cc:2272] T 9027c3c93a9b4774bba818a406e5e36b P 8995ef9978c446769377fc0e9a0cb9c1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.132381 14474 tablet_replica.cc:333] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.133560 14474 raft_consensus.cc:2243] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.118453 15544 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:57.151036 16274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.024s	sys 0.045s
W20260709 13:08:57.151690 16274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.024s	sys 0.045s
I20260709 13:08:57.166788 14474 raft_consensus.cc:2272] T f3f2e1d93d5244bb997f6e208e9bbc20 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.170924 21798 raft_consensus.cc:2749] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:57.169631 21779 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:57.172083 15543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 43634.2us
I20260709 13:08:57.175459 14474 tablet_replica.cc:333] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.176589 14474 raft_consensus.cc:2243] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.177268 14474 raft_consensus.cc:2272] T 88df0ea72a7846ebb2982ffb2d948734 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.180351 14474 tablet_replica.cc:333] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.181142 14474 raft_consensus.cc:2243] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:57.183100 15544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 64738us
I20260709 13:08:57.190724 15544 leader_election.cc:304] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
W20260709 13:08:57.209880 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 78291.1us
I20260709 13:08:57.195319 21798 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:57.212563 21797 raft_consensus.cc:493] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:57.219419 21797 raft_consensus.cc:515] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.220248 21590 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.208711 21719 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:08:57.231616 21719 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.204195 21752 raft_consensus.cc:2749] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:57.242892 21711 raft_consensus.cc:670] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:08:57.245292 21797 leader_election.cc:290] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.249867 14474 raft_consensus.cc:2272] T 9d6936bd27314fcb82914d68a6cae45e P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.274893 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.275779 21719 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.270959 21797 raft_consensus.cc:493] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:57.276690 21797 raft_consensus.cc:515] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: NON_VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: true } }
I20260709 13:08:57.276734 15724 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.278857 21797 leader_election.cc:290] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:57.282936 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 45734.1us
I20260709 13:08:57.265383 21798 raft_consensus.cc:493] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:57.289253 21798 raft_consensus.cc:515] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.298928 14474 tablet_replica.cc:333] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.299990 14474 raft_consensus.cc:2243] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.305325 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.308331 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3f2e1d93d5244bb997f6e208e9bbc20 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:08:57.314465 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7baa38cef34b39ab9d39592b319ba3" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.314478 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.314563 15475 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: config changed from index 4 to 9, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 12 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.320137 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070f910fe7cf4a4ca2ca43b63d4d997f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.310585 16274 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.321560 15543 leader_election.cc:304] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.308526 15654 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.331449 21798 leader_election.cc:290] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.332104 21798 raft_consensus.cc:493] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0afe96ac1d4a48728e3ac0814d8867b1)
I20260709 13:08:57.332623 21798 raft_consensus.cc:515] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:57.334995 21752 raft_consensus.cc:2749] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:57.338164 21781 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.338737 21781 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.341110 21781 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.319293 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a425ca03b12f47b49b434d40007e90b5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.345515 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.317422 21711 raft_consensus.cc:493] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 681370bcf39d46b189ec8e9a5957f93d)
I20260709 13:08:57.346246 21711 raft_consensus.cc:515] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.348335 21711 leader_election.cc:290] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.351773 15544 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.351824 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.352322 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "361bd26d633f474ba34078d9cf76f22f" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.353498 21799 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:57.356402 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de522f1a56b4d09aebf0748d415d7d5" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.359195 15544 leader_election.cc:304] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:57.360343 15544 leader_election.cc:304] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:08:57.361366 15544 leader_election.cc:304] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:08:57.364303 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 45041.2us
I20260709 13:08:57.368986 21807 raft_consensus.cc:2749] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:57.362959 21799 raft_consensus.cc:2749] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.366792 21711 raft_consensus.cc:2749] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:57.386952 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.387213 21798 leader_election.cc:290] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:57.387921 15723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c036f4b115e847feb37d916989af7159" candidate_uuid: "8995ef9978c446769377fc0e9a0cb9c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.396003 15544 leader_election.cc:304] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8995ef9978c446769377fc0e9a0cb9c1; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:08:57.409534 14474 raft_consensus.cc:2272] T 554babfb4498479a98f58801621b0dac P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.403187 21798 raft_consensus.cc:2749] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:57.444831 14474 tablet_replica.cc:333] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.445685 14474 raft_consensus.cc:2243] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:08:57.451654 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 142607us
I20260709 13:08:57.476454 14474 raft_consensus.cc:2272] T 92dd48cf0c9c49d98f7da6f98ac56241 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.471220 16272 raft_consensus.cc:2955] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.477622 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.478659 21786 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.481383 21786 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.499378 21786 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:57.502737 14474 tablet_replica.cc:333] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.503696 14474 raft_consensus.cc:2243] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.504467 14474 raft_consensus.cc:2272] T a425ca03b12f47b49b434d40007e90b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.515892 14474 tablet_replica.cc:333] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.517930 21590 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.518605 21590 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.519215 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.520906 21590 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.532146 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:57.534195 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 48619.3us
I20260709 13:08:57.534343 16275 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 10.
W20260709 13:08:57.540392 15618 leader_election.cc:336] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.540912 15618 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.542243 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.543156 21590 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:57.544697 21590 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.545181 21590 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.549034 21802 raft_consensus.cc:493] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.549630 21802 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.550105 14474 raft_consensus.cc:2243] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.551822 14474 raft_consensus.cc:2272] T 2b55db060b644f01bd9ec436b864e377 P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.552265 21802 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:57.552925 15692 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:57.563320 16235 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.563875 16235 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.564658 21786 raft_consensus.cc:2749] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:57.571527 21779 raft_consensus.cc:2749] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:57.569563 21590 raft_consensus.cc:515] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.577051 21590 leader_election.cc:290] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.578137 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.589125 15720 raft_consensus.cc:2393] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 11: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
I20260709 13:08:57.578598 14474 tablet_replica.cc:333] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.591696 14474 raft_consensus.cc:2243] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:08:57.592794 15692 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.602296 15473 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: config changed from index 10 to 11, 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.581352 16235 leader_election.cc:336] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.584693 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836934bdc16146549eca0b7b8b6f3bbe" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:57.587831 21770 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.606529 21770 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.608268 16236 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.608795 21770 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.609126 21786 raft_consensus.cc:3060] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:57.620592 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.621294 16275 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 14.
I20260709 13:08:57.622576 21786 raft_consensus.cc:2749] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:57.624969 21802 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.625520 21802 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.627966 21802 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:57.592960 14474 raft_consensus.cc:2272] T f9377274f9c9482a924840f15b616a13 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.629024 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.629722 15654 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:08:57.630884 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.632349 16272 raft_consensus.cc:2468] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:57.633005 21783 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:57.633396 21783 raft_consensus.cc:493] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.633760 21783 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.629330 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.636083 21770 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:57.636447 21770 raft_consensus.cc:493] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.636811 21770 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.644783 14474 tablet_replica.cc:333] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.645365 21770 raft_consensus.cc:515] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.658865 21783 raft_consensus.cc:515] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.663771 15692 leader_election.cc:304] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.664728 14474 raft_consensus.cc:2243] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.661815 21786 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:57.666989 15692 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.667304 21590 raft_consensus.cc:2804] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:57.678987 21590 raft_consensus.cc:697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:57.680027 21590 consensus_queue.cc:237] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.670542 21786 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.686870 21786 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:57.688817 21783 leader_election.cc:290] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:57.689679 14474 raft_consensus.cc:2272] T 361bd26d633f474ba34078d9cf76f22f P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.689929 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1059a62c94747b0b296ee50ba126991" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:57.690600 15647 raft_consensus.cc:3060] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:57.692688 14474 tablet_replica.cc:333] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.693861 14474 raft_consensus.cc:2243] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:57.694931 14474 raft_consensus.cc:2272] T 93645f909b36412c9d021e6d4cb8f9d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.697539 21770 leader_election.cc:290] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.699502 15647 raft_consensus.cc:2468] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:08:57.700711 16236 leader_election.cc:304] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.706701 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52b1ff912bd4f07a795a7bfccb8a2f0" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:57.707360 16272 raft_consensus.cc:3060] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:57.716364 15724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:57.719045 21783 raft_consensus.cc:2804] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:57.719754 21783 raft_consensus.cc:697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:57.720642 21783 consensus_queue.cc:237] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.724774 15720 consensus_queue.cc:237] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.747364 16272 raft_consensus.cc:2468] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
W20260709 13:08:57.752732 15462 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 135253us
W20260709 13:08:57.755288 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:57.752357 21802 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.767652 21802 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.769764 21802 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:57.772835 14474 tablet_replica.cc:333] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.774052 14474 raft_consensus.cc:2243] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.795811 21781 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.796563 21781 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.799996 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.800709 15647 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:08:57.798972 21781 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.811249 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.811996 16275 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
W20260709 13:08:57.815442 15618 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.820091 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.820348 21805 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.821503 21802 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:57.813021 16235 leader_election.cc:336] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.821185 21805 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.828752 14474 raft_consensus.cc:2272] T 070f910fe7cf4a4ca2ca43b63d4d997f P 8995ef9978c446769377fc0e9a0cb9c1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.836212 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.827899 21802 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:57.857973 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 130270us
I20260709 13:08:57.860195 15475 catalog_manager.cc:5697] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 13 to 14, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 14 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.867144 15692 leader_election.cc:304] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:08:57.868040 16235 leader_election.cc:336] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:57.868691 15692 leader_election.cc:336] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.869577 16235 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.869796 16272 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:57.873910 21791 raft_consensus.cc:2804] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:57.874488 21791 raft_consensus.cc:697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:57.875484 21791 consensus_queue.cc:237] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.890129 21805 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:57.894688 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:57.856819 21802 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.847930 21665 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:57.903616 16235 leader_election.cc:336] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:57.906993 16235 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.905864 21665 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.923560 21778 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.930142 21823 raft_consensus.cc:2749] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:57.929831 21778 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:57.931000 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 120938us
I20260709 13:08:57.933621 21778 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.935948 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:57.936757 16275 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 15.
I20260709 13:08:57.940146 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:57.946627 21781 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:57.947114 21781 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.947544 21781 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:57.921968 21665 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:57.956579 16235 leader_election.cc:336] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.957087 16235 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:57.959105 21785 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:57.966993 21754 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:57.952524 21821 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:57.981415 21821 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:57.983664 21821 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:57.989128 15472 catalog_manager.cc:5697] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 10 to 11, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 11 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.991888 14474 tablet_replica.cc:333] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:57.986158 21754 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:57.992745 14474 raft_consensus.cc:2243] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.993332 14474 raft_consensus.cc:2272] T c036f4b115e847feb37d916989af7159 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.001299 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:58.001998 16275 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:58.002696 21665 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.004721 21665 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:58.009021 15647 raft_consensus.cc:1275] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:58.010614 16275 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:58.022429 21590 consensus_queue.cc:1048] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:58.029709 14474 tablet_replica.cc:333] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.030575 14474 raft_consensus.cc:2243] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:58.031666 14474 raft_consensus.cc:2272] T e25768ee42b44e978e9d8764ecd10199 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.032660 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:58.032748 15475 catalog_manager.cc:5697] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 14 to 15, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 15 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.035456 15647 raft_consensus.cc:2955] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
I20260709 13:08:58.039779 21772 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:58.042299 15463 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a425ca03b12f47b49b434d40007e90b5 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:58.043501 14474 tablet_replica.cc:333] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.044113 21802 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:58.046208 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 106162us
I20260709 13:08:58.047387 21772 raft_consensus.cc:493] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.051554 21772 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.054442 21781 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.056486 21781 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:58.047344 15692 leader_election.cc:336] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:58.057062 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 127595us
I20260709 13:08:58.058835 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:58.061975 16272 raft_consensus.cc:2393] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 680390d3f0884c91bf1f22ba914b438a in current term 16: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:58.062424 21802 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:58.063645 14474 raft_consensus.cc:2243] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:58.069068 15618 leader_election.cc:336] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.071130 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:58.071969 15650 raft_consensus.cc:2393] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 16: Already voted for candidate 680390d3f0884c91bf1f22ba914b438a in this term.
W20260709 13:08:58.083392 16235 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.083963 16235 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.085737 21783 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:58.092288 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57eafeb5dcb749c7be00fa4c5e0eae26" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:58.092864 16270 raft_consensus.cc:3060] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:58.094342 21772 raft_consensus.cc:515] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.096397 21772 leader_election.cc:290] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:58.099687 16270 raft_consensus.cc:2468] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 16.
I20260709 13:08:58.102133 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42acde8d7184571acdbe8d34af2df1f" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:58.103641 16272 raft_consensus.cc:3060] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:58.108608 16273 raft_consensus.cc:1275] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:58.110311 14474 raft_consensus.cc:2272] T 83d7922f778044c7b5600f9d4024c1b5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.110422 15475 catalog_manager.cc:5697] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: config changed from index 11 to 12, VOTER 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) evicted. New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } } }
W20260709 13:08:58.109716 15618 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.112424 15618 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.113258 21781 raft_consensus.cc:2749] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:58.120648 15618 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:58.121475 21754 consensus_queue.cc:1048] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:58.122179 21781 raft_consensus.cc:2804] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:58.122730 15692 leader_election.cc:336] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.122735 21781 raft_consensus.cc:697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:58.124060 21781 consensus_queue.cc:237] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.127959 16272 raft_consensus.cc:2468] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 13.
I20260709 13:08:58.113214 14474 tablet_replica.cc:333] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.130517 14474 raft_consensus.cc:2243] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:58.136634 15618 leader_election.cc:336] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.143271 14474 raft_consensus.cc:2272] T 8291273c09814d929a78b8c6da15ad25 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:58.148536 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.157001 15692 leader_election.cc:304] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.159260 14474 tablet_replica.cc:333] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.165241 14474 raft_consensus.cc:2243] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:58.166529 14474 raft_consensus.cc:2272] T 78adb81d1456468f8ad75e99085c54ba P 8995ef9978c446769377fc0e9a0cb9c1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.169309 14474 tablet_replica.cc:333] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.170279 21754 raft_consensus.cc:2804] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:58.170948 21754 raft_consensus.cc:697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:58.172873 21754 consensus_queue.cc:237] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.173916 15473 catalog_manager.cc:5697] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 15 to 16, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 16 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:58.180678 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.188457 14474 raft_consensus.cc:2243] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:08:58.189797 14474 raft_consensus.cc:2272] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.193014 14474 tablet_replica.cc:333] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.193753 14474 raft_consensus.cc:2243] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.218197 14474 raft_consensus.cc:2272] T 7e251fb313da4e75911104bd3aedca42 P 8995ef9978c446769377fc0e9a0cb9c1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.221066 14474 tablet_replica.cc:333] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.221854 14474 raft_consensus.cc:2243] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.222503 14474 raft_consensus.cc:2272] T 0f7baa38cef34b39ab9d39592b319ba3 P 8995ef9978c446769377fc0e9a0cb9c1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.227303 14474 tablet_replica.cc:333] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.227866 15647 raft_consensus.cc:1275] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.228092 14474 raft_consensus.cc:2243] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.229554 14474 raft_consensus.cc:2272] T 9a81a07de3df43208a6b3b6331e8c158 P 8995ef9978c446769377fc0e9a0cb9c1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.230976 21785 consensus_queue.cc:1048] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:58.232250 14474 tablet_replica.cc:333] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.233114 14474 raft_consensus.cc:2243] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.233765 14474 raft_consensus.cc:2272] T 5de522f1a56b4d09aebf0748d415d7d5 P 8995ef9978c446769377fc0e9a0cb9c1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.236816 14474 tablet_replica.cc:333] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.237547 14474 raft_consensus.cc:2243] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.238117 14474 raft_consensus.cc:2272] T da1e42035c3d46ac90631305fec02672 P 8995ef9978c446769377fc0e9a0cb9c1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.241353 14474 tablet_replica.cc:333] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1: stopping tablet replica
I20260709 13:08:58.243148 14474 raft_consensus.cc:2243] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:58.243721 14474 raft_consensus.cc:2272] T 78d5d462c9e4427f934553b90818efd6 P 8995ef9978c446769377fc0e9a0cb9c1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:58.224562 15473 catalog_manager.cc:5697] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 12 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 13 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.423203 16272 raft_consensus.cc:1275] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:58.427304 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.437408 21791 consensus_queue.cc:1048] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:58.513847 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.515645 21827 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.515105 21665 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.525380 21827 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:58.530627 21827 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:58.531261 21665 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.531700 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:58.533345 21665 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:58.537639 15618 leader_election.cc:336] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.538121 15618 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.538234 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:58.540546 21665 raft_consensus.cc:2749] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:58.542464 15618 leader_election.cc:336] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.543011 15618 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.544034 21665 raft_consensus.cc:2749] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:58.555660 21754 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.556233 21754 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:58.559352 15647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:58.559978 15647 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 17.
I20260709 13:08:58.563325 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
I20260709 13:08:58.564201 21772 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:58.564597 21772 raft_consensus.cc:493] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.564944 21772 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.565227 21590 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.565750 21590 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.567822 21590 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:58.575685 21754 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:58.576720 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.579756 16273 raft_consensus.cc:1275] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:08:58.581142 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:58.584455 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.584326 21826 consensus_queue.cc:1048] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:58.585179 21785 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.585780 21785 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.586783 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:58.579784 21772 raft_consensus.cc:515] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:58.587872 16273 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 7.
W20260709 13:08:58.592303 16235 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.593432 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92dd48cf0c9c49d98f7da6f98ac56241" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:58.594046 21772 leader_election.cc:290] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:58.594063 15650 raft_consensus.cc:3060] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.607160 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:58.608035 21838 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.609337 21838 raft_consensus.cc:493] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.609503 21816 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.609751 21838 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.610558 21785 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
W20260709 13:08:58.687951 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 56687.3us
W20260709 13:08:58.700677 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.684345 21816 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.691953 21838 raft_consensus.cc:515] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.711946 21816 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333), 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045)
I20260709 13:08:58.714989 21838 leader_election.cc:290] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:58.719107 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.721665 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:58.723892 15720 raft_consensus.cc:2393] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 681370bcf39d46b189ec8e9a5957f93d in current term 8: Already voted for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in this term.
W20260709 13:08:58.724009 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:58.721815 15692 leader_election.cc:336] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.714993 15650 raft_consensus.cc:2468] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 18.
W20260709 13:08:58.725391 15692 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.727393 15693 leader_election.cc:304] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:58.727995 15692 leader_election.cc:336] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.728308 21838 raft_consensus.cc:2804] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:58.729211 21838 raft_consensus.cc:697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:58.730307 21838 consensus_queue.cc:237] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:08:58.733976 15692 leader_election.cc:336] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.741197 16236 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.743795 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9027c3c93a9b4774bba818a406e5e36b" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:58.755846 16235 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.755945 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:58.763020 16273 raft_consensus.cc:1275] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:08:58.772780 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.742385 21816 raft_consensus.cc:3060] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.774489 16236 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.776762 21802 raft_consensus.cc:2749] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:58.781694 21754 consensus_queue.cc:1048] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:58.786217 21802 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.786906 21802 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:58.794924 16235 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.796989 21802 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:58.798739 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:58.800431 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.802069 21802 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:58.808218 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a425ca03b12f47b49b434d40007e90b5: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:58.815800 21816 raft_consensus.cc:2749] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:58.821653 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.823628 21781 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.824399 21781 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:58.825313 16272 raft_consensus.cc:2468] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 8.
I20260709 13:08:58.828337 15720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:58.829095 21802 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.829624 21802 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.830476 15692 leader_election.cc:304] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.831951 21754 raft_consensus.cc:2804] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:58.832401 21802 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:58.832482 21754 raft_consensus.cc:697] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:58.833762 21754 consensus_queue.cc:237] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.834666 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:58.835443 15650 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 19.
I20260709 13:08:58.836434 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:58.837613 21816 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:58.838239 21816 raft_consensus.cc:493] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
W20260709 13:08:58.838514 16235 leader_election.cc:336] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.838721 21816 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:58.848673 15618 leader_election.cc:336] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.851142 15618 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.855726 21816 raft_consensus.cc:515] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:58.864573 16235 leader_election.cc:336] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:58.867753 21828 raft_consensus.cc:2749] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:58.862883 21781 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:58.887984 15472 catalog_manager.cc:5697] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 17 to 18, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 18 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.886844 21816 leader_election.cc:290] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:58.893935 15650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554babfb4498479a98f58801621b0dac" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:58.896008 15650 raft_consensus.cc:3060] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:58.914426 15650 raft_consensus.cc:2468] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 20.
I20260709 13:08:58.916134 16236 leader_election.cc:304] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:58.921226 21783 raft_consensus.cc:2804] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:58.927253 21783 raft_consensus.cc:697] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 20 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:58.928216 21783 consensus_queue.cc:237] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:58.945343 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 77979.8us
I20260709 13:08:58.961768 21590 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:58.962503 21590 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:58.964948 21590 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:58.976580 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:58.977264 16272 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
W20260709 13:08:58.958088 15618 connection.cc:769] client connection to 127.14.34.129:45045 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:59.005021 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:59.007133 21821 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.007730 21821 raft_consensus.cc:493] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.008177 21821 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.018473 21783 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.019088 21783 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.021425 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.021932 15692 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.026286 15473 catalog_manager.cc:5697] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 19 to 20, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 20 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.033480 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
W20260709 13:08:59.037360 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.022555 21821 raft_consensus.cc:515] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.043574 21826 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.047343 21826 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.049556 21826 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:59.053841 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.054708 16235 leader_election.cc:336] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.056044 16235 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.061362 21823 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:59.021917 21783 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:59.070097 15692 leader_election.cc:336] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:08:59.076792 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.077529 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.084961 21821 leader_election.cc:290] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:59.086355 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b55db060b644f01bd9ec436b864e377" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:59.086833 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.087222 16273 raft_consensus.cc:3060] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:59.087389 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.087942 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.089205 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:59.089844 16272 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
W20260709 13:08:59.101852 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.102432 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.103963 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:59.104838 21826 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.105268 21826 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.105718 21826 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.109942 15473 catalog_manager.cc:5697] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 7 to 8, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 8 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.113313 16273 raft_consensus.cc:2468] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:59.115700 21826 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.118654 15692 leader_election.cc:304] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.120762 21590 raft_consensus.cc:2804] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:59.121284 21590 raft_consensus.cc:697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:59.121402 21838 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.122078 21838 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:59.122192 21590 consensus_queue.cc:237] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.124172 21838 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:59.124967 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.126255 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:59.126967 15654 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 19.
I20260709 13:08:59.128989 15693 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 
W20260709 13:08:59.129586 15692 leader_election.cc:336] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.129951 21838 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:59.130383 21838 raft_consensus.cc:493] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.130765 21838 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:59.131476 21844 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.132001 21844 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.133468 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.134080 21844 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:59.140883 21838 raft_consensus.cc:515] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:59.156762 15473 catalog_manager.cc:5697] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 12 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.165246 21826 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:59.122707 15618 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.175022 21838 leader_election.cc:290] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:59.176525 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 53826.4us
I20260709 13:08:59.177335 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93645f909b36412c9d021e6d4cb8f9d5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:59.177904 15654 raft_consensus.cc:3060] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:59.187788 15692 leader_election.cc:336] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.193451 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:59.194248 16273 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 12.
I20260709 13:08:59.195708 15654 raft_consensus.cc:2468] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 20.
I20260709 13:08:59.196151 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9377274f9c9482a924840f15b616a13" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:59.199149 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.199865 16272 raft_consensus.cc:3060] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.200629 15693 leader_election.cc:304] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.202216 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:59.202371 21590 raft_consensus.cc:2804] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:59.202926 21590 raft_consensus.cc:697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:59.203707 21590 consensus_queue.cc:237] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:08:59.204356 21827 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:59.204820 21827 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.205196 21827 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:59.208215 16272 raft_consensus.cc:2468] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:59.216567 21827 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.218684 15618 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:59.219439 21844 raft_consensus.cc:2804] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.219991 21844 raft_consensus.cc:697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:59.221333 21827 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:59.220947 21844 consensus_queue.cc:237] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.231117 15618 leader_election.cc:336] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:08:59.234591 15618 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.235806 15473 catalog_manager.cc:5697] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 19 to 20, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 20 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.239441 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.230990 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25768ee42b44e978e9d8764ecd10199" candidate_uuid: "680390d3f0884c91bf1f22ba914b438a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
W20260709 13:08:59.239497 15618 leader_election.cc:336] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.240784 16272 raft_consensus.cc:3060] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:59.246548 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.247157 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.279982 16272 raft_consensus.cc:2468] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680390d3f0884c91bf1f22ba914b438a in term 13.
I20260709 13:08:59.281303 15618 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.282157 21827 raft_consensus.cc:2804] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:59.282680 21827 raft_consensus.cc:697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Becoming Leader. State: Replica: 680390d3f0884c91bf1f22ba914b438a, State: Running, Role: LEADER
I20260709 13:08:59.283612 21827 consensus_queue.cc:237] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.290612 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.293052 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.306119 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.310111 16273 raft_consensus.cc:1275] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:59.314658 15654 raft_consensus.cc:1275] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:59.318898 21590 consensus_queue.cc:1048] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:59.319919 21838 consensus_queue.cc:1048] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:59.329779 15473 catalog_manager.cc:5697] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 12 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.335167 21783 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.335911 21783 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.339354 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.356441 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.356832 16235 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:08:59.357031 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.360061 21783 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:59.379623 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:59.389667 16236 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.390537 21823 raft_consensus.cc:2749] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.394853 15472 catalog_manager.cc:5697] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a reported cstate change: term changed from 12 to 13, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 680390d3f0884c91bf1f22ba914b438a (127.14.34.130). New cstate: current_term: 13 leader_uuid: "680390d3f0884c91bf1f22ba914b438a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.401971 21754 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.402640 21754 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.404929 21754 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:59.410944 15692 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.417444 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:08:59.418215 16277 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:08:59.424202 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.425503 21590 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:59.425927 21590 raft_consensus.cc:493] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.426327 21590 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:59.433825 15647 raft_consensus.cc:1275] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:59.438861 21783 consensus_queue.cc:1048] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:59.440124 21590 raft_consensus.cc:515] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.442245 21590 leader_election.cc:290] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:08:59.444058 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.446794 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78adb81d1456468f8ad75e99085c54ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:08:59.447405 16277 raft_consensus.cc:3060] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:59.448521 15692 leader_election.cc:336] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.456562 16277 raft_consensus.cc:2468] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
I20260709 13:08:59.461643 15692 leader_election.cc:304] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.463423 21754 raft_consensus.cc:2804] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:59.463950 21754 raft_consensus.cc:697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:08:59.464813 21754 consensus_queue.cc:237] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.482818 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:59.487811 21783 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.488464 21783 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.490842 21783 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:59.496249 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:08:59.497044 15725 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 9.
I20260709 13:08:59.497882 21821 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.500752 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:08:59.506199 21821 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.508589 21821 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:08:59.501616 21783 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.511626 21783 raft_consensus.cc:493] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8995ef9978c446769377fc0e9a0cb9c1)
I20260709 13:08:59.512068 21783 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.516265 15473 catalog_manager.cc:5697] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 11 to 12, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 12 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:59.518791 16235 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.521867 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:08:59.530126 15692 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:08:59.557973 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.588645 21783 raft_consensus.cc:515] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.601094 16277 raft_consensus.cc:1275] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:59.611291 16272 raft_consensus.cc:2393] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0afe96ac1d4a48728e3ac0814d8867b1 in current term 10: Already voted for candidate 681370bcf39d46b189ec8e9a5957f93d in this term.
I20260709 13:08:59.611827 21821 consensus_queue.cc:1048] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:59.619756 15692 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 681370bcf39d46b189ec8e9a5957f93d, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.621716 21821 raft_consensus.cc:3060] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.627147 21783 leader_election.cc:290] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:08:59.626832 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aaafafa2c8f482d8b66bb15c3b1b088" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
W20260709 13:08:59.635531 16235 leader_election.cc:336] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.642972 21821 raft_consensus.cc:2749] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:59.653044 15725 raft_consensus.cc:2468] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 10.
W20260709 13:08:59.659911 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.672441 16236 leader_election.cc:304] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.673880 21783 raft_consensus.cc:2804] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:59.674420 21783 raft_consensus.cc:697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:59.675288 21783 consensus_queue.cc:237] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.700174 16272 raft_consensus.cc:1275] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:59.702813 21826 consensus_queue.cc:1048] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:59.705771 15654 raft_consensus.cc:1275] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:59.708693 21772 consensus_queue.cc:1048] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:59.711658 15475 catalog_manager.cc:5697] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 9 to 10, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 10 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.744406 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.759811 16277 raft_consensus.cc:1275] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Refusing update from remote peer 680390d3f0884c91bf1f22ba914b438a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:59.761559 21827 consensus_queue.cc:1048] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:59.806080 21783 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.806663 21783 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:08:59.808880 21783 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:08:59.809748 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.816938 16235 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:08:59.819866 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.824867 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a" is_pre_election: true
I20260709 13:08:59.839329 15654 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 16.
I20260709 13:08:59.844075 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.845201 21783 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:59.845597 21783 raft_consensus.cc:493] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.845934 21783 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:59.881481 21783 raft_consensus.cc:515] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.892839 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.894979 21783 leader_election.cc:290] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Requested vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:08:59.898715 15654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b5c231d4c74287b7bcdae567611bea" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "680390d3f0884c91bf1f22ba914b438a"
I20260709 13:08:59.899353 15654 raft_consensus.cc:3060] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:59.907207 16235 leader_election.cc:336] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:08:59.913288 15654 raft_consensus.cc:2468] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 17.
I20260709 13:08:59.914750 16236 leader_election.cc:304] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d; no voters: 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:08:59.915601 21783 raft_consensus.cc:2804] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:59.918912 21783 raft_consensus.cc:697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:08:59.919960 21783 consensus_queue.cc:237] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:08:59.950305 14474 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15601)
I20260709 13:08:59.966813 15472 catalog_manager.cc:5697] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 15 to 17, leader changed from 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 17 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.971462 16272 raft_consensus.cc:1275] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Refusing update from remote peer 0afe96ac1d4a48728e3ac0814d8867b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:59.974298 21821 consensus_queue.cc:1048] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:00.223315 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.253459 15720 raft_consensus.cc:1275] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:00.256354 21816 consensus_queue.cc:1048] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:00.281191 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:00.364439 15650 raft_consensus.cc:1275] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Refusing update from remote peer 681370bcf39d46b189ec8e9a5957f93d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:00.366220 21783 consensus_queue.cc:1048] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Connected to new peer: Peer: permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:00.383031 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.478623 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 65550.8us
W20260709 13:09:00.751017 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.882295 15618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111) [suppressed 390 similar messages]
W20260709 13:09:00.910127 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.951402 14474 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:00.954336 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.957649 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.958362 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.012971 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.160404 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.178841 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.189502 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.213708 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.265628 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.269477 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.270539 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.280123 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.298696 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.402326 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 43981.7us
W20260709 13:09:01.484767 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.490904 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.549305 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.576530 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.583199 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.588733 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.620518 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.650920 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.672945 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.689893 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.693583 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.827437 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.831612 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.850791 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.854260 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.885736 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.901872 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.927884 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.943533 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.952101 14474 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:02.034000 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.177021 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.179865 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.187157 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.212194 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.213863 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.263787 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.270581 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.386631 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:02.649652 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.725293 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:02.953199 14474 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:03.176736 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 48571.9us
W20260709 13:09:03.186678 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.199692 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.222481 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.253186 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.398063 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.560138 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.572628 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.598981 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.664629 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.699981 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.710103 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.833850 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.865681 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.892874 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.954106 14474 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:03.957883 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.976269 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.003018 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.039731 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.041375 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.082329 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.286335 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.298820 15693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44871, user_credentials={real_user=slave}} blocked reactor thread for 56262.8us
W20260709 13:09:04.321149 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.329123 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.342372 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.373481 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.374132 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.378346 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.386083 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.407927 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.417824 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.502466 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.514401 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.523344 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.524590 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.600871 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.615463 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.633936 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.705340 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.770361 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.775561 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.775978 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.855589 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.954730 14474 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:05.135357 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:05.352078 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:05.616206 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.701367 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.724740 16235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 173526us
W20260709 13:09:05.826953 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.845752 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.923676 15692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111) [suppressed 436 similar messages]
W20260709 13:09:05.955236 14474 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:05.955710 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.075563 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.085407 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.136051 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.173857 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.299358 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.360201 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.407671 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.412678 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.422508 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.458238 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.498575 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.498521 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.575018 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:06.611330 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.673362 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.688743 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.763788 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08003597e0 after lost signal to thread 14477
W20260709 13:09:06.764966 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed740 after lost signal to thread 15512
W20260709 13:09:06.766394 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed720 after lost signal to thread 15679
W20260709 13:09:06.767508 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed060 after lost signal to thread 15753
W20260709 13:09:06.767688 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.768682 16299 debug-util.cc:398] Leaking SignalData structure 0x7b08004153a0 after lost signal to thread 16302
W20260709 13:09:06.864940 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.909355 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.928438 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.929219 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.931749 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 47115.6us
W20260709 13:09:06.934182 16236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44339.5us
W20260709 13:09:06.945420 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.953799 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.955703 14474 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:06.982170 15618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 96704.7us
W20260709 13:09:07.080106 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.081274 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.116101 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.139526 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.144948 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.172360 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.180384 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.191035 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.196035 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.205652 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.208345 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.249493 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.347186 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.481344 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.501890 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.571882 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.934432 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:07.956219 14474 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:08.131623 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.250279 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.251017 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.266256 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.321312 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.543920 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.658243 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.666014 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.740996 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.768369 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.808225 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.820194 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.856175 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.945354 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.949050 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.956748 14474 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:09.177680 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.178836 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.197868 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.253575 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.265645 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.266526 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.288342 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.311626 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.333181 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.360114 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.369719 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.397123 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.404022 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.408241 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.446416 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.605792 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.619515 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.658564 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.663844 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.767336 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.803305 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.810729 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.810937 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.887691 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.919489 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.957278 14474 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:10.117950 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:10.122359 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:10.182289 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:10.455297 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:10.504972 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.610287 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.655331 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.668754 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd960 after lost signal to thread 14477
W20260709 13:09:10.670272 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7640 after lost signal to thread 15512
W20260709 13:09:10.671854 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800259640 after lost signal to thread 15679
W20260709 13:09:10.743880 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdd60 after lost signal to thread 15753
W20260709 13:09:10.745528 15750 debug-util.cc:398] Leaking SignalData structure 0x7b080041c740 after lost signal to thread 16302
W20260709 13:09:10.748106 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.901480 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:45045, user_credentials={real_user=slave}} blocked reactor thread for 62434.1us
W20260709 13:09:10.956439 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.957755 14474 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:10.957706 15618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111) [suppressed 430 similar messages]
W20260709 13:09:10.977306 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.194772 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.334533 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.362099 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.376964 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.386318 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.454306 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.481212 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.502944 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.509989 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.540870 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.622911 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.653880 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.664340 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.731369 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.739682 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.844355 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.850244 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.862440 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.932219 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.958233 14474 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:12.048821 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.056478 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.293202 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.301357 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.366609 15692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:39301, user_credentials={real_user=slave}} blocked reactor thread for 300982us
W20260709 13:09:12.369063 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.394285 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.397647 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.398520 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.398998 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.421381 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.424005 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.424916 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.421751 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.448094 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.460716 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.593463 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.709985 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.917181 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.958758 14474 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:13.002388 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:13.136881 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.156344 15509 debug-util.cc:398] Leaking SignalData structure 0x7b080017a0e0 after lost signal to thread 14477
W20260709 13:09:13.157467 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08003c17c0 after lost signal to thread 15512
W20260709 13:09:13.158856 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08002294c0 after lost signal to thread 15679
W20260709 13:09:13.160048 15509 debug-util.cc:398] Leaking SignalData structure 0x7b0800376f20 after lost signal to thread 15753
W20260709 13:09:13.161267 15509 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd8a0 after lost signal to thread 16302
W20260709 13:09:13.248759 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.399520 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.405732 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.461151 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.647629 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08003c53a0 after lost signal to thread 14477
W20260709 13:09:13.648927 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf6a0 after lost signal to thread 15512
W20260709 13:09:13.650431 15750 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff9a0 after lost signal to thread 15679
W20260709 13:09:13.651623 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800108540 after lost signal to thread 15753
W20260709 13:09:13.652837 15750 debug-util.cc:398] Leaking SignalData structure 0x7b0800037560 after lost signal to thread 16302
W20260709 13:09:13.692302 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.943114 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.960496 14474 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:14.008525 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.072381 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.095917 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.105098 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.118620 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.186411 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.288331 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.458259 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.489029 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.490765 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.491360 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.491914 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.492581 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.503089 15619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:34333, user_credentials={real_user=slave}} blocked reactor thread for 44219.3us
W20260709 13:09:14.504015 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.597911 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.634913 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.655815 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.659602 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.685415 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.690138 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.730206 15618 consensus_peers.cc:597] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.734519 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.787119 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:14.862214 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.869014 15618 consensus_peers.cc:597] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.923281 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.961961 14474 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:14.961886 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.963187 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.991444 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.037619 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.131597 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.200637 15618 consensus_peers.cc:597] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.389846 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.424537 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.443327 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.516137 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.682240 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.695559 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.701836 15618 consensus_peers.cc:597] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.740005 15618 consensus_peers.cc:597] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.772316 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:15.871688 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.963096 14474 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 15601)
W20260709 13:09:15.964077 15618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 13:09:15.969741 15618 consensus_peers.cc:597] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.993819 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.196280 15618 consensus_peers.cc:597] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.466495 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.568323 15618 consensus_peers.cc:597] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:16.592350 15618 consensus_peers.cc:597] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.644336 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:16.760799 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.798949 15692 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.826901 15692 consensus_peers.cc:597] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:16.838304 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
W20260709 13:09:16.863862 15692 consensus_peers.cc:597] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:16.909922 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.933508 15692 consensus_peers.cc:597] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:16.963737 15692 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:16.994014 15692 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:17.026419 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
W20260709 13:09:17.029670 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.041867 15692 consensus_peers.cc:597] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.058676 16236 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.093552 15693 consensus_peers.cc:597] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.099237 16236 consensus_peers.cc:597] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.108803 15618 consensus_peers.cc:597] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.121025 16236 consensus_peers.cc:597] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.139506 16236 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.143224 15693 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.144950 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:17.148625 14474 tablet_replica.cc:333] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
W20260709 13:09:17.149103 15693 consensus_peers.cc:597] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.152125 14474 raft_consensus.cc:2243] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.154452 14474 raft_consensus.cc:2272] T 89f37c80078841efa574af907a802c86 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.157158 15692 consensus_peers.cc:597] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.157621 14474 tablet_replica.cc:333] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.158650 14474 raft_consensus.cc:2243] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.159921 14474 raft_consensus.cc:2272] T c7551fe74b4949e1b7ca08793d185c8f P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.161167 15693 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.162348 16236 consensus_peers.cc:597] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.163717 16236 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.163833 15693 consensus_peers.cc:597] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.164463 16236 consensus_peers.cc:597] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.163093 14474 tablet_replica.cc:333] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.165853 14474 raft_consensus.cc:2243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.167178 14474 raft_consensus.cc:2272] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 680390d3f0884c91bf1f22ba914b438a [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.168282 15692 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.169857 14474 tablet_replica.cc:333] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.170785 14474 raft_consensus.cc:2243] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.171768 14474 raft_consensus.cc:2272] T 796cbc2fdf89418ea0827815b500d50a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.174299 14474 tablet_replica.cc:333] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.174964 14474 raft_consensus.cc:2243] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.175510 14474 raft_consensus.cc:2272] T b1059a62c94747b0b296ee50ba126991 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.178481 14474 tablet_replica.cc:333] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.179468 14474 raft_consensus.cc:2243] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.180627 14474 raft_consensus.cc:2272] T 8f9faf7687b644b6871b03c7adb9f3e3 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.183629 14474 tablet_replica.cc:333] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.184403 14474 raft_consensus.cc:2243] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.185120 14474 raft_consensus.cc:2272] T 363fa81d735347758e73efea5dc3fae6 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.188225 14474 tablet_replica.cc:333] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.189210 14474 raft_consensus.cc:2243] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.189529 15693 consensus_peers.cc:597] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.189952 14474 raft_consensus.cc:2272] T 1c3913ed9e5b4674a9091483756deadf P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.193125 14474 tablet_replica.cc:333] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.193962 14474 raft_consensus.cc:2243] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.194761 15692 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.194943 14474 raft_consensus.cc:2272] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.197865 14474 tablet_replica.cc:333] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.198525 14474 raft_consensus.cc:2243] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.199440 14474 raft_consensus.cc:2272] T 5fd8c2b67a6b46399004625b89edc3ba P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.202232 14474 tablet_replica.cc:333] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.203073 14474 raft_consensus.cc:2243] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.203749 14474 raft_consensus.cc:2272] T 0eba092a851143659b8e87e62bb71b1c P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.206142 14474 tablet_replica.cc:333] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.206753 14474 raft_consensus.cc:2243] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.207351 14474 raft_consensus.cc:2272] T 8d98a5c01953408b8ad3eb550494fbf2 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.209340 14474 tablet_replica.cc:333] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.209932 14474 raft_consensus.cc:2243] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.211076 14474 raft_consensus.cc:2272] T 2b413aeb892643a1af655defc3b03c4d P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.213824 14474 tablet_replica.cc:333] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.214743 14474 raft_consensus.cc:2243] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:17.214890 16236 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.215523 14474 raft_consensus.cc:2272] T 6a514609784146e8a8b6917d543f83e7 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.218521 14474 tablet_replica.cc:333] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.219343 14474 raft_consensus.cc:2243] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.220605 14474 raft_consensus.cc:2272] T 692cb3906e474706ae13f98e2b050415 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.223642 14474 tablet_replica.cc:333] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.224596 14474 raft_consensus.cc:2243] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.226320 14474 raft_consensus.cc:2272] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.228750 14474 tablet_replica.cc:333] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.229326 14474 raft_consensus.cc:2243] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.229998 14474 raft_consensus.cc:2272] T 78b5c231d4c74287b7bcdae567611bea P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.232321 14474 tablet_replica.cc:333] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.233059 14474 raft_consensus.cc:2243] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.233757 14474 raft_consensus.cc:2272] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.236097 14474 tablet_replica.cc:333] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.236770 14474 raft_consensus.cc:2243] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.237880 14474 raft_consensus.cc:2272] T 57649fad66734a1786f0f9c09f4fa317 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.239953 14474 tablet_replica.cc:333] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.240572 14474 raft_consensus.cc:2243] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.241261 14474 raft_consensus.cc:2272] T f73e75e796664f8198da4aa0a96ea07a P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.243376 14474 tablet_replica.cc:333] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.244084 14474 raft_consensus.cc:2243] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.245041 14474 raft_consensus.cc:2272] T 69ec834a3b71420c9f09248e41809358 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.247195 14474 tablet_replica.cc:333] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.247879 14474 raft_consensus.cc:2243] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.248425 14474 raft_consensus.cc:2272] T a7a0379477ed4600a60cd9fde8f2867a P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.251158 14474 tablet_replica.cc:333] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.252218 14474 raft_consensus.cc:2243] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.253070 14474 raft_consensus.cc:2272] T 0e2176261a314ecdb0b1c0ff764de958 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.255960 14474 tablet_replica.cc:333] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.256745 14474 raft_consensus.cc:2243] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.258064 14474 raft_consensus.cc:2272] T ab663998de28482d8438f0c594104dd5 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.258178 16235 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.260483 14474 tablet_replica.cc:333] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.261135 14474 raft_consensus.cc:2243] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.262239 14474 raft_consensus.cc:2272] T f9377274f9c9482a924840f15b616a13 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.264678 14474 tablet_replica.cc:333] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.265492 14474 raft_consensus.cc:2243] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.266156 14474 raft_consensus.cc:2272] T 93645f909b36412c9d021e6d4cb8f9d5 P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.269018 14474 tablet_replica.cc:333] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.269853 14474 raft_consensus.cc:2243] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.271100 14474 raft_consensus.cc:2272] T 070f910fe7cf4a4ca2ca43b63d4d997f P 680390d3f0884c91bf1f22ba914b438a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.273892 14474 tablet_replica.cc:333] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.274740 14474 raft_consensus.cc:2243] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:09:17.275208 15693 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.275907 14474 raft_consensus.cc:2272] T f3f2e1d93d5244bb997f6e208e9bbc20 P 680390d3f0884c91bf1f22ba914b438a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.278187 14474 tablet_replica.cc:333] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.279013 14474 raft_consensus.cc:2243] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.279884 14474 raft_consensus.cc:2272] T 88df0ea72a7846ebb2982ffb2d948734 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.282537 14474 tablet_replica.cc:333] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.283262 14474 raft_consensus.cc:2243] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.284117 14474 raft_consensus.cc:2272] T 554babfb4498479a98f58801621b0dac P 680390d3f0884c91bf1f22ba914b438a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.286535 14474 tablet_replica.cc:333] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.287298 14474 raft_consensus.cc:2243] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.287910 14474 raft_consensus.cc:2272] T 9d6936bd27314fcb82914d68a6cae45e P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.290751 14474 tablet_replica.cc:333] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.291529 14474 raft_consensus.cc:2243] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.292290 14474 raft_consensus.cc:2272] T 92dd48cf0c9c49d98f7da6f98ac56241 P 680390d3f0884c91bf1f22ba914b438a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.295120 14474 tablet_replica.cc:333] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.295941 14474 raft_consensus.cc:2243] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.297161 14474 raft_consensus.cc:2272] T a425ca03b12f47b49b434d40007e90b5 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.298182 15692 consensus_peers.cc:597] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:17.300124 14474 tablet_replica.cc:333] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
W20260709 13:09:17.300324 16236 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.301043 14474 raft_consensus.cc:2243] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.301762 14474 raft_consensus.cc:2272] T 4f560ec7039940e59212368b2f12385e P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.304461 16236 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.304740 14474 tablet_replica.cc:333] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.305709 14474 raft_consensus.cc:2243] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.306322 14474 raft_consensus.cc:2272] T a96efb5d87b14ca19297799c72e797f0 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.308077 15693 consensus_peers.cc:597] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.308209 16236 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.311151 14474 tablet_replica.cc:333] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.312100 14474 raft_consensus.cc:2243] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:09:17.312395 15618 consensus_peers.cc:597] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:17.313283 14474 raft_consensus.cc:2272] T 40c2674fd9d04c0fb406ca8f6eef4025 P 680390d3f0884c91bf1f22ba914b438a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.315685 14474 tablet_replica.cc:333] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.316311 14474 raft_consensus.cc:2243] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.316934 14474 raft_consensus.cc:2272] T c036f4b115e847feb37d916989af7159 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.319022 14474 tablet_replica.cc:333] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.319628 14474 raft_consensus.cc:2243] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.321125 14474 raft_consensus.cc:2272] T e25768ee42b44e978e9d8764ecd10199 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.323611 14474 tablet_replica.cc:333] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.324229 14474 raft_consensus.cc:2243] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.325173 14474 raft_consensus.cc:2272] T 83d7922f778044c7b5600f9d4024c1b5 P 680390d3f0884c91bf1f22ba914b438a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.327929 14474 tablet_replica.cc:333] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.328507 14474 raft_consensus.cc:2243] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.329010 14474 raft_consensus.cc:2272] T 8291273c09814d929a78b8c6da15ad25 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.331346 14474 tablet_replica.cc:333] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.332041 14474 raft_consensus.cc:2243] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.332657 14474 raft_consensus.cc:2272] T 9e1128bef1224facb3c1a31e94fb0379 P 680390d3f0884c91bf1f22ba914b438a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.335335 14474 tablet_replica.cc:333] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.336028 14474 raft_consensus.cc:2243] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.337294 14474 raft_consensus.cc:2272] T dd80b5819c634a02a3dd8e2d112db507 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.340296 14474 tablet_replica.cc:333] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
W20260709 13:09:17.340917 15692 consensus_peers.cc:597] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.341048 14474 raft_consensus.cc:2243] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.341856 14474 raft_consensus.cc:2272] T da1e42035c3d46ac90631305fec02672 P 680390d3f0884c91bf1f22ba914b438a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.344241 14474 tablet_replica.cc:333] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.344866 14474 raft_consensus.cc:2243] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:17.345402 14474 raft_consensus.cc:2272] T 78d5d462c9e4427f934553b90818efd6 P 680390d3f0884c91bf1f22ba914b438a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:17.347708 14474 tablet_replica.cc:333] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a: stopping tablet replica
I20260709 13:09:17.348371 14474 raft_consensus.cc:2243] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:17.349550 14474 raft_consensus.cc:2272] T 9a81a07de3df43208a6b3b6331e8c158 P 680390d3f0884c91bf1f22ba914b438a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:17.369817 16236 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.375135 15693 consensus_peers.cc:597] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.382774 15693 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.428946 15693 consensus_peers.cc:597] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.447417 16236 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.506592 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.531548 15693 consensus_peers.cc:597] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.532956 16236 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.537694 15692 consensus_peers.cc:597] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.551084 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.567231 15692 consensus_peers.cc:597] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.615658 15693 consensus_peers.cc:597] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.682186 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:17.838479 16235 consensus_peers.cc:597] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.869518 15692 consensus_peers.cc:597] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:17.869930 15692 consensus_peers.cc:597] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:18.012315 16235 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:18.089134 15692 consensus_peers.cc:597] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:18.117765 16235 consensus_peers.cc:597] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:18.170152 21955 raft_consensus.cc:493] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.170745 21955 raft_consensus.cc:515] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.173224 21955 leader_election.cc:290] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:09:18.174190 21962 raft_consensus.cc:493] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.175760 21962 raft_consensus.cc:515] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:09:18.177973 21962 leader_election.cc:290] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.179060 16235 leader_election.cc:336] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:18.183699 16236 leader_election.cc:336] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
W20260709 13:09:18.183786 15692 leader_election.cc:336] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.184176 16236 leader_election.cc:304] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.185038 21955 raft_consensus.cc:2749] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:18.188287 15693 leader_election.cc:336] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.188823 15693 leader_election.cc:304] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.189605 21962 raft_consensus.cc:2749] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.201234 21955 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.201789 21955 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.204107 21955 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.206535 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:09:18.209347 16236 leader_election.cc:336] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.210425 16236 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.211071 21955 raft_consensus.cc:2749] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:18.285655 21962 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.286304 21962 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.288656 21955 raft_consensus.cc:493] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.288686 21962 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.289316 21955 raft_consensus.cc:515] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.290408 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:09:18.292865 15693 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.293049 21955 leader_election.cc:290] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:09:18.294147 15693 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
W20260709 13:09:18.295622 16235 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.295367 21962 raft_consensus.cc:2749] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:18.298734 16236 leader_election.cc:336] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.299163 16236 leader_election.cc:304] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.299768 21955 raft_consensus.cc:2749] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.323316 21962 raft_consensus.cc:493] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.323849 21962 raft_consensus.cc:515] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:09:18.325896 21962 leader_election.cc:290] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.329355 15692 leader_election.cc:336] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:18.329825 15693 leader_election.cc:336] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.330340 15693 leader_election.cc:304] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.331236 21969 raft_consensus.cc:2749] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:18.363219 21962 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.363739 21962 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.365742 21962 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.367645 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
W20260709 13:09:18.369181 15693 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.369519 15693 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:09:18.370131 21962 raft_consensus.cc:2749] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.387315 21955 raft_consensus.cc:493] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:09:18.387650 16235 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:18.387853 21955 raft_consensus.cc:515] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.390014 21955 leader_election.cc:290] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.393663 16236 leader_election.cc:336] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
W20260709 13:09:18.395553 16235 leader_election.cc:336] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.395902 16235 leader_election.cc:304] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.396519 21955 raft_consensus.cc:2749] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:18.396886 21962 raft_consensus.cc:493] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.397861 21962 raft_consensus.cc:515] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:09:18.399899 21962 leader_election.cc:290] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.405690 15692 leader_election.cc:336] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.406778 21962 raft_consensus.cc:493] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.407310 21962 raft_consensus.cc:515] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
W20260709 13:09:18.407021 15693 leader_election.cc:336] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.408161 15693 leader_election.cc:304] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.408905 21969 raft_consensus.cc:2749] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.409471 21962 leader_election.cc:290] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.414407 15692 leader_election.cc:336] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:18.417143 15692 consensus_peers.cc:597] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:18.419353 15693 leader_election.cc:336] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.419744 15693 leader_election.cc:304] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.420326 21962 raft_consensus.cc:2749] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:18.427022 21955 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.427628 21955 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.429621 21955 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.430852 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:09:18.433760 16236 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.434199 16236 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.434748 21955 raft_consensus.cc:2749] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.437477 21962 raft_consensus.cc:493] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.438045 21962 raft_consensus.cc:515] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:09:18.440122 21962 leader_election.cc:290] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.445330 15692 leader_election.cc:336] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.448671 21955 raft_consensus.cc:493] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.449296 21955 raft_consensus.cc:515] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:09:18.450973 15693 leader_election.cc:336] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.451442 15693 leader_election.cc:304] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.451531 21955 leader_election.cc:290] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:09:18.452337 21962 raft_consensus.cc:2749] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:18.457857 16235 leader_election.cc:336] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:18.459254 16236 leader_election.cc:336] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.461477 16236 leader_election.cc:304] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.462214 21955 raft_consensus.cc:2749] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:18.493848 16235 consensus_peers.cc:597] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:18.504874 21955 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.505436 21955 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.506963 21955 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.508450 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:09:18.510157 16236 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.510591 16236 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.511227 21955 raft_consensus.cc:2749] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.521045 21969 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.521555 21969 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.523371 21969 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.524710 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:09:18.525367 16275 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:09:18.526353 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:09:18.526952 15693 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.527148 21969 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.527592 21969 raft_consensus.cc:493] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.527933 21969 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.535738 21969 raft_consensus.cc:515] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.541292 21969 leader_election.cc:290] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.543848 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ec834a3b71420c9f09248e41809358" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:09:18.544502 16275 raft_consensus.cc:3060] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:18.546295 15693 leader_election.cc:336] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.550362 16275 raft_consensus.cc:2468] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:09:18.551397 15692 leader_election.cc:304] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.552004 21969 raft_consensus.cc:2804] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:18.552507 21969 raft_consensus.cc:697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:09:18.553282 21969 consensus_queue.cc:237] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.567097 15473 catalog_manager.cc:5697] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 15 to 16, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 16 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.569828 21969 raft_consensus.cc:493] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.570966 21969 raft_consensus.cc:515] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } }
I20260709 13:09:18.571977 21964 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.572543 21964 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.573176 21969 leader_election.cc:290] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
W20260709 13:09:18.577095 15692 leader_election.cc:336] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:18.578145 21964 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.580068 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:09:18.580832 15725 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
W20260709 13:09:18.580848 15693 leader_election.cc:336] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.581444 15693 leader_election.cc:304] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.583392 21969 raft_consensus.cc:2749] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.583599 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:09:18.584399 21964 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:18.584796 21964 raft_consensus.cc:493] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:09:18.584996 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.585166 21964 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.592851 21964 raft_consensus.cc:515] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.595681 21964 leader_election.cc:290] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.598328 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692cb3906e474706ae13f98e2b050415" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:09:18.598935 15725 raft_consensus.cc:3060] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:18.605939 15725 raft_consensus.cc:2468] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
W20260709 13:09:18.607273 16236 leader_election.cc:336] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.612207 16236 leader_election.cc:304] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.613682 21962 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.614452 21962 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.613207 21964 raft_consensus.cc:2804] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:18.616161 21964 raft_consensus.cc:697] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:09:18.616953 21962 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.617136 21964 consensus_queue.cc:237] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.622016 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:09:18.625070 21977 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:09:18.625200 15693 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.625787 15693 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1; no voters: 680390d3f0884c91bf1f22ba914b438a, 681370bcf39d46b189ec8e9a5957f93d
I20260709 13:09:18.625619 21977 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.626626 21962 raft_consensus.cc:2749] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.629508 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:09:18.630136 15725 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 12.
I20260709 13:09:18.631305 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:09:18.632071 16236 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.629835 21977 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.632928 21955 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:18.633322 21955 raft_consensus.cc:493] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.633627 21955 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.640473 21955 raft_consensus.cc:515] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.642242 21955 leader_election.cc:290] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.645344 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
I20260709 13:09:18.644650 21969 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
W20260709 13:09:18.645642 16236 leader_election.cc:336] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.645426 15473 catalog_manager.cc:5697] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 13 to 14, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 14 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.646059 21969 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.646798 21964 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.647547 21964 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.648483 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f2e1d93d5244bb997f6e208e9bbc20" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:09:18.649080 15725 raft_consensus.cc:3060] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.650194 21964 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.652738 15721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
W20260709 13:09:18.657049 16236 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.657871 21969 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.658310 16236 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 0afe96ac1d4a48728e3ac0814d8867b1, 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.658452 15725 raft_consensus.cc:2468] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 13.
I20260709 13:09:18.659343 21955 raft_consensus.cc:2749] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:18.661168 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:09:18.661793 16275 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 19.
I20260709 13:09:18.663488 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:09:18.664453 21969 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:18.664860 21969 raft_consensus.cc:493] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.665242 21969 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:18.665102 16236 leader_election.cc:304] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.666570 21977 raft_consensus.cc:2804] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.667084 21977 raft_consensus.cc:697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:09:18.668476 21977 consensus_queue.cc:237] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.673317 21969 raft_consensus.cc:515] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
W20260709 13:09:18.674319 15693 leader_election.cc:336] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.675730 21969 leader_election.cc:290] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.676867 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd8c2b67a6b46399004625b89edc3ba" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:09:18.677456 16275 raft_consensus.cc:3060] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:18.684113 15693 leader_election.cc:336] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.686924 16275 raft_consensus.cc:2468] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 20.
I20260709 13:09:18.688136 15692 leader_election.cc:304] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.688987 21969 raft_consensus.cc:2804] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:18.688136 15473 catalog_manager.cc:5697] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 12 to 13, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 13 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.689551 21969 raft_consensus.cc:697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:09:18.690472 21969 consensus_queue.cc:237] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.711002 15473 catalog_manager.cc:5697] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 19 to 20, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 20 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.717154 21977 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.717849 21977 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.720428 21955 raft_consensus.cc:493] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.720963 21955 raft_consensus.cc:515] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8995ef9978c446769377fc0e9a0cb9c1" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 45045 } } peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.721772 21977 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.722982 21955 leader_election.cc:290] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045), 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871)
I20260709 13:09:18.723829 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" is_pre_election: true
I20260709 13:09:18.724484 15725 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 14.
I20260709 13:09:18.725613 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
I20260709 13:09:18.728404 21977 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.728804 21977 raft_consensus.cc:493] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.729226 21977 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:18.732826 16235 leader_election.cc:336] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
W20260709 13:09:18.733515 16235 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:18.734287 16236 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
W20260709 13:09:18.735107 16236 leader_election.cc:336] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.735548 16236 leader_election.cc:304] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a, 8995ef9978c446769377fc0e9a0cb9c1
I20260709 13:09:18.737494 21955 raft_consensus.cc:2749] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:18.746706 21977 raft_consensus.cc:515] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.748961 21977 leader_election.cc:290] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333)
I20260709 13:09:18.749981 15725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab663998de28482d8438f0c594104dd5" candidate_uuid: "681370bcf39d46b189ec8e9a5957f93d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0afe96ac1d4a48728e3ac0814d8867b1"
I20260709 13:09:18.750663 15725 raft_consensus.cc:3060] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:18.752419 16236 leader_election.cc:336] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.754104 21969 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.754698 21969 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.756593 15725 raft_consensus.cc:2468] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681370bcf39d46b189ec8e9a5957f93d in term 15.
I20260709 13:09:18.756981 21969 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.758211 16236 leader_election.cc:304] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.759394 21977 raft_consensus.cc:2804] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:18.759743 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:09:18.759985 21977 raft_consensus.cc:697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Becoming Leader. State: Replica: 681370bcf39d46b189ec8e9a5957f93d, State: Running, Role: LEADER
I20260709 13:09:18.760425 16275 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 15.
I20260709 13:09:18.761513 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 
W20260709 13:09:18.762301 15693 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.761288 21977 consensus_queue.cc:237] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.764645 21962 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:18.765103 21962 raft_consensus.cc:493] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.765566 21962 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.776785 21962 raft_consensus.cc:515] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.778960 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:09:18.781845 21969 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.783427 21962 leader_election.cc:290] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.784864 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd80b5819c634a02a3dd8e2d112db507" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:09:18.787352 16277 raft_consensus.cc:3060] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:18.782531 21969 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.798735 21969 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
W20260709 13:09:18.786595 15693 leader_election.cc:336] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.805305 16277 raft_consensus.cc:2468] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 16.
I20260709 13:09:18.801174 15473 catalog_manager.cc:5697] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d reported cstate change: term changed from 14 to 15, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132). New cstate: current_term: 15 leader_uuid: "681370bcf39d46b189ec8e9a5957f93d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.810317 15693 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.820071 15692 leader_election.cc:304] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.820315 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d" is_pre_election: true
I20260709 13:09:18.821028 16275 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 11.
I20260709 13:09:18.822474 21982 raft_consensus.cc:2804] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:18.823062 21982 raft_consensus.cc:697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:09:18.823568 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.823949 21982 consensus_queue.cc:237] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.829718 21954 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:18.830201 21954 raft_consensus.cc:493] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 680390d3f0884c91bf1f22ba914b438a)
I20260709 13:09:18.830554 21954 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:18.831357 16236 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.840024 21954 raft_consensus.cc:515] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.842772 21954 leader_election.cc:290] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Requested vote from peers 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871), 681370bcf39d46b189ec8e9a5957f93d (127.14.34.132:39301)
I20260709 13:09:18.845355 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c2674fd9d04c0fb406ca8f6eef4025" candidate_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "681370bcf39d46b189ec8e9a5957f93d"
I20260709 13:09:18.845880 16275 raft_consensus.cc:3060] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.854130 15473 catalog_manager.cc:5697] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 reported cstate change: term changed from 15 to 16, leader changed from 680390d3f0884c91bf1f22ba914b438a (127.14.34.130) to 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131). New cstate: current_term: 16 leader_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:18.862147 16236 consensus_peers.cc:597] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.866056 16275 raft_consensus.cc:2468] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0afe96ac1d4a48728e3ac0814d8867b1 in term 12.
W20260709 13:09:18.868186 16235 consensus_peers.cc:597] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:18.868798 15693 leader_election.cc:336] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111)
I20260709 13:09:18.870390 15692 leader_election.cc:304] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0afe96ac1d4a48728e3ac0814d8867b1, 681370bcf39d46b189ec8e9a5957f93d; no voters: 680390d3f0884c91bf1f22ba914b438a
I20260709 13:09:18.871199 21954 raft_consensus.cc:2804] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:18.874282 21954 raft_consensus.cc:697] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Becoming Leader. State: Replica: 0afe96ac1d4a48728e3ac0814d8867b1, State: Running, Role: LEADER
I20260709 13:09:18.875211 21954 consensus_queue.cc:237] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "680390d3f0884c91bf1f22ba914b438a" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44871 } } peers { permanent_uuid: "0afe96ac1d4a48728e3ac0814d8867b1" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 34333 } } peers { permanent_uuid: "681370bcf39d46b189ec8e9a5957f93d" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 39301 } attrs { promote: false } }
I20260709 13:09:18.876047 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:18.877210 14474 tablet_replica.cc:333] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.878078 14474 raft_consensus.cc:2243] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.879154 14474 raft_consensus.cc:2272] T 363fa81d735347758e73efea5dc3fae6 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.882207 14474 tablet_replica.cc:333] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.882862 14474 raft_consensus.cc:2243] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.883301 14474 raft_consensus.cc:2272] T 0eba092a851143659b8e87e62bb71b1c P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.885519 14474 tablet_replica.cc:333] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.886247 14474 raft_consensus.cc:2243] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.887007 14474 raft_consensus.cc:2272] T 796cbc2fdf89418ea0827815b500d50a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.890506 14474 tablet_replica.cc:333] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.891099 14474 raft_consensus.cc:2243] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.891562 14474 raft_consensus.cc:2272] T 8f9faf7687b644b6871b03c7adb9f3e3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.893425 14474 tablet_replica.cc:333] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.893960 14474 raft_consensus.cc:2243] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.894464 14474 raft_consensus.cc:2272] T 692cb3906e474706ae13f98e2b050415 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.896289 14474 tablet_replica.cc:333] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.896925 14474 raft_consensus.cc:2243] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.897629 14474 raft_consensus.cc:2272] T 6a514609784146e8a8b6917d543f83e7 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.899904 14474 tablet_replica.cc:333] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.900530 14474 raft_consensus.cc:2243] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.901077 14474 raft_consensus.cc:2272] T c7551fe74b4949e1b7ca08793d185c8f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.903602 14474 tablet_replica.cc:333] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.904361 14474 raft_consensus.cc:2243] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.904942 14474 raft_consensus.cc:2272] T 4b3d9415f6fb48709a2c4782cbf5ed31 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.906764 14474 tablet_replica.cc:333] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.907232 14474 raft_consensus.cc:2243] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.908036 14474 pending_rounds.cc:70] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Trying to abort 1 pending ops.
I20260709 13:09:18.908288 14474 pending_rounds.cc:77] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305636080404090880 op_type: NO_OP noop_request { }
I20260709 13:09:18.908725 14474 raft_consensus.cc:2889] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:18.909010 14474 raft_consensus.cc:2272] T 5fd8c2b67a6b46399004625b89edc3ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.911375 14474 tablet_replica.cc:333] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.912127 14474 raft_consensus.cc:2243] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.912974 14474 raft_consensus.cc:2272] T 8652a740787d4ef6a541ee7ee4b5a7c0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:18.914636 16236 consensus_peers.cc:597] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.915233 14474 tablet_replica.cc:333] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.915825 14474 raft_consensus.cc:2243] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.916868 14474 raft_consensus.cc:2272] T 6043256b63964d729edc1a480d265404 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.919294 14474 tablet_replica.cc:333] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.919981 14474 raft_consensus.cc:2243] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.920939 14474 raft_consensus.cc:2272] T 836934bdc16146549eca0b7b8b6f3bbe P 0afe96ac1d4a48728e3ac0814d8867b1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.923079 14474 tablet_replica.cc:333] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.923621 14474 raft_consensus.cc:2243] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.924383 14474 raft_consensus.cc:2272] T f73e75e796664f8198da4aa0a96ea07a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.926214 14474 tablet_replica.cc:333] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.926733 14474 raft_consensus.cc:2243] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.927556 14474 raft_consensus.cc:2272] T dfa9aad2b798480db18c5b0e3bac6a57 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.929270 14474 tablet_replica.cc:333] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.929811 14474 raft_consensus.cc:2243] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.930779 14474 raft_consensus.cc:2272] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.933270 14474 tablet_replica.cc:333] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
W20260709 13:09:18.933720 16236 consensus_peers.cc:597] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.934005 14474 raft_consensus.cc:2243] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.934820 14474 pending_rounds.cc:70] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Trying to abort 1 pending ops.
I20260709 13:09:18.935030 14474 pending_rounds.cc:77] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305636079841783808 op_type: NO_OP noop_request { }
I20260709 13:09:18.935361 14474 raft_consensus.cc:2889] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:18.935756 14474 raft_consensus.cc:2272] T 69ec834a3b71420c9f09248e41809358 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.939658 14474 tablet_replica.cc:333] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.940160 14474 raft_consensus.cc:2243] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.940908 14474 raft_consensus.cc:2272] T 233f2755fc484e7fb202702622c7b652 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.942685 14474 tablet_replica.cc:333] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.943149 14474 raft_consensus.cc:2243] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.943671 14474 raft_consensus.cc:2272] T a7a0379477ed4600a60cd9fde8f2867a P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.945897 14474 tablet_replica.cc:333] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.946694 14474 raft_consensus.cc:2243] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.947703 14474 raft_consensus.cc:2272] T 0e2176261a314ecdb0b1c0ff764de958 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.949924 14474 tablet_replica.cc:333] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.950702 14474 raft_consensus.cc:2243] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.951275 14474 raft_consensus.cc:2272] T ab663998de28482d8438f0c594104dd5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.953583 14474 tablet_replica.cc:333] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.954425 14474 raft_consensus.cc:2243] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:09:18.955286 15692 consensus_peers.cc:597] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:18.955546 14474 raft_consensus.cc:2272] T 2b55db060b644f01bd9ec436b864e377 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.957705 14474 tablet_replica.cc:333] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.958295 14474 raft_consensus.cc:2243] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.958818 14474 raft_consensus.cc:2272] T 361bd26d633f474ba34078d9cf76f22f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.961069 14474 tablet_replica.cc:333] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.961825 14474 raft_consensus.cc:2243] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.962834 14474 raft_consensus.cc:2272] T 93645f909b36412c9d021e6d4cb8f9d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.965333 14474 tablet_replica.cc:333] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.965982 14474 raft_consensus.cc:2243] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.966935 14474 raft_consensus.cc:2272] T 9027c3c93a9b4774bba818a406e5e36b P 0afe96ac1d4a48728e3ac0814d8867b1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.968655 14474 tablet_replica.cc:333] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.969151 14474 raft_consensus.cc:2243] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.969758 14474 raft_consensus.cc:2272] T 5de522f1a56b4d09aebf0748d415d7d5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.971864 14474 tablet_replica.cc:333] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.972539 14474 raft_consensus.cc:2243] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.973403 14474 pending_rounds.cc:70] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Trying to abort 1 pending ops.
I20260709 13:09:18.973640 14474 pending_rounds.cc:77] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305636080985333760 op_type: NO_OP noop_request { }
I20260709 13:09:18.974208 14474 raft_consensus.cc:2889] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:18.974558 14474 raft_consensus.cc:2272] T dd80b5819c634a02a3dd8e2d112db507 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.976706 14474 tablet_replica.cc:333] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.977203 14474 raft_consensus.cc:2243] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.977762 14474 raft_consensus.cc:2272] T f3f2e1d93d5244bb997f6e208e9bbc20 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.979619 14474 tablet_replica.cc:333] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.980150 14474 raft_consensus.cc:2243] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.980909 14474 raft_consensus.cc:2272] T 9d6936bd27314fcb82914d68a6cae45e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.982769 14474 tablet_replica.cc:333] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.983269 14474 raft_consensus.cc:2243] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.984154 14474 raft_consensus.cc:2272] T 92dd48cf0c9c49d98f7da6f98ac56241 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.985882 14474 tablet_replica.cc:333] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.986441 14474 raft_consensus.cc:2243] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.987229 14474 raft_consensus.cc:2272] T a425ca03b12f47b49b434d40007e90b5 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.989392 14474 tablet_replica.cc:333] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.990185 14474 raft_consensus.cc:2243] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.991204 14474 raft_consensus.cc:2272] T a96efb5d87b14ca19297799c72e797f0 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.993435 14474 tablet_replica.cc:333] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.993963 14474 raft_consensus.cc:2243] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.994745 14474 pending_rounds.cc:70] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Trying to abort 1 pending ops.
I20260709 13:09:18.994997 14474 pending_rounds.cc:77] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1: Aborting op as it isn't in flight: id { term: 12 index: 11 } timestamp: 7305636081171128320 op_type: NO_OP noop_request { }
I20260709 13:09:18.995337 14474 raft_consensus.cc:2889] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:18.995657 14474 raft_consensus.cc:2272] T 40c2674fd9d04c0fb406ca8f6eef4025 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.998126 14474 tablet_replica.cc:333] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:18.998771 14474 raft_consensus.cc:2243] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.999529 14474 raft_consensus.cc:2272] T c036f4b115e847feb37d916989af7159 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.001680 14474 tablet_replica.cc:333] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.002293 14474 raft_consensus.cc:2243] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.003152 14474 raft_consensus.cc:2272] T 7e251fb313da4e75911104bd3aedca42 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.004803 14474 tablet_replica.cc:333] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.005321 14474 raft_consensus.cc:2243] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.005750 14474 raft_consensus.cc:2272] T 4f560ec7039940e59212368b2f12385e P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.007472 14474 tablet_replica.cc:333] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.007910 14474 raft_consensus.cc:2243] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.008618 14474 raft_consensus.cc:2272] T 8291273c09814d929a78b8c6da15ad25 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.010824 14474 tablet_replica.cc:333] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.011420 14474 raft_consensus.cc:2243] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.012351 14474 raft_consensus.cc:2272] T 78adb81d1456468f8ad75e99085c54ba P 0afe96ac1d4a48728e3ac0814d8867b1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.014144 14474 tablet_replica.cc:333] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.014590 14474 raft_consensus.cc:2243] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.015286 14474 raft_consensus.cc:2272] T 9e1128bef1224facb3c1a31e94fb0379 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.016963 14474 tablet_replica.cc:333] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.017393 14474 raft_consensus.cc:2243] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.018309 14474 raft_consensus.cc:2272] T b42acde8d7184571acdbe8d34af2df1f P 0afe96ac1d4a48728e3ac0814d8867b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.019953 14474 tablet_replica.cc:333] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.020476 14474 raft_consensus.cc:2243] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.020861 14474 raft_consensus.cc:2272] T 2b413aeb892643a1af655defc3b03c4d P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.022634 14474 tablet_replica.cc:333] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.023177 14474 raft_consensus.cc:2243] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.023880 14474 raft_consensus.cc:2272] T da1e42035c3d46ac90631305fec02672 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.025555 14474 tablet_replica.cc:333] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.025959 14474 raft_consensus.cc:2243] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.026412 14474 raft_consensus.cc:2272] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.028211 14474 tablet_replica.cc:333] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.028910 14474 raft_consensus.cc:2243] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.029651 14474 raft_consensus.cc:2272] T 9a81a07de3df43208a6b3b6331e8c158 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.032269 14474 tablet_replica.cc:333] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1: stopping tablet replica
I20260709 13:09:19.032891 14474 raft_consensus.cc:2243] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.033566 14474 raft_consensus.cc:2272] T 0f7baa38cef34b39ab9d39592b319ba3 P 0afe96ac1d4a48728e3ac0814d8867b1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.069473 16236 consensus_peers.cc:597] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.083985 16236 consensus_peers.cc:597] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.108222 16236 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:34333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.131124 16236 consensus_peers.cc:597] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.134605 16235 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:19.154920 16236 consensus_peers.cc:597] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:34333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.202633 16236 consensus_peers.cc:597] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.209939 16236 consensus_peers.cc:597] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:34333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.230845 16236 consensus_peers.cc:597] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.285091 16236 consensus_peers.cc:597] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:34333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.391310 16236 consensus_peers.cc:597] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 0afe96ac1d4a48728e3ac0814d8867b1 (127.14.34.131:34333): Couldn't send request to peer 0afe96ac1d4a48728e3ac0814d8867b1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:34333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.413822 16235 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:19.436534 16235 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:19.568651 16236 consensus_peers.cc:597] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.586530 16236 consensus_peers.cc:597] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.613668 16235 consensus_peers.cc:597] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:19.688565 16236 consensus_peers.cc:597] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.724525 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
W20260709 13:09:19.731853 16236 consensus_peers.cc:597] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.785585 16235 consensus_peers.cc:597] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:19.795245 16235 consensus_peers.cc:597] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d -> Peer 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): Couldn't send request to peer 8995ef9978c446769377fc0e9a0cb9c1. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:19.797428 16236 consensus_peers.cc:597] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:19.800168 16236 consensus_peers.cc:597] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.820945 14474 tablet_server.cc:179] TabletServer@127.14.34.132:0 shutting down...
W20260709 13:09:19.841264 16236 consensus_peers.cc:597] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.871030 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:19.872076 14474 tablet_replica.cc:333] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.873284 14474 raft_consensus.cc:2243] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.874181 14474 raft_consensus.cc:2272] T a425ca03b12f47b49b434d40007e90b5 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.877311 14474 tablet_replica.cc:333] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.878135 14474 raft_consensus.cc:2243] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.879542 14474 raft_consensus.cc:2272] T 9aaafafa2c8f482d8b66bb15c3b1b088 P 681370bcf39d46b189ec8e9a5957f93d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.880244 16236 consensus_peers.cc:597] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.882390 14474 tablet_replica.cc:333] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.883163 14474 raft_consensus.cc:2243] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.883826 14474 raft_consensus.cc:2272] T f9377274f9c9482a924840f15b616a13 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.887236 14474 tablet_replica.cc:333] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
W20260709 13:09:19.887444 16236 consensus_peers.cc:597] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d -> Peer 680390d3f0884c91bf1f22ba914b438a (127.14.34.130:44871): Couldn't send request to peer 680390d3f0884c91bf1f22ba914b438a. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.888054 14474 raft_consensus.cc:2243] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.888816 14474 raft_consensus.cc:2272] T 9e1128bef1224facb3c1a31e94fb0379 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.890944 14474 tablet_replica.cc:333] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.891547 14474 raft_consensus.cc:2243] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.892333 14474 raft_consensus.cc:2272] T 83d7922f778044c7b5600f9d4024c1b5 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.894546 14474 tablet_replica.cc:333] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.895112 14474 raft_consensus.cc:2243] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.895884 14474 pending_rounds.cc:70] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Trying to abort 1 pending ops.
I20260709 13:09:19.896050 14474 pending_rounds.cc:77] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d: Aborting op as it isn't in flight: id { term: 15 index: 11 } timestamp: 7305636080699355136 op_type: NO_OP noop_request { }
I20260709 13:09:19.896303 14474 raft_consensus.cc:2889] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.896538 14474 raft_consensus.cc:2272] T ab663998de28482d8438f0c594104dd5 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.898788 14474 tablet_replica.cc:333] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.899365 14474 raft_consensus.cc:2243] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.900223 14474 raft_consensus.cc:2272] T b1059a62c94747b0b296ee50ba126991 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.902761 14474 tablet_replica.cc:333] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.903321 14474 raft_consensus.cc:2243] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.904207 14474 raft_consensus.cc:2272] T a7a0379477ed4600a60cd9fde8f2867a P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.906664 14474 tablet_replica.cc:333] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.907306 14474 raft_consensus.cc:2243] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.907778 14474 raft_consensus.cc:2272] T 57eafeb5dcb749c7be00fa4c5e0eae26 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.909785 14474 tablet_replica.cc:333] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.910385 14474 raft_consensus.cc:2243] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.910987 14474 raft_consensus.cc:2272] T 9027c3c93a9b4774bba818a406e5e36b P 681370bcf39d46b189ec8e9a5957f93d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.913233 14474 tablet_replica.cc:333] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.913769 14474 raft_consensus.cc:2243] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.914521 14474 raft_consensus.cc:2272] T 0eba092a851143659b8e87e62bb71b1c P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.916476 14474 tablet_replica.cc:333] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.917079 14474 raft_consensus.cc:2243] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.917778 14474 raft_consensus.cc:2272] T 2b55db060b644f01bd9ec436b864e377 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.919855 14474 tablet_replica.cc:333] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.920491 14474 raft_consensus.cc:2243] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.921387 14474 raft_consensus.cc:2272] T 0f7baa38cef34b39ab9d39592b319ba3 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.923501 14474 tablet_replica.cc:333] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.924081 14474 raft_consensus.cc:2243] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.924646 14474 raft_consensus.cc:2272] T 233f2755fc484e7fb202702622c7b652 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.926851 14474 tablet_replica.cc:333] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.927439 14474 raft_consensus.cc:2243] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.928400 14474 raft_consensus.cc:2272] T 57649fad66734a1786f0f9c09f4fa317 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.931394 14474 tablet_replica.cc:333] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.932085 14474 raft_consensus.cc:2243] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.932634 14474 raft_consensus.cc:2272] T 69ec834a3b71420c9f09248e41809358 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.934846 14474 tablet_replica.cc:333] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.935423 14474 raft_consensus.cc:2243] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.936298 14474 pending_rounds.cc:70] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Trying to abort 1 pending ops.
I20260709 13:09:19.936473 14474 pending_rounds.cc:77] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d: Aborting op as it isn't in flight: id { term: 13 index: 10 } timestamp: 7305636080320344064 op_type: NO_OP noop_request { }
I20260709 13:09:19.936721 14474 raft_consensus.cc:2889] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:19.937057 14474 raft_consensus.cc:2272] T f3f2e1d93d5244bb997f6e208e9bbc20 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.939107 14474 tablet_replica.cc:333] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.939728 14474 raft_consensus.cc:2243] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.940254 14474 raft_consensus.cc:2272] T dd80b5819c634a02a3dd8e2d112db507 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.942436 14474 tablet_replica.cc:333] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.943017 14474 raft_consensus.cc:2243] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.943826 14474 raft_consensus.cc:2272] T 88df0ea72a7846ebb2982ffb2d948734 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.945909 14474 tablet_replica.cc:333] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.946539 14474 raft_consensus.cc:2243] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.947365 14474 raft_consensus.cc:2272] T 78d5d462c9e4427f934553b90818efd6 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.949353 14474 tablet_replica.cc:333] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.949926 14474 raft_consensus.cc:2243] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.950871 14474 raft_consensus.cc:2272] T 8d98a5c01953408b8ad3eb550494fbf2 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.952907 14474 tablet_replica.cc:333] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.953486 14474 raft_consensus.cc:2243] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.954392 14474 raft_consensus.cc:2272] T 9bc3f862b6ee4e76ab0d4372c4bcd7be P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.956424 14474 tablet_replica.cc:333] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.956980 14474 raft_consensus.cc:2243] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.957820 14474 raft_consensus.cc:2272] T 4f560ec7039940e59212368b2f12385e P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.959973 14474 tablet_replica.cc:333] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.960757 14474 raft_consensus.cc:2243] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.961422 14474 raft_consensus.cc:2272] T 7e251fb313da4e75911104bd3aedca42 P 681370bcf39d46b189ec8e9a5957f93d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.964052 14474 tablet_replica.cc:333] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.964602 14474 raft_consensus.cc:2243] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.965370 14474 raft_consensus.cc:2272] T 5de522f1a56b4d09aebf0748d415d7d5 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.967438 14474 tablet_replica.cc:333] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.967948 14474 raft_consensus.cc:2243] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.968425 14474 raft_consensus.cc:2272] T a96efb5d87b14ca19297799c72e797f0 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.970468 14474 tablet_replica.cc:333] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.971006 14474 raft_consensus.cc:2243] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.971951 14474 raft_consensus.cc:2272] T 554babfb4498479a98f58801621b0dac P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.973883 14474 tablet_replica.cc:333] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.974479 14474 raft_consensus.cc:2243] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.975025 14474 raft_consensus.cc:2272] T 40c2674fd9d04c0fb406ca8f6eef4025 P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.977561 14474 tablet_replica.cc:333] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.978417 14474 raft_consensus.cc:2243] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.979063 14474 raft_consensus.cc:2272] T e25768ee42b44e978e9d8764ecd10199 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.981868 14474 tablet_replica.cc:333] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.982445 14474 raft_consensus.cc:2243] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.982908 14474 raft_consensus.cc:2272] T 89f37c80078841efa574af907a802c86 P 681370bcf39d46b189ec8e9a5957f93d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.984802 14474 tablet_replica.cc:333] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.985339 14474 raft_consensus.cc:2243] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.985822 14474 raft_consensus.cc:2272] T 363fa81d735347758e73efea5dc3fae6 P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.987725 14474 tablet_replica.cc:333] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.988268 14474 raft_consensus.cc:2243] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.989073 14474 raft_consensus.cc:2272] T 1c3913ed9e5b4674a9091483756deadf P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.991153 14474 tablet_replica.cc:333] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.991752 14474 raft_consensus.cc:2243] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.992300 14474 raft_consensus.cc:2272] T dfa9aad2b798480db18c5b0e3bac6a57 P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.994376 14474 tablet_replica.cc:333] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.994933 14474 raft_consensus.cc:2243] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.995457 14474 raft_consensus.cc:2272] T b42acde8d7184571acdbe8d34af2df1f P 681370bcf39d46b189ec8e9a5957f93d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.997509 14474 tablet_replica.cc:333] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:19.998265 14474 raft_consensus.cc:2243] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.999101 14474 raft_consensus.cc:2272] T 6a514609784146e8a8b6917d543f83e7 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.001022 14474 tablet_replica.cc:333] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.001542 14474 raft_consensus.cc:2243] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.002427 14474 raft_consensus.cc:2272] T 361bd26d633f474ba34078d9cf76f22f P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.004237 14474 tablet_replica.cc:333] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.004750 14474 raft_consensus.cc:2243] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.005195 14474 raft_consensus.cc:2272] T a52b1ff912bd4f07a795a7bfccb8a2f0 P 681370bcf39d46b189ec8e9a5957f93d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.007200 14474 tablet_replica.cc:333] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.007678 14474 raft_consensus.cc:2243] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.008237 14474 raft_consensus.cc:2272] T 070f910fe7cf4a4ca2ca43b63d4d997f P 681370bcf39d46b189ec8e9a5957f93d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.010094 14474 tablet_replica.cc:333] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.010583 14474 raft_consensus.cc:2243] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.011117 14474 raft_consensus.cc:2272] T 5fd8c2b67a6b46399004625b89edc3ba P 681370bcf39d46b189ec8e9a5957f93d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.012959 14474 tablet_replica.cc:333] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.013480 14474 raft_consensus.cc:2243] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.013952 14474 raft_consensus.cc:2272] T 6043256b63964d729edc1a480d265404 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.015774 14474 tablet_replica.cc:333] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.016259 14474 raft_consensus.cc:2243] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.017148 14474 pending_rounds.cc:70] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Trying to abort 1 pending ops.
I20260709 13:09:20.017355 14474 pending_rounds.cc:77] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305636080117972992 op_type: NO_OP noop_request { }
I20260709 13:09:20.017635 14474 raft_consensus.cc:2889] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:20.017910 14474 raft_consensus.cc:2272] T 692cb3906e474706ae13f98e2b050415 P 681370bcf39d46b189ec8e9a5957f93d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.020071 14474 tablet_replica.cc:333] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.020577 14474 raft_consensus.cc:2243] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.021109 14474 raft_consensus.cc:2272] T 836934bdc16146549eca0b7b8b6f3bbe P 681370bcf39d46b189ec8e9a5957f93d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.023226 14474 tablet_replica.cc:333] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.023705 14474 raft_consensus.cc:2243] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.024329 14474 raft_consensus.cc:2272] T 78adb81d1456468f8ad75e99085c54ba P 681370bcf39d46b189ec8e9a5957f93d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.026286 14474 tablet_replica.cc:333] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d: stopping tablet replica
I20260709 13:09:20.026715 14474 raft_consensus.cc:2243] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.027571 14474 raft_consensus.cc:2272] T 78b5c231d4c74287b7bcdae567611bea P 681370bcf39d46b189ec8e9a5957f93d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.383611 14474 tablet_server.cc:196] TabletServer@127.14.34.132:0 shutdown complete.
I20260709 13:09:20.450171 14474 master.cc:562] Master@127.14.34.190:46799 shutting down...
W20260709 13:09:31.205781 15462 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111) [suppressed 461 similar messages]
W20260709 13:09:31.209793 15462 catalog_manager.cc:4755] TS 8995ef9978c446769377fc0e9a0cb9c1 (127.14.34.129:45045): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f3f2e1d93d5244bb997f6e208e9bbc20: Network error: Client connection negotiation failed: client connection to 127.14.34.129:45045: connect: Connection refused (error 111)
I20260709 13:09:31.380782 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.381923 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.382366 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P bcd214cd726347aba20c77156a32ce97: stopping tablet replica
I20260709 13:09:31.628033 14474 master.cc:584] Master@127.14.34.190:46799 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (222060 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:31.758857 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:40037
I20260709 13:09:31.760170 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.767014 21990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.767048 21991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.767264 21993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.769212 14474 server_base.cc:1061] running on GCE node
I20260709 13:09:31.773133 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.773360 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.773605 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602571773565 us; error 0 us; skew 500 ppm
I20260709 13:09:31.774581 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.777349 14474 webserver.cc:533] Webserver started at http://127.14.34.190:36193/ using document root <none> and password file <none>
I20260709 13:09:31.777930 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.778215 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.778522 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.779973 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "2ed4f192b33049bd8840c60f38337165"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-nr1f"
I20260709 13:09:31.785120 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:09:31.788681 21998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.789476 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:31.789837 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "2ed4f192b33049bd8840c60f38337165"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-nr1f"
I20260709 13:09:31.790161 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.820438 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.821750 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.861886 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:40037
I20260709 13:09:31.861989 22049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:40037 every 8 connection(s)
I20260709 13:09:31.866056 22050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.877019 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165: Bootstrap starting.
I20260709 13:09:31.881964 22050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.886584 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165: No bootstrap required, opened a new log
I20260709 13:09:31.888893 22050 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER }
I20260709 13:09:31.889366 22050 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.889587 22050 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed4f192b33049bd8840c60f38337165, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.890322 22050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER }
I20260709 13:09:31.890805 22050 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:31.891038 22050 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:31.891322 22050 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.896018 22050 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER }
I20260709 13:09:31.896602 22050 leader_election.cc:304] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ed4f192b33049bd8840c60f38337165; no voters: 
I20260709 13:09:31.897768 22050 leader_election.cc:290] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:31.898147 22053 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.899520 22053 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 1 LEADER]: Becoming Leader. State: Replica: 2ed4f192b33049bd8840c60f38337165, State: Running, Role: LEADER
I20260709 13:09:31.900283 22053 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER }
I20260709 13:09:31.900848 22050 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:31.908182 22054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ed4f192b33049bd8840c60f38337165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER } }
I20260709 13:09:31.909071 22054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.910580 22055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed4f192b33049bd8840c60f38337165. Latest consensus state: current_term: 1 leader_uuid: "2ed4f192b33049bd8840c60f38337165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4f192b33049bd8840c60f38337165" member_type: VOTER } }
I20260709 13:09:31.911252 22055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.916841 22063 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:31.926586 22063 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:31.927569 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:31.936290 22063 catalog_manager.cc:1383] Generated new cluster ID: 84de3a4c450545c3911f1e274514b917
I20260709 13:09:31.936595 22063 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:31.963395 22063 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:31.964721 22063 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:31.976606 22063 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165: Generated new TSK 0
I20260709 13:09:31.977211 22063 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:31.994228 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.000483 22071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.001935 22072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.004858 14474 server_base.cc:1061] running on GCE node
W20260709 13:09:32.004995 22074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.007091 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.007293 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.007414 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602572007403 us; error 0 us; skew 500 ppm
I20260709 13:09:32.007905 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.010380 14474 webserver.cc:533] Webserver started at http://127.14.34.129:44475/ using document root <none> and password file <none>
I20260709 13:09:32.010912 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.011142 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.011422 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.012609 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "17194feb726e4445801d2097dd68067d"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.017066 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:09:32.020330 22079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.021190 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:32.021474 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "17194feb726e4445801d2097dd68067d"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.021760 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.035998 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.037276 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.038944 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.041530 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.041728 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.042081 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.042284 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.087407 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:33489
I20260709 13:09:32.087508 22141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:33489 every 8 connection(s)
I20260709 13:09:32.093150 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.101851 22146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.102496 22147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.106604 14474 server_base.cc:1061] running on GCE node
W20260709 13:09:32.107115 22149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.108884 22142 heartbeater.cc:344] Connected to a master server at 127.14.34.190:40037
I20260709 13:09:32.109330 22142 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.109773 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.110018 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.110239 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602572110186 us; error 0 us; skew 500 ppm
I20260709 13:09:32.110327 22142 heartbeater.cc:507] Master 127.14.34.190:40037 requested a full tablet report, sending...
I20260709 13:09:32.110913 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.112921 22015 ts_manager.cc:194] Registered new tserver with Master: 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:32.114315 14474 webserver.cc:533] Webserver started at http://127.14.34.130:38283/ using document root <none> and password file <none>
I20260709 13:09:32.115001 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.115242 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.115526 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.115728 22015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44596
I20260709 13:09:32.117113 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.121574 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:09:32.125411 22154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.126466 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:09:32.126783 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.127095 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.145187 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.146637 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.148137 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.150390 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.150609 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.150841 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.151007 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.193291 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:44021
I20260709 13:09:32.193392 22216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:44021 every 8 connection(s)
I20260709 13:09:32.198390 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.206605 22220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.208628 22221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.210879 22223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.211323 14474 server_base.cc:1061] running on GCE node
I20260709 13:09:32.212355 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:32.212647 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.212870 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602572212852 us; error 0 us; skew 500 ppm
I20260709 13:09:32.213300 22217 heartbeater.cc:344] Connected to a master server at 127.14.34.190:40037
I20260709 13:09:32.213604 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.213729 22217 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.214848 22217 heartbeater.cc:507] Master 127.14.34.190:40037 requested a full tablet report, sending...
I20260709 13:09:32.216886 14474 webserver.cc:533] Webserver started at http://127.14.34.131:41707/ using document root <none> and password file <none>
I20260709 13:09:32.217198 22015 ts_manager.cc:194] Registered new tserver with Master: c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:32.217561 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.217839 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.218175 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.219094 22015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44610
I20260709 13:09:32.219870 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "ca1c2f73661f4fd28f53d294057790cb"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.225055 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:32.228883 22228 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.229748 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:09:32.230098 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "ca1c2f73661f4fd28f53d294057790cb"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.230402 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.247963 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.249235 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.250746 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.253007 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.253244 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.253484 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.253655 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.296993 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:44441
I20260709 13:09:32.297116 22290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:44441 every 8 connection(s)
I20260709 13:09:32.301970 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:32.309191 22294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.310796 22295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:32.312386 22297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:32.313877 14474 server_base.cc:1061] running on GCE node
I20260709 13:09:32.315091 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:32.315188 22291 heartbeater.cc:344] Connected to a master server at 127.14.34.190:40037
W20260709 13:09:32.315433 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:32.315631 22291 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.315659 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602572315641 us; error 0 us; skew 500 ppm
I20260709 13:09:32.316655 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:32.316632 22291 heartbeater.cc:507] Master 127.14.34.190:40037 requested a full tablet report, sending...
I20260709 13:09:32.319275 22015 ts_manager.cc:194] Registered new tserver with Master: ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:32.319929 14474 webserver.cc:533] Webserver started at http://127.14.34.132:33221/ using document root <none> and password file <none>
I20260709 13:09:32.320465 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:32.320655 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:32.320948 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:32.321013 22015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44624
I20260709 13:09:32.322268 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-3-root/instance:
uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.327437 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:32.330917 22302 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.331700 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:09:32.332001 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:32.332340 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:32.346287 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:32.347625 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:32.349144 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.351455 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.351698 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.351953 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.352133 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.395687 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.132:36873
I20260709 13:09:32.395785 22364 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.132:36873 every 8 connection(s)
I20260709 13:09:32.411015 22365 heartbeater.cc:344] Connected to a master server at 127.14.34.190:40037
I20260709 13:09:32.411523 22365 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.412544 22365 heartbeater.cc:507] Master 127.14.34.190:40037 requested a full tablet report, sending...
I20260709 13:09:32.414695 22015 ts_manager.cc:194] Registered new tserver with Master: 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:32.415588 14474 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016536418s
I20260709 13:09:32.416396 22015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44632
I20260709 13:09:32.443913 22015 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44642:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:32.701341 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 3f610a8a53884b579f5db10b1da26e34 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.702970 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f610a8a53884b579f5db10b1da26e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.707861 22255 tablet_service.cc:1511] Processing CreateTablet for tablet b1ba8098e9a343f5826bcd03b7821877 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.709455 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ba8098e9a343f5826bcd03b7821877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.715622 22254 tablet_service.cc:1511] Processing CreateTablet for tablet c96bcd6c5d2745d4af954e66e23b0e4f (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.717216 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96bcd6c5d2745d4af954e66e23b0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.719434 22330 tablet_service.cc:1511] Processing CreateTablet for tablet 69dea929793f41b284b6169e5f48f91c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.720976 22330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dea929793f41b284b6169e5f48f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.722661 22329 tablet_service.cc:1511] Processing CreateTablet for tablet b1ba8098e9a343f5826bcd03b7821877 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.724116 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ba8098e9a343f5826bcd03b7821877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.726159 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 3f610a8a53884b579f5db10b1da26e34 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.727277 22328 tablet_service.cc:1511] Processing CreateTablet for tablet c96bcd6c5d2745d4af954e66e23b0e4f (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.728806 22328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96bcd6c5d2745d4af954e66e23b0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.730652 22182 tablet_service.cc:1511] Processing CreateTablet for tablet 3f610a8a53884b579f5db10b1da26e34 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.732177 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f610a8a53884b579f5db10b1da26e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.732725 22252 tablet_service.cc:1511] Processing CreateTablet for tablet 327c2509cc82419a9564c2a7282f0f71 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.727730 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f610a8a53884b579f5db10b1da26e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.737190 22327 tablet_service.cc:1511] Processing CreateTablet for tablet 007cad1be85a4b9e8e1a28971ce3cc56 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.731225 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7fe317f7748d6b79af65dfce6aaa3 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.738785 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cad1be85a4b9e8e1a28971ce3cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.754009 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.756043 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.757725 22248 tablet_service.cc:1511] Processing CreateTablet for tablet a90f7e1b06aa47b1a7a3bad9feba4d21 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.749862 22249 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.760756 22322 tablet_service.cc:1511] Processing CreateTablet for tablet a90f7e1b06aa47b1a7a3bad9feba4d21 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.749858 22325 tablet_service.cc:1511] Processing CreateTablet for tablet c939561ea4c94526ab504d3c4253671b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.763703 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c939561ea4c94526ab504d3c4253671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.764344 22247 tablet_service.cc:1511] Processing CreateTablet for tablet a6965ff3bf9a458d94a7ab8928ea1832 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.767414 22321 tablet_service.cc:1511] Processing CreateTablet for tablet af8695172b484ce5baae1689dc3e9847 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:32.769287 22321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8695172b484ce5baae1689dc3e9847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.747630 22324 tablet_service.cc:1511] Processing CreateTablet for tablet 15c812af74344306b9c9ab661cdbb582 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.771653 22324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c812af74344306b9c9ab661cdbb582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.746634 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 69dea929793f41b284b6169e5f48f91c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.775118 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dea929793f41b284b6169e5f48f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.748627 22250 tablet_service.cc:1511] Processing CreateTablet for tablet 37090b927d224c0d902fc48f6b211e37 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.778247 22105 tablet_service.cc:1511] Processing CreateTablet for tablet b1ba8098e9a343f5826bcd03b7821877 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.780992 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ba8098e9a343f5826bcd03b7821877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.751595 22326 tablet_service.cc:1511] Processing CreateTablet for tablet 327c2509cc82419a9564c2a7282f0f71 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.783634 22326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c2509cc82419a9564c2a7282f0f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.769884 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 69dea929793f41b284b6169e5f48f91c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.787274 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69dea929793f41b284b6169e5f48f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.744993 22251 tablet_service.cc:1511] Processing CreateTablet for tablet c939561ea4c94526ab504d3c4253671b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.791970 22252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c2509cc82419a9564c2a7282f0f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.792102 22180 tablet_service.cc:1511] Processing CreateTablet for tablet c96bcd6c5d2745d4af954e66e23b0e4f (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.794559 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7fe317f7748d6b79af65dfce6aaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.793857 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96bcd6c5d2745d4af954e66e23b0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.798622 22249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.801517 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90f7e1b06aa47b1a7a3bad9feba4d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.806726 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90f7e1b06aa47b1a7a3bad9feba4d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.810642 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37090b927d224c0d902fc48f6b211e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.819694 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7fe317f7748d6b79af65dfce6aaa3 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.821588 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7fe317f7748d6b79af65dfce6aaa3 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.823233 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7fe317f7748d6b79af65dfce6aaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.823285 22103 tablet_service.cc:1511] Processing CreateTablet for tablet 007cad1be85a4b9e8e1a28971ce3cc56 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.827651 22102 tablet_service.cc:1511] Processing CreateTablet for tablet 327c2509cc82419a9564c2a7282f0f71 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.821609 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7fe317f7748d6b79af65dfce6aaa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.834120 22101 tablet_service.cc:1511] Processing CreateTablet for tablet 37090b927d224c0d902fc48f6b211e37 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.838410 22102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c2509cc82419a9564c2a7282f0f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.839375 22101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37090b927d224c0d902fc48f6b211e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.846486 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cad1be85a4b9e8e1a28971ce3cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.815897 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c939561ea4c94526ab504d3c4253671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.847801 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 007cad1be85a4b9e8e1a28971ce3cc56 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.849509 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cad1be85a4b9e8e1a28971ce3cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.849906 22247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6965ff3bf9a458d94a7ab8928ea1832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.853340 22100 tablet_service.cc:1511] Processing CreateTablet for tablet 15c812af74344306b9c9ab661cdbb582 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.853765 22177 tablet_service.cc:1511] Processing CreateTablet for tablet c939561ea4c94526ab504d3c4253671b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.854815 22100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c812af74344306b9c9ab661cdbb582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.855350 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c939561ea4c94526ab504d3c4253671b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.859081 22099 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.859294 22176 tablet_service.cc:1511] Processing CreateTablet for tablet 37090b927d224c0d902fc48f6b211e37 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.860476 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6bbb4b9f7b416aad8d32612da1e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.860913 22176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37090b927d224c0d902fc48f6b211e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.864248 22175 tablet_service.cc:1511] Processing CreateTablet for tablet 15c812af74344306b9c9ab661cdbb582 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.866164 22175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c812af74344306b9c9ab661cdbb582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.871730 22098 tablet_service.cc:1511] Processing CreateTablet for tablet a6965ff3bf9a458d94a7ab8928ea1832 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.873556 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6965ff3bf9a458d94a7ab8928ea1832. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:32.946740 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.953186 22175 tablet_service.cc:1511] Processing CreateTablet for tablet a90f7e1b06aa47b1a7a3bad9feba4d21 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.953994 22174 tablet_service.cc:1511] Processing CreateTablet for tablet a6965ff3bf9a458d94a7ab8928ea1832 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.954850 22175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90f7e1b06aa47b1a7a3bad9feba4d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.957221 22173 tablet_service.cc:1511] Processing CreateTablet for tablet af8695172b484ce5baae1689dc3e9847 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:32.961303 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8695172b484ce5baae1689dc3e9847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.962352 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6965ff3bf9a458d94a7ab8928ea1832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.963220 22327 tablet_service.cc:1511] Processing CreateTablet for tablet 2635674412cd401c9431a779ae71dcee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:32.964617 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2635674412cd401c9431a779ae71dcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.978124 22385 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:32.981904 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 6b704e57772443559af3ab4ea6f48f67 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:32.987018 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b704e57772443559af3ab4ea6f48f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.014997 22386 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:33.025897 22182 tablet_service.cc:1511] Processing CreateTablet for tablet 6b704e57772443559af3ab4ea6f48f67 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:33.028062 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b704e57772443559af3ab4ea6f48f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.917908 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 2635674412cd401c9431a779ae71dcee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:33.031566 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2635674412cd401c9431a779ae71dcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.033566 22387 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:33.040771 22103 tablet_service.cc:1511] Processing CreateTablet for tablet af8695172b484ce5baae1689dc3e9847 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:33.042392 22322 tablet_service.cc:1511] Processing CreateTablet for tablet 6b704e57772443559af3ab4ea6f48f67 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:33.044382 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b704e57772443559af3ab4ea6f48f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.070771 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8695172b484ce5baae1689dc3e9847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.074726 22388 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:33.089071 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 75599b9dde5f4db2bd81f1872e371761 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:33.091084 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75599b9dde5f4db2bd81f1872e371761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.084012 22330 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad9fbad184a4753852b26a96e13dc49 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:33.097602 22330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad9fbad184a4753852b26a96e13dc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.093734 22328 tablet_service.cc:1511] Processing CreateTablet for tablet 75599b9dde5f4db2bd81f1872e371761 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:33.105795 22328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75599b9dde5f4db2bd81f1872e371761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.119108 22142 heartbeater.cc:499] Master 127.14.34.190:40037 was elected leader, sending a full tablet report...
I20260709 13:09:33.125615 22323 tablet_service.cc:1511] Processing CreateTablet for tablet f4ead399c25f4fba981e4ae8dc56595d (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:33.127167 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ead399c25f4fba981e4ae8dc56595d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.139961 22387 tablet_bootstrap.cc:654] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.077708 22250 tablet_service.cc:1511] Processing CreateTablet for tablet 0f66b966ecab4e0292876583bb462dcc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:33.147676 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f66b966ecab4e0292876583bb462dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.150651 22388 tablet_bootstrap.cc:654] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.158392 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 0f66b966ecab4e0292876583bb462dcc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:33.159832 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f66b966ecab4e0292876583bb462dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.152122 22101 tablet_service.cc:1511] Processing CreateTablet for tablet 2635674412cd401c9431a779ae71dcee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:33.166306 22386 tablet_bootstrap.cc:654] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.184167 22254 tablet_service.cc:1511] Processing CreateTablet for tablet f4ead399c25f4fba981e4ae8dc56595d (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:33.219944 22101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2635674412cd401c9431a779ae71dcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.228714 22217 heartbeater.cc:499] Master 127.14.34.190:40037 was elected leader, sending a full tablet report...
I20260709 13:09:33.230988 22173 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad9fbad184a4753852b26a96e13dc49 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:33.232512 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad9fbad184a4753852b26a96e13dc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.222222 22385 tablet_bootstrap.cc:654] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:33.217747 22001 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 234225us
I20260709 13:09:33.231220 22329 tablet_service.cc:1511] Processing CreateTablet for tablet 57b0e3fbce6246c6b6701af14d2add23 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 13:09:33.246214 21999 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 249273us
I20260709 13:09:33.246572 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 75599b9dde5f4db2bd81f1872e371761 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:33.247968 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75599b9dde5f4db2bd81f1872e371761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.249847 22100 tablet_service.cc:1511] Processing CreateTablet for tablet 9ad9fbad184a4753852b26a96e13dc49 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 13:09:33.250172 22002 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 189222us
I20260709 13:09:33.252015 22102 tablet_service.cc:1511] Processing CreateTablet for tablet b2e4e0ac91fa4d63ae85265155993405 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:33.252225 22179 tablet_service.cc:1511] Processing CreateTablet for tablet f4ead399c25f4fba981e4ae8dc56595d (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:33.253844 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 57b0e3fbce6246c6b6701af14d2add23 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:33.256548 22251 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fff09c6c3456a80ff8246e5641523 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.248840 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ead399c25f4fba981e4ae8dc56595d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.270382 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fff09c6c3456a80ff8246e5641523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.269985 22174 tablet_service.cc:1511] Processing CreateTablet for tablet b2e4e0ac91fa4d63ae85265155993405 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:33.270668 22248 tablet_service.cc:1511] Processing CreateTablet for tablet b2e4e0ac91fa4d63ae85265155993405 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:33.271530 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e4e0ac91fa4d63ae85265155993405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.286788 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e4e0ac91fa4d63ae85265155993405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.287745 22178 tablet_service.cc:1511] Processing CreateTablet for tablet d84b3305904946d38911396e3454a49c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.289969 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b0e3fbce6246c6b6701af14d2add23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.257977 22328 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fff09c6c3456a80ff8246e5641523 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.299299 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b0e3fbce6246c6b6701af14d2add23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.289724 22247 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0585d90c03430d88a8fee355e3944b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.303045 22247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0585d90c03430d88a8fee355e3944b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.290532 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ead399c25f4fba981e4ae8dc56595d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.294245 22177 tablet_service.cc:1511] Processing CreateTablet for tablet 57b0e3fbce6246c6b6701af14d2add23 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:33.315551 22322 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0585d90c03430d88a8fee355e3944b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.317001 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0585d90c03430d88a8fee355e3944b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.316751 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 0142c870a43c41b7bcb815fcee196201 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.317129 22099 tablet_service.cc:1511] Processing CreateTablet for tablet 6b9fff09c6c3456a80ff8246e5641523 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.318141 22102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e4e0ac91fa4d63ae85265155993405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.324056 22291 heartbeater.cc:499] Master 127.14.34.190:40037 was elected leader, sending a full tablet report...
I20260709 13:09:33.324512 22385 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:33.325060 22385 ts_tablet_manager.cc:1403] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.347s	user 0.021s	sys 0.000s
I20260709 13:09:33.326057 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fff09c6c3456a80ff8246e5641523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.323622 22181 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0585d90c03430d88a8fee355e3944b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.327178 22181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0585d90c03430d88a8fee355e3944b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.328233 22385 raft_consensus.cc:359] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:33.328987 22385 raft_consensus.cc:385] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.329288 22385 raft_consensus.cc:740] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.244556 22103 tablet_service.cc:1511] Processing CreateTablet for tablet 0f66b966ecab4e0292876583bb462dcc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:33.333196 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f66b966ecab4e0292876583bb462dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.334149 22175 tablet_service.cc:1511] Processing CreateTablet for tablet 0142c870a43c41b7bcb815fcee196201 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.335580 22175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0142c870a43c41b7bcb815fcee196201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.338267 22328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b9fff09c6c3456a80ff8246e5641523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.342324 22100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ad9fbad184a4753852b26a96e13dc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.343061 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84b3305904946d38911396e3454a49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.344918 22249 tablet_service.cc:1511] Processing CreateTablet for tablet 0142c870a43c41b7bcb815fcee196201 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.347973 22107 tablet_service.cc:1511] Processing CreateTablet for tablet fc40bc6bbf64498894a29949620657cc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.349498 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40bc6bbf64498894a29949620657cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.356383 22098 tablet_service.cc:1511] Processing CreateTablet for tablet 13a6f0c3a1204df3b6e06881227e59a7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.319526 22330 tablet_service.cc:1511] Processing CreateTablet for tablet fc40bc6bbf64498894a29949620657cc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.357775 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a6f0c3a1204df3b6e06881227e59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.353428 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 13a6f0c3a1204df3b6e06881227e59a7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.350179 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b0e3fbce6246c6b6701af14d2add23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.358172 22330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40bc6bbf64498894a29949620657cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.362293 22249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0142c870a43c41b7bcb815fcee196201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.355195 22182 tablet_service.cc:1511] Processing CreateTablet for tablet fc40bc6bbf64498894a29949620657cc (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.387328 22321 tablet_service.cc:1511] Processing CreateTablet for tablet d84b3305904946d38911396e3454a49c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.407464 22182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40bc6bbf64498894a29949620657cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.409266 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0142c870a43c41b7bcb815fcee196201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.399334 22385 consensus_queue.cc:260] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:33.405573 22001 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 95624.2us
I20260709 13:09:33.416491 22326 tablet_service.cc:1511] Processing CreateTablet for tablet 1339f58f4b83447ca1b957607bb81a0e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.419405 22365 heartbeater.cc:499] Master 127.14.34.190:40037 was elected leader, sending a full tablet report...
I20260709 13:09:33.419629 22386 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:33.420326 22386 ts_tablet_manager.cc:1403] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.407s	user 0.010s	sys 0.015s
I20260709 13:09:33.423439 22386 raft_consensus.cc:359] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.424162 22386 raft_consensus.cc:385] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.424477 22386 raft_consensus.cc:740] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.425235 22386 consensus_queue.cc:260] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.426266 22321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84b3305904946d38911396e3454a49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.426875 22387 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:33.427572 22387 ts_tablet_manager.cc:1403] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.514s	user 0.022s	sys 0.015s
I20260709 13:09:33.431874 22388 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:33.432483 22388 ts_tablet_manager.cc:1403] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.358s	user 0.031s	sys 0.021s
I20260709 13:09:33.435173 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a6f0c3a1204df3b6e06881227e59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.446269 22326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1339f58f4b83447ca1b957607bb81a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.480989 22255 tablet_service.cc:1511] Processing CreateTablet for tablet 13a6f0c3a1204df3b6e06881227e59a7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.505199 22252 tablet_service.cc:1511] Processing CreateTablet for tablet c38f1076893d40b9897230548a8b40ed (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.508028 22180 tablet_service.cc:1511] Processing CreateTablet for tablet 1339f58f4b83447ca1b957607bb81a0e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.508760 22101 tablet_service.cc:1511] Processing CreateTablet for tablet c38f1076893d40b9897230548a8b40ed (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.509593 22180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1339f58f4b83447ca1b957607bb81a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.515102 22388 raft_consensus.cc:359] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.481456 22174 tablet_service.cc:1511] Processing CreateTablet for tablet f372f4163d984cce8f4884fa17505bee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:33.521258 22388 raft_consensus.cc:385] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.537444 22103 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc58c529b54ba2a96c147ab3fb7c29 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.520344 22101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f1076893d40b9897230548a8b40ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.529809 22099 tablet_service.cc:1511] Processing CreateTablet for tablet 1339f58f4b83447ca1b957607bb81a0e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.497593 22176 tablet_service.cc:1511] Processing CreateTablet for tablet c38f1076893d40b9897230548a8b40ed (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.543533 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a6f0c3a1204df3b6e06881227e59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.554461 22393 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.543689 22388 raft_consensus.cc:740] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.575573 22388 consensus_queue.cc:260] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.582263 22322 tablet_service.cc:1511] Processing CreateTablet for tablet f372f4163d984cce8f4884fa17505bee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:33.583871 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f372f4163d984cce8f4884fa17505bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.570823 22176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f1076893d40b9897230548a8b40ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.571118 22385 ts_tablet_manager.cc:1434] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.246s	user 0.005s	sys 0.011s
I20260709 13:09:33.574340 22393 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:33.595161 22393 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:33.585291 22252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f1076893d40b9897230548a8b40ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.565224 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc58c529b54ba2a96c147ab3fb7c29 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.592458 22385 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:33.531669 22250 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc58c529b54ba2a96c147ab3fb7c29 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.608507 22327 tablet_service.cc:1511] Processing CreateTablet for tablet 98aeacddec914f1d8a82fe805dedcf91 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.608950 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 543bace83eba44d6ab8955f3c9fdb2f8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.604453 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f372f4163d984cce8f4884fa17505bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.617568 22253 tablet_service.cc:1511] Processing CreateTablet for tablet d84b3305904946d38911396e3454a49c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.619189 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc58c529b54ba2a96c147ab3fb7c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.627902 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc58c529b54ba2a96c147ab3fb7c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.650943 22173 tablet_service.cc:1511] Processing CreateTablet for tablet cceaff14ae1a439093a61fc311090c52 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:33.652817 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cceaff14ae1a439093a61fc311090c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.653262 22106 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.654518 22324 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.655652 22387 raft_consensus.cc:359] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.656400 22387 raft_consensus.cc:385] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.656678 22387 raft_consensus.cc:740] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.658079 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc58c529b54ba2a96c147ab3fb7c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.657660 22387 consensus_queue.cc:260] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.658250 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 98aeacddec914f1d8a82fe805dedcf91 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.649883 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98aeacddec914f1d8a82fe805dedcf91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.622917 22247 tablet_service.cc:1511] Processing CreateTablet for tablet 98aeacddec914f1d8a82fe805dedcf91 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.642951 22254 tablet_service.cc:1511] Processing CreateTablet for tablet f372f4163d984cce8f4884fa17505bee (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:33.666509 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.683243 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.683118 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 543bace83eba44d6ab8955f3c9fdb2f8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.664335 22251 tablet_service.cc:1511] Processing CreateTablet for tablet cceaff14ae1a439093a61fc311090c52 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:33.665079 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 88301f9a41d1408a954402329da2f773 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:33.666569 22106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.658293 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84b3305904946d38911396e3454a49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.667344 22178 tablet_service.cc:1511] Processing CreateTablet for tablet 543bace83eba44d6ab8955f3c9fdb2f8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.672997 22386 ts_tablet_manager.cc:1434] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.252s	user 0.016s	sys 0.015s
I20260709 13:09:33.702363 22178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543bace83eba44d6ab8955f3c9fdb2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.704978 22329 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffcff5675b2484f92ffac7f3db09d88 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.706389 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88301f9a41d1408a954402329da2f773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.709069 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffcff5675b2484f92ffac7f3db09d88 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.709633 22324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3cb8a2bc034a8fbd075e0b21f622e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.710381 22247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98aeacddec914f1d8a82fe805dedcf91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.714663 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffcff5675b2484f92ffac7f3db09d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.658867 22098 tablet_service.cc:1511] Processing CreateTablet for tablet cceaff14ae1a439093a61fc311090c52 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:33.720103 22386 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:33.712757 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98aeacddec914f1d8a82fe805dedcf91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.723305 22254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f372f4163d984cce8f4884fa17505bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.725813 22395 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.730664 22388 ts_tablet_manager.cc:1434] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.298s	user 0.015s	sys 0.003s
I20260709 13:09:33.833182 22395 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.834661 22388 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:33.723130 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543bace83eba44d6ab8955f3c9fdb2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.837532 22395 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:33.722607 22397 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.842245 22397 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:33.845084 22397 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:33.712343 22177 tablet_service.cc:1511] Processing CreateTablet for tablet 88301f9a41d1408a954402329da2f773 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:33.875334 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88301f9a41d1408a954402329da2f773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.758919 22248 tablet_service.cc:1511] Processing CreateTablet for tablet 88301f9a41d1408a954402329da2f773 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:09:33.804682 22292 tablet.cc:2406] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:33.807032 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:33.819571 22385 tablet_bootstrap.cc:654] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.866135 22175 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffcff5675b2484f92ffac7f3db09d88 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.881458 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffcff5675b2484f92ffac7f3db09d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.886950 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1339f58f4b83447ca1b957607bb81a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.887720 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543bace83eba44d6ab8955f3c9fdb2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.889951 22387 ts_tablet_manager.cc:1434] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.462s	user 0.021s	sys 0.022s
I20260709 13:09:33.901206 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88301f9a41d1408a954402329da2f773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.907008 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cceaff14ae1a439093a61fc311090c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.910578 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cceaff14ae1a439093a61fc311090c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.912011 22387 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:33.914201 22175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffcff5675b2484f92ffac7f3db09d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.941443 22388 tablet_bootstrap.cc:654] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.951668 22250 tablet_service.cc:1511] Processing CreateTablet for tablet 32223739e62f42aeb7edc9209035b260 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:33.953611 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32223739e62f42aeb7edc9209035b260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.961992 22386 tablet_bootstrap.cc:654] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.994338 22385 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:33.995008 22385 ts_tablet_manager.cc:1403] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.403s	user 0.017s	sys 0.007s
I20260709 13:09:34.023504 22402 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.024154 22402 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.027088 22402 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:34.065837 22099 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40254 (request call id 22) took 1074 ms. Trace:
I20260709 13:09:34.066497 22099 rpcz_store.cc:276] 0709 13:09:33.142241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.528776 (+386535us) service_pool.cc:224] Handling call
0709 13:09:33.565669 (+ 36893us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b580004e998. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d927aedb1 00007f2d928eeb71 00007f2d928eea22 00007f2d9b807c09 00007f2d9a961ee0 00007f2d9aa47831 00007f2d9aa24ac3 00007f2d9a9d3400 00007f2d93e58af4 00007f2d93e58a82 00007f2d93e589b1
0709 13:09:33.642531 (+ 76862us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:33.650269 (+  7738us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:33.967202 (+316933us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:34.064996 (+ 97794us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:34.065770 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39590656}
I20260709 13:09:34.073232 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:34.092746 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:34.106798 22083 leader_election.cc:343] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.113652 22387 tablet_bootstrap.cc:654] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.114253 22229 leader_election.cc:343] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.136188 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:34.147786 22232 leader_election.cc:343] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.148299 22232 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:34.148669 22386 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:34.149214 22386 ts_tablet_manager.cc:1403] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.429s	user 0.033s	sys 0.007s
I20260709 13:09:34.152590 22386 raft_consensus.cc:359] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.153317 22386 raft_consensus.cc:385] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.153630 22386 raft_consensus.cc:740] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.154577 22393 raft_consensus.cc:2749] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.145756 22385 raft_consensus.cc:359] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.158551 22385 raft_consensus.cc:385] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.158874 22385 raft_consensus.cc:740] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.159374 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:34.159758 22385 consensus_queue.cc:260] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.162248 22385 ts_tablet_manager.cc:1434] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.000s
I20260709 13:09:34.163244 22385 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
W20260709 13:09:34.163864 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:34.171054 22158 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.171626 22099 tablet_service.cc:1511] Processing CreateTablet for tablet 32223739e62f42aeb7edc9209035b260 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:34.172099 22386 consensus_queue.cc:260] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.172964 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32223739e62f42aeb7edc9209035b260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.178572 22386 ts_tablet_manager.cc:1434] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 13:09:34.179737 22386 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:34.184041 22174 tablet_service.cc:1511] Processing CreateTablet for tablet d5222aa4870d49f19225aa91b8599c95 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:34.185285 22388 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:34.185376 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5222aa4870d49f19225aa91b8599c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.185824 22388 ts_tablet_manager.cc:1403] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.351s	user 0.018s	sys 0.001s
I20260709 13:09:34.188936 22388 raft_consensus.cc:359] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.189608 22388 raft_consensus.cc:385] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.193500 22385 tablet_bootstrap.cc:654] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.189882 22388 raft_consensus.cc:740] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.194172 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 32223739e62f42aeb7edc9209035b260 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:34.195531 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32223739e62f42aeb7edc9209035b260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.197238 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47a9b9b2ec4f09be9ef8f885554e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:34.198741 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47a9b9b2ec4f09be9ef8f885554e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.200469 22253 tablet_service.cc:1511] Processing CreateTablet for tablet d5222aa4870d49f19225aa91b8599c95 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:34.201807 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5222aa4870d49f19225aa91b8599c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.203127 22177 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47a9b9b2ec4f09be9ef8f885554e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:34.204424 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47a9b9b2ec4f09be9ef8f885554e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.208997 22248 tablet_service.cc:1511] Processing CreateTablet for tablet 8e47a9b9b2ec4f09be9ef8f885554e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:34.212210 22388 consensus_queue.cc:260] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.226266 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e5e86a9404276b44ce60830112a9e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:34.226888 22173 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e5e86a9404276b44ce60830112a9e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:34.227645 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e5e86a9404276b44ce60830112a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.228129 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e5e86a9404276b44ce60830112a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.233515 22388 ts_tablet_manager.cc:1434] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:09:34.233860 22385 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:34.234370 22385 ts_tablet_manager.cc:1403] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.001s
I20260709 13:09:34.234586 22388 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:34.239239 22327 tablet_service.cc:1511] Processing CreateTablet for tablet d5222aa4870d49f19225aa91b8599c95 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:34.240666 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5222aa4870d49f19225aa91b8599c95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:34.242821 22306 leader_election.cc:343] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.243099 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4e5e86a9404276b44ce60830112a9e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:34.244415 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4e5e86a9404276b44ce60830112a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.244227 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:34.244979 22340 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:34.246711 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:34.248625 22080 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:34.249423 22395 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.249830 22395 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.250203 22395 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.257400 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e47a9b9b2ec4f09be9ef8f885554e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.259727 22395 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:34.262248 22306 leader_election.cc:343] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.262733 22306 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:34.262840 22329 tablet_service.cc:1511] Processing CreateTablet for tablet eb552418dae949178152d5fd607910e7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:34.263535 22397 raft_consensus.cc:2749] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.264211 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb552418dae949178152d5fd607910e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.265170 22256 tablet_service.cc:1511] Processing CreateTablet for tablet eb552418dae949178152d5fd607910e7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:34.266120 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:34.266439 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb552418dae949178152d5fd607910e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:34.267544 22083 leader_election.cc:343] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.269026 22395 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.263522 22386 tablet_bootstrap.cc:654] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.269840 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:34.270494 22340 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.271152 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:34.272634 22155 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.273138 22155 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:34.274312 22402 raft_consensus.cc:2749] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.276891 22385 raft_consensus.cc:359] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.277659 22385 raft_consensus.cc:385] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.277972 22385 raft_consensus.cc:740] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.279841 22099 tablet_service.cc:1511] Processing CreateTablet for tablet eb552418dae949178152d5fd607910e7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:34.281188 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb552418dae949178152d5fd607910e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.282366 22254 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55722 (request call id 23) took 1302 ms. Trace:
I20260709 13:09:34.282770 22254 rpcz_store.cc:276] 0709 13:09:32.980277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.533516 (+553239us) service_pool.cc:224] Handling call
0709 13:09:33.678924 (+145408us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:33.679011 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:33.878008 (+198997us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:34.257784 (+379776us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:34.282302 (+ 24518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24000}
I20260709 13:09:34.277992 22340 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:34.285106 22080 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:34.286263 22395 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.284505 22385 consensus_queue.cc:260] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.296187 22394 raft_consensus.cc:493] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.296674 22394 raft_consensus.cc:515] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.302616 22388 tablet_bootstrap.cc:654] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.292766 22174 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:34.307858 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.317615 22387 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:34.318321 22387 ts_tablet_manager.cc:1403] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.407s	user 0.037s	sys 0.040s
I20260709 13:09:34.320499 22394 leader_election.cc:290] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.308151 22385 ts_tablet_manager.cc:1434] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:09:34.313189 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:34.321540 22117 raft_consensus.cc:2468] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:34.324258 22232 leader_election.cc:304] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:34.325662 22393 raft_consensus.cc:2804] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.326167 22393 raft_consensus.cc:493] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.326485 22393 raft_consensus.cc:3060] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.331952 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:34.333997 22232 leader_election.cc:343] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.335031 22386 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:34.335566 22386 ts_tablet_manager.cc:1403] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.000s
I20260709 13:09:34.336555 22251 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:34.337550 22394 raft_consensus.cc:493] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.337869 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.338091 22394 raft_consensus.cc:515] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.338680 22386 raft_consensus.cc:359] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.339412 22386 raft_consensus.cc:385] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.339696 22386 raft_consensus.cc:740] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.341094 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f610a8a53884b579f5db10b1da26e34" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:34.342670 22232 leader_election.cc:343] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.343353 22393 raft_consensus.cc:515] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.347143 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:34.347898 22117 raft_consensus.cc:3060] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.354277 22385 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:34.356525 22324 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:34.357900 22324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2ad0d0d17848deb4a3f21d5b04a3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.340445 22386 consensus_queue.cc:260] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.363010 22386 ts_tablet_manager.cc:1434] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:09:34.364024 22386 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:34.364452 22117 raft_consensus.cc:2468] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:34.365849 22232 leader_election.cc:304] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:34.370453 22104 tablet_service.cc:1511] Processing CreateTablet for tablet 9831dd11f7cb42cea1274a6891904740 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:34.371805 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831dd11f7cb42cea1274a6891904740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.367561 22395 raft_consensus.cc:697] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:34.380609 22395 consensus_queue.cc:237] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.383467 22173 tablet_service.cc:1511] Processing CreateTablet for tablet 9831dd11f7cb42cea1274a6891904740 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:34.391252 22387 raft_consensus.cc:359] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.392361 22387 raft_consensus.cc:385] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.392874 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831dd11f7cb42cea1274a6891904740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.392782 22387 raft_consensus.cc:740] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.403013 22387 consensus_queue.cc:260] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.405855 22387 ts_tablet_manager.cc:1434] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.005s
I20260709 13:09:34.396555 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 9831dd11f7cb42cea1274a6891904740 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:34.407107 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9831dd11f7cb42cea1274a6891904740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.393795 22394 leader_election.cc:290] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.394862 22393 leader_election.cc:290] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.412276 22394 raft_consensus.cc:2804] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.407168 22387 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:34.412955 22394 raft_consensus.cc:697] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:34.414160 22394 consensus_queue.cc:237] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.420967 22418 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.421512 22418 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.423858 22418 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.428121 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:34.429603 22080 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.435189 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:34.435940 22192 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:34.436877 22325 tablet_service.cc:1511] Processing CreateTablet for tablet f92951140ac34be7b033283112113d7c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:34.437372 22083 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:34.438457 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92951140ac34be7b033283112113d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.438750 22418 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.439116 22386 tablet_bootstrap.cc:654] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.439206 22418 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.439752 22418 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.448055 22385 tablet_bootstrap.cc:654] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.458509 22103 tablet_service.cc:1511] Processing CreateTablet for tablet f92951140ac34be7b033283112113d7c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:34.460450 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92951140ac34be7b033283112113d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.464859 22177 tablet_service.cc:1511] Processing CreateTablet for tablet f92951140ac34be7b033283112113d7c (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:34.466362 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92951140ac34be7b033283112113d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.472363 22387 tablet_bootstrap.cc:654] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.441038 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 75285.6us
I20260709 13:09:34.482370 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f610a8a53884b579f5db10b1da26e34" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:34.483099 22192 raft_consensus.cc:2468] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:34.458504 22418 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.484246 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:34.490532 22232 leader_election.cc:304] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:34.499104 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:34.500138 22232 leader_election.cc:343] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.493970 22418 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.503333 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:34.508603 22394 raft_consensus.cc:2804] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.509238 22191 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.511233 22385 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:34.511871 22385 ts_tablet_manager.cc:1403] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.004s
I20260709 13:09:34.515388 22385 raft_consensus.cc:359] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.509413 22394 raft_consensus.cc:493] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.517200 22394 raft_consensus.cc:3060] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.518221 22191 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:34.507439 22388 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:34.520087 22388 ts_tablet_manager.cc:1403] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.286s	user 0.040s	sys 0.024s
I20260709 13:09:34.524104 22386 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:34.523685 22388 raft_consensus.cc:359] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.524765 22386 ts_tablet_manager.cc:1403] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 13:09:34.524830 22388 raft_consensus.cc:385] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.519058 22385 raft_consensus.cc:385] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.525525 22388 raft_consensus.cc:740] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.525641 22385 raft_consensus.cc:740] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.526643 22388 consensus_queue.cc:260] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.527135 22385 consensus_queue.cc:260] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:34.528366 22386 raft_consensus.cc:359] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.529055 22386 raft_consensus.cc:385] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.529361 22386 raft_consensus.cc:740] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.529501 22388 ts_tablet_manager.cc:1434] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:34.529459 22394 raft_consensus.cc:515] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.530149 22386 consensus_queue.cc:260] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.530759 22388 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
W20260709 13:09:34.501940 22080 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:34.561065 22080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 58939.1us
I20260709 13:09:34.567456 22083 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:34.579571 22174 tablet_service.cc:1511] Processing CreateTablet for tablet 171e1f8df0714984a5c04e9a4c53c90b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.580629 22251 tablet_service.cc:1511] Processing CreateTablet for tablet 171e1f8df0714984a5c04e9a4c53c90b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.582168 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e1f8df0714984a5c04e9a4c53c90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.582758 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e1f8df0714984a5c04e9a4c53c90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.586318 22012 catalog_manager.cc:5697] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.587020 22013 catalog_manager.cc:5697] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.598489 22256 tablet_service.cc:1511] Processing CreateTablet for tablet 7924d439b23d46c090863a9e0eeab8d6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:34.600278 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7924d439b23d46c090863a9e0eeab8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.603399 22103 tablet_service.cc:1511] Processing CreateTablet for tablet 7924d439b23d46c090863a9e0eeab8d6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:34.603668 22099 tablet_service.cc:1511] Processing CreateTablet for tablet 11ae63d58cc3409fac6679d9f14f3145 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.605448 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7924d439b23d46c090863a9e0eeab8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.612259 22173 tablet_service.cc:1511] Processing CreateTablet for tablet 11ae63d58cc3409fac6679d9f14f3145 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.613569 22099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ae63d58cc3409fac6679d9f14f3145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.618216 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 171e1f8df0714984a5c04e9a4c53c90b (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.532999 22385 ts_tablet_manager.cc:1434] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:34.623133 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ae63d58cc3409fac6679d9f14f3145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.623641 22386 ts_tablet_manager.cc:1434] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:09:34.623781 22394 leader_election.cc:290] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.626583 22418 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.627417 22385 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:34.627691 22418 raft_consensus.cc:697] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:34.627779 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f610a8a53884b579f5db10b1da26e34" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:34.628996 22191 raft_consensus.cc:3060] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.631222 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e1f8df0714984a5c04e9a4c53c90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.621093 22387 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:34.636514 22387 ts_tablet_manager.cc:1403] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.230s	user 0.013s	sys 0.006s
I20260709 13:09:34.626003 22386 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:34.637660 22253 tablet_service.cc:1511] Processing CreateTablet for tablet 11ae63d58cc3409fac6679d9f14f3145 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.639588 22253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ae63d58cc3409fac6679d9f14f3145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.641763 22107 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcdef153e7447d84951d92004c6594 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.643491 22107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcdef153e7447d84951d92004c6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.629575 22418 consensus_queue.cc:237] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.647807 22327 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcdef153e7447d84951d92004c6594 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.649587 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcdef153e7447d84951d92004c6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.652343 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 7924d439b23d46c090863a9e0eeab8d6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:34.654060 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7924d439b23d46c090863a9e0eeab8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.654827 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcdef153e7447d84951d92004c6594 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.656258 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcdef153e7447d84951d92004c6594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.657271 22385 tablet_bootstrap.cc:654] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.658880 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f610a8a53884b579f5db10b1da26e34" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
W20260709 13:09:34.661135 22232 leader_election.cc:343] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.664482 22248 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8819d5105462fadf17a4783b64e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:34.667949 22329 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8819d5105462fadf17a4783b64e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:34.669530 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8819d5105462fadf17a4783b64e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.670351 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8819d5105462fadf17a4783b64e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.671923 22104 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8819d5105462fadf17a4783b64e02 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:34.650170 22387 raft_consensus.cc:359] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.673285 22387 raft_consensus.cc:385] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.673627 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8819d5105462fadf17a4783b64e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.673749 22387 raft_consensus.cc:740] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.681046 22388 tablet_bootstrap.cc:654] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.686291 22397 raft_consensus.cc:493] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.687156 22395 raft_consensus.cc:493] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.687090 22397 raft_consensus.cc:515] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.687850 22395 raft_consensus.cc:515] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.693081 22395 leader_election.cc:290] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:34.692950 22191 raft_consensus.cc:2468] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:34.710809 22387 consensus_queue.cc:260] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.693747 22397 leader_election.cc:290] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:34.700201 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:34.703428 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:34.703639 22177 tablet_service.cc:1511] Processing CreateTablet for tablet ccf3d2ff31fb49d0afde438cabaf1883 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.714747 22387 ts_tablet_manager.cc:1434] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 13:09:34.727751 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:34.727986 22250 tablet_service.cc:1511] Processing CreateTablet for tablet ccf3d2ff31fb49d0afde438cabaf1883 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.729617 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf3d2ff31fb49d0afde438cabaf1883. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:34.731452 22080 leader_election.cc:343] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:34.732632 22083 leader_election.cc:343] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.734141 22083 leader_election.cc:304] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:34.734932 22387 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:34.735394 22395 raft_consensus.cc:2749] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.735544 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf3d2ff31fb49d0afde438cabaf1883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.738651 22386 tablet_bootstrap.cc:654] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.735616 22306 leader_election.cc:343] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.791121 22329 tablet_service.cc:1511] Processing CreateTablet for tablet ccf3d2ff31fb49d0afde438cabaf1883 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.792625 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf3d2ff31fb49d0afde438cabaf1883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.834893 22098 tablet_service.cc:1511] Processing CreateTablet for tablet 79ad3d419e304cec828f5104f51047f6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.836411 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ad3d419e304cec828f5104f51047f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.839622 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6d7c28c00b4ce7ac2826c1959ada78 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.841503 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6d7c28c00b4ce7ac2826c1959ada78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.841240 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 79ad3d419e304cec828f5104f51047f6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.841775 22105 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6d7c28c00b4ce7ac2826c1959ada78 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.842725 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ad3d419e304cec828f5104f51047f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.843253 22105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6d7c28c00b4ce7ac2826c1959ada78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.846480 22232 leader_election.cc:304] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:34.848151 22394 raft_consensus.cc:2804] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.848896 22394 raft_consensus.cc:697] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:34.849424 22385 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:34.850095 22385 ts_tablet_manager.cc:1403] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.004s
I20260709 13:09:34.853092 22387 tablet_bootstrap.cc:654] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.854494 22083 consensus_peers.cc:597] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.850363 22394 consensus_queue.cc:237] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.878988 22420 consensus_queue.cc:1048] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:34.881073 22402 raft_consensus.cc:493] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.881637 22402 raft_consensus.cc:515] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.887001 22402 leader_election.cc:290] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:34.888799 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:34.888931 22248 tablet_service.cc:1511] Processing CreateTablet for tablet 79ad3d419e304cec828f5104f51047f6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.890852 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ad3d419e304cec828f5104f51047f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.894017 22395 consensus_queue.cc:1048] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.896533 22386 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
W20260709 13:09:34.894443 22155 leader_election.cc:343] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.897097 22386 ts_tablet_manager.cc:1403] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.272s	user 0.039s	sys 0.051s
I20260709 13:09:34.931447 22104 tablet_service.cc:1511] Processing CreateTablet for tablet f399f589fa4347108c35bf247c543fb6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.932509 22256 tablet_service.cc:1511] Processing CreateTablet for tablet f399f589fa4347108c35bf247c543fb6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.933394 22104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f399f589fa4347108c35bf247c543fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.935673 22174 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6d7c28c00b4ce7ac2826c1959ada78 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.937855 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6d7c28c00b4ce7ac2826c1959ada78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.945839 22387 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:34.948458 22388 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:34.953841 22386 raft_consensus.cc:359] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:34.954923 22386 raft_consensus.cc:385] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.955672 22388 ts_tablet_manager.cc:1403] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.425s	user 0.014s	sys 0.011s
I20260709 13:09:34.955283 22327 tablet_service.cc:1511] Processing CreateTablet for tablet f399f589fa4347108c35bf247c543fb6 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.955296 22386 raft_consensus.cc:740] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.957638 22386 consensus_queue.cc:260] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:34.958755 22387 ts_tablet_manager.cc:1403] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.224s	user 0.009s	sys 0.011s
I20260709 13:09:34.956857 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f399f589fa4347108c35bf247c543fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.963188 22385 raft_consensus.cc:359] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.963972 22385 raft_consensus.cc:385] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.964251 22385 raft_consensus.cc:740] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.965075 22386 ts_tablet_manager.cc:1434] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:09:34.965044 22385 consensus_queue.cc:260] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.972074 22385 ts_tablet_manager.cc:1434] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 13:09:34.967290 22387 raft_consensus.cc:359] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:34.976773 22386 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:34.978931 22395 raft_consensus.cc:493] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.987298 22395 raft_consensus.cc:515] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:34.981793 22388 raft_consensus.cc:359] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:34.983726 22256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f399f589fa4347108c35bf247c543fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.004714 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:35.006870 22080 leader_election.cc:343] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.007498 22213 debug-util.cc:398] Leaking SignalData structure 0x7b0800264220 after lost signal to thread 14477
W20260709 13:09:35.009070 22213 debug-util.cc:398] Leaking SignalData structure 0x7b0800262ee0 after lost signal to thread 22049
I20260709 13:09:34.984483 22387 raft_consensus.cc:385] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.994884 22388 raft_consensus.cc:385] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.031471 22385 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:35.000252 22395 leader_election.cc:290] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:35.035211 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:35.036384 22266 raft_consensus.cc:2468] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:35.038833 22305 leader_election.cc:304] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:35.040098 22397 raft_consensus.cc:2804] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.040524 22397 raft_consensus.cc:493] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.011495 22387 raft_consensus.cc:740] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.040918 22397 raft_consensus.cc:3060] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.029078 22388 raft_consensus.cc:740] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.066416 22386 tablet_bootstrap.cc:654] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.095496 22387 consensus_queue.cc:260] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.098176 22387 ts_tablet_manager.cc:1434] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.000s
I20260709 13:09:35.099481 22387 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:35.107352 22387 tablet_bootstrap.cc:654] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.111578 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 85a853eea2e64e4bb361d4720592e9a4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:35.111426 22011 catalog_manager.cc:5697] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.112874 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a853eea2e64e4bb361d4720592e9a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:35.093395 22232 consensus_peers.cc:597] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.118510 22098 tablet_service.cc:1511] Processing CreateTablet for tablet c183a828104c4ec7bb186876a7fcf7d8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:35.119957 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c183a828104c4ec7bb186876a7fcf7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.123594 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 95a9a3f31b644deeae1bdd440987faf4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:35.124948 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a9a3f31b644deeae1bdd440987faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.128279 22103 tablet_service.cc:1511] Processing CreateTablet for tablet 95a9a3f31b644deeae1bdd440987faf4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:35.129638 22103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a9a3f31b644deeae1bdd440987faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.140012 22179 tablet_service.cc:1511] Processing CreateTablet for tablet 85a853eea2e64e4bb361d4720592e9a4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:35.140817 22177 tablet_service.cc:1511] Processing CreateTablet for tablet c183a828104c4ec7bb186876a7fcf7d8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:35.141935 22179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a853eea2e64e4bb361d4720592e9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.142395 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:35.137264 22013 catalog_manager.cc:5697] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.146672 22177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c183a828104c4ec7bb186876a7fcf7d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:35.156062 22157 leader_election.cc:343] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.156754 22157 leader_election.cc:304] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.157661 22402 raft_consensus.cc:2749] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:35.169015 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:35.166647 22388 consensus_queue.cc:260] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.176120 22451 raft_consensus.cc:493] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.182243 22394 raft_consensus.cc:493] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.182838 22394 raft_consensus.cc:515] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.183730 22248 tablet_service.cc:1511] Processing CreateTablet for tablet 85a853eea2e64e4bb361d4720592e9a4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:35.185079 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a853eea2e64e4bb361d4720592e9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.185155 22394 leader_election.cc:290] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:35.186582 22174 tablet_service.cc:1511] Processing CreateTablet for tablet 95a9a3f31b644deeae1bdd440987faf4 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:35.187422 22250 tablet_service.cc:1511] Processing CreateTablet for tablet c183a828104c4ec7bb186876a7fcf7d8 (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:35.187914 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a9a3f31b644deeae1bdd440987faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.187808 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:35.188825 22250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c183a828104c4ec7bb186876a7fcf7d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:35.189805 22232 leader_election.cc:343] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.195333 22080 consensus_peers.cc:597] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d -> Peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Couldn't send request to peer 3f0e42f9dab447d5bc309baaacba2ee7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.202551 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:35.204290 22232 leader_election.cc:343] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.204808 22232 leader_election.cc:304] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:35.205940 22394 raft_consensus.cc:2749] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.210752 22385 tablet_bootstrap.cc:654] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.176904 22451 raft_consensus.cc:515] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.219684 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:35.222805 22082 leader_election.cc:343] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.223294 22082 leader_election.cc:304] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.224540 22395 raft_consensus.cc:2749] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.231446 22397 raft_consensus.cc:515] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.234690 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:35.239132 22306 leader_election.cc:343] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.240700 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:35.241577 22266 raft_consensus.cc:3060] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.245116 22395 consensus_queue.cc:1048] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.239727 22397 leader_election.cc:290] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:35.258368 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 39ecd61e5f504f318519347d1299751e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:35.259935 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ecd61e5f504f318519347d1299751e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.259701 22098 tablet_service.cc:1511] Processing CreateTablet for tablet 39ecd61e5f504f318519347d1299751e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:35.261018 22098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ecd61e5f504f318519347d1299751e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.261020 22387 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:35.262538 22387 ts_tablet_manager.cc:1403] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.163s	user 0.032s	sys 0.061s
I20260709 13:09:35.268893 22248 tablet_service.cc:1511] Processing CreateTablet for tablet 39ecd61e5f504f318519347d1299751e (DEFAULT_TABLE table=test-workload [id=c7b5500897854f09be6e9bfd21cc1c7c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:35.282385 22266 raft_consensus.cc:2468] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:35.286836 22305 leader_election.cc:304] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:35.292590 22386 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.293228 22386 ts_tablet_manager.cc:1403] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.318s	user 0.016s	sys 0.029s
I20260709 13:09:35.295084 22397 raft_consensus.cc:2804] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.295713 22397 raft_consensus.cc:697] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:35.296620 22397 consensus_queue.cc:237] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.298174 22248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ecd61e5f504f318519347d1299751e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:35.300804 22386 raft_consensus.cc:359] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.310946 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:35.312158 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:35.313071 22385 tablet_bootstrap.cc:492] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:35.324381 22190 raft_consensus.cc:2468] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:35.324581 22385 ts_tablet_manager.cc:1403] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.008s
W20260709 13:09:35.325349 22305 leader_election.cc:343] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.325821 22386 raft_consensus.cc:385] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.326334 22386 raft_consensus.cc:740] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.328011 22306 leader_election.cc:304] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.314695 22388 ts_tablet_manager.cc:1434] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.359s	user 0.005s	sys 0.023s
I20260709 13:09:35.315002 22451 leader_election.cc:290] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:35.327689 22386 consensus_queue.cc:260] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.331630 22388 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:35.329077 22452 raft_consensus.cc:2804] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.334367 22452 raft_consensus.cc:493] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.334684 22452 raft_consensus.cc:3060] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.327696 22385 raft_consensus.cc:359] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.338011 22385 raft_consensus.cc:385] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.338356 22385 raft_consensus.cc:740] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.339383 22385 consensus_queue.cc:260] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.341874 22385 ts_tablet_manager.cc:1434] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:09:35.330438 22387 raft_consensus.cc:359] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.342931 22387 raft_consensus.cc:385] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.343274 22387 raft_consensus.cc:740] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.344095 22387 consensus_queue.cc:260] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.344420 22452 raft_consensus.cc:515] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.353034 22452 leader_election.cc:290] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:35.354219 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:35.355569 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96bcd6c5d2745d4af954e66e23b0e4f" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:35.357465 22386 ts_tablet_manager.cc:1434] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 13:09:35.364181 22266 raft_consensus.cc:3060] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.364373 22402 raft_consensus.cc:493] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.364890 22402 raft_consensus.cc:515] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.357738 22388 tablet_bootstrap.cc:654] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.367213 22402 leader_election.cc:290] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:35.365269 22386 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.368942 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.363399 22385 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
W20260709 13:09:35.370934 22155 leader_election.cc:343] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.371737 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:35.372221 22266 raft_consensus.cc:2468] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:35.372428 22117 raft_consensus.cc:2468] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:35.362665 22012 catalog_manager.cc:5697] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.374531 22305 leader_election.cc:304] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:35.374734 22158 leader_election.cc:304] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:35.373356 22190 raft_consensus.cc:3060] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.378625 22452 raft_consensus.cc:2804] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.379338 22452 raft_consensus.cc:697] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:35.380199 22452 consensus_queue.cc:237] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.382272 22386 tablet_bootstrap.cc:654] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.383162 22394 consensus_queue.cc:1048] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.386309 22402 raft_consensus.cc:2804] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.390861 22402 raft_consensus.cc:493] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.391394 22402 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.393217 22385 tablet_bootstrap.cc:654] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.399819 22387 ts_tablet_manager.cc:1434] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.003s
I20260709 13:09:35.407076 22387 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:35.407649 22190 raft_consensus.cc:2468] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:35.419850 22402 raft_consensus.cc:515] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.454653 22387 tablet_bootstrap.cc:654] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.454950 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:35.451583 22232 consensus_peers.cc:597] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:35.457924 22155 leader_election.cc:343] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.441469 22012 catalog_manager.cc:5697] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.475282 22388 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:35.476300 22388 ts_tablet_manager.cc:1403] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.017s
I20260709 13:09:35.484453 22385 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:35.485314 22385 ts_tablet_manager.cc:1403] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.015s
I20260709 13:09:35.490417 22402 leader_election.cc:290] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:35.492139 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:35.491756 22385 raft_consensus.cc:359] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.493116 22117 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.493394 22385 raft_consensus.cc:385] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.494133 22385 raft_consensus.cc:740] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.495397 22385 consensus_queue.cc:260] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.512779 22386 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.509483 22388 raft_consensus.cc:359] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.515998 22388 raft_consensus.cc:385] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.516331 22388 raft_consensus.cc:740] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.516821 22385 ts_tablet_manager.cc:1434] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:09:35.518335 22385 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:35.518687 22386 ts_tablet_manager.cc:1403] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.007s
I20260709 13:09:35.524334 22117 raft_consensus.cc:2468] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:35.525645 22385 tablet_bootstrap.cc:654] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.525884 22386 raft_consensus.cc:359] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.526710 22386 raft_consensus.cc:385] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.527005 22386 raft_consensus.cc:740] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.528023 22387 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:35.527746 22386 consensus_queue.cc:260] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.528596 22387 ts_tablet_manager.cc:1403] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.041s
I20260709 13:09:35.529942 22386 ts_tablet_manager.cc:1434] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 13:09:35.531112 22386 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.531864 22387 raft_consensus.cc:359] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.532711 22387 raft_consensus.cc:385] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.533075 22387 raft_consensus.cc:740] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.533929 22387 consensus_queue.cc:260] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.536785 22158 leader_election.cc:304] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:35.537168 22387 ts_tablet_manager.cc:1434] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:35.537655 22402 raft_consensus.cc:2804] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.537988 22386 tablet_bootstrap.cc:654] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.538295 22402 raft_consensus.cc:697] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:35.539255 22402 consensus_queue.cc:237] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.563669 22387 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:35.572227 22388 consensus_queue.cc:260] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.573590 22452 raft_consensus.cc:493] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.574227 22452 raft_consensus.cc:515] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.582058 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:35.584293 22305 leader_election.cc:343] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.586200 22452 leader_election.cc:290] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:35.587831 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:35.588824 22117 raft_consensus.cc:2468] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:35.590583 22306 leader_election.cc:304] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.593513 22452 raft_consensus.cc:2804] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.594058 22452 raft_consensus.cc:493] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.594530 22452 raft_consensus.cc:3060] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.612633 22012 catalog_manager.cc:5697] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.621646 22387 tablet_bootstrap.cc:654] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.624136 22418 raft_consensus.cc:493] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.624709 22418 raft_consensus.cc:515] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.626928 22418 leader_election.cc:290] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:35.629765 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.630432 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:35.631464 22080 leader_election.cc:343] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.631968 22082 leader_election.cc:343] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.632499 22082 leader_election.cc:304] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.632746 22386 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.633469 22386 ts_tablet_manager.cc:1403] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.103s	user 0.034s	sys 0.053s
I20260709 13:09:35.637200 22418 raft_consensus.cc:2749] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.639288 22452 raft_consensus.cc:515] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.640383 22385 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:35.640988 22385 ts_tablet_manager.cc:1403] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.069s
I20260709 13:09:35.644141 22388 ts_tablet_manager.cc:1434] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.167s	user 0.011s	sys 0.000s
I20260709 13:09:35.644200 22385 raft_consensus.cc:359] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.645303 22385 raft_consensus.cc:385] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.645579 22388 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:35.645668 22385 raft_consensus.cc:740] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.646788 22385 consensus_queue.cc:260] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.637281 22386 raft_consensus.cc:359] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.648913 22386 raft_consensus.cc:385] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.649194 22386 raft_consensus.cc:740] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.649269 22385 ts_tablet_manager.cc:1434] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:35.649950 22386 consensus_queue.cc:260] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.650794 22385 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:35.652624 22386 ts_tablet_manager.cc:1434] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:09:35.655855 22386 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.660668 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:35.661339 22117 raft_consensus.cc:3060] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.662056 22386 tablet_bootstrap.cc:654] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.663020 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6bbb4b9f7b416aad8d32612da1e7e1" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:35.663518 22385 tablet_bootstrap.cc:654] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:35.664944 22305 leader_election.cc:343] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.666364 22418 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.666883 22418 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.669013 22418 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:35.670851 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:35.671981 22266 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:35.670938 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.673599 22117 raft_consensus.cc:2468] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
W20260709 13:09:35.675011 22080 leader_election.cc:343] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.675751 22082 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:35.676220 22306 leader_election.cc:304] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:35.677515 22397 raft_consensus.cc:2804] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.677541 22418 raft_consensus.cc:2804] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.678201 22397 raft_consensus.cc:697] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:35.678369 22418 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.679032 22418 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.679251 22397 consensus_queue.cc:237] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.687552 22452 leader_election.cc:290] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:35.687865 22395 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.688717 22395 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.692255 22395 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:35.694511 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:35.696623 22083 leader_election.cc:343] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.698472 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.699491 22339 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:35.701588 22080 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:35.703231 22395 raft_consensus.cc:2804] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.703773 22395 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.704231 22395 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.705982 22402 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.706836 22402 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.712169 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.712248 22402 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:35.714473 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:35.716564 22158 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:35.717739 22402 raft_consensus.cc:2749] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.719166 22388 tablet_bootstrap.cc:654] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.726186 22394 raft_consensus.cc:493] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.727008 22394 raft_consensus.cc:515] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.729689 22387 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:35.730393 22387 ts_tablet_manager.cc:1403] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.001s
I20260709 13:09:35.731830 22394 leader_election.cc:290] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:35.734265 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:35.735630 22191 raft_consensus.cc:2468] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:35.735802 22395 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.737900 22232 leader_election.cc:304] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:35.739691 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:35.740476 22339 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.743184 22394 raft_consensus.cc:2804] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.744287 22394 raft_consensus.cc:493] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.744897 22394 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.747872 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:35.751087 22232 leader_election.cc:343] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.753013 22306 consensus_peers.cc:597] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.756940 22397 consensus_queue.cc:1048] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.767540 22387 raft_consensus.cc:359] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.768910 22388 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:35.768958 22386 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.769629 22388 ts_tablet_manager.cc:1403] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.001s
I20260709 13:09:35.769671 22386 ts_tablet_manager.cc:1403] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.114s	user 0.024s	sys 0.040s
I20260709 13:09:35.773208 22339 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:35.774396 22080 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:35.768342 22387 raft_consensus.cc:385] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.775419 22387 raft_consensus.cc:740] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.775468 22459 raft_consensus.cc:2804] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.772611 22386 raft_consensus.cc:359] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.776223 22386 raft_consensus.cc:385] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.776671 22386 raft_consensus.cc:740] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.777770 22386 consensus_queue.cc:260] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.786543 22387 consensus_queue.cc:260] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.787798 22386 ts_tablet_manager.cc:1434] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:09:35.787777 22395 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:35.789533 22386 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.789916 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:35.791822 22083 leader_election.cc:343] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.792651 22387 ts_tablet_manager.cc:1434] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 13:09:35.797153 22386 tablet_bootstrap.cc:654] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.804536 22388 raft_consensus.cc:359] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.805629 22388 raft_consensus.cc:385] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.805956 22011 catalog_manager.cc:5697] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.809644 22386 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.810285 22386 ts_tablet_manager.cc:1403] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:09:35.810595 22459 raft_consensus.cc:697] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:35.811651 22459 consensus_queue.cc:237] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:35.813223 22386 raft_consensus.cc:359] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.814150 22386 raft_consensus.cc:385] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.814404 22386 raft_consensus.cc:740] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.815143 22386 consensus_queue.cc:260] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.817788 22386 ts_tablet_manager.cc:1434] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:35.819204 22386 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.805995 22388 raft_consensus.cc:740] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.823071 22388 consensus_queue.cc:260] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.825084 22388 ts_tablet_manager.cc:1434] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 13:09:35.825935 22388 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:35.826349 22387 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:35.833007 22388 tablet_bootstrap.cc:654] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.834594 22386 tablet_bootstrap.cc:654] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.846565 22420 raft_consensus.cc:493] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.845917 22015 catalog_manager.cc:5697] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.847131 22420 raft_consensus.cc:515] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.854568 22402 raft_consensus.cc:493] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.855350 22402 raft_consensus.cc:515] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.781275 22418 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.862265 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:35.885965 22232 leader_election.cc:343] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.884943 22387 tablet_bootstrap.cc:654] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.890681 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:35.891450 22266 raft_consensus.cc:2468] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:35.892721 22157 leader_election.cc:304] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:35.893627 22460 raft_consensus.cc:2804] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.894083 22460 raft_consensus.cc:493] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.894472 22460 raft_consensus.cc:3060] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.897578 22385 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:35.898329 22385 ts_tablet_manager.cc:1403] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.248s	user 0.079s	sys 0.092s
I20260709 13:09:35.889971 22402 leader_election.cc:290] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:35.886528 22386 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.886493 22420 leader_election.cc:290] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:35.888793 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:35.904570 22117 raft_consensus.cc:2468] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:35.903613 22394 raft_consensus.cc:515] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.886904 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:35.903466 22386 ts_tablet_manager.cc:1403] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.000s
I20260709 13:09:35.909729 22388 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:35.910424 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:35.911012 22191 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.911226 22460 raft_consensus.cc:515] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:35.911648 22229 leader_election.cc:343] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.912173 22229 leader_election.cc:304] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:35.913661 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
W20260709 13:09:35.915261 22232 leader_election.cc:343] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.916276 22386 raft_consensus.cc:359] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.917109 22386 raft_consensus.cc:385] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.917495 22386 raft_consensus.cc:740] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.918411 22388 ts_tablet_manager.cc:1403] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.035s
I20260709 13:09:35.918301 22386 consensus_queue.cc:260] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.918911 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:35.919728 22266 raft_consensus.cc:3060] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.921130 22386 ts_tablet_manager.cc:1434] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:35.922287 22386 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:35.922633 22388 raft_consensus.cc:359] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.923389 22388 raft_consensus.cc:385] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.923682 22388 raft_consensus.cc:740] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.924595 22388 consensus_queue.cc:260] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.925465 22420 raft_consensus.cc:2749] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.926718 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7fe317f7748d6b79af65dfce6aaa3" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:35.927455 22116 raft_consensus.cc:3060] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.929488 22387 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:35.929988 22387 ts_tablet_manager.cc:1403] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.029s
I20260709 13:09:35.930859 22386 tablet_bootstrap.cc:654] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.930480 22397 consensus_queue.cc:1048] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.932896 22387 raft_consensus.cc:359] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.933607 22387 raft_consensus.cc:385] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.933945 22387 raft_consensus.cc:740] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.934880 22387 consensus_queue.cc:260] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:35.937628 22388 ts_tablet_manager.cc:1434] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:35.938511 22191 raft_consensus.cc:2468] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:35.940074 22388 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:35.940232 22191 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.945371 22116 raft_consensus.cc:2468] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:35.945626 22232 leader_election.cc:304] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:35.946722 22420 raft_consensus.cc:2804] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.951895 22387 ts_tablet_manager.cc:1434] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:35.953226 22387 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:35.949677 22388 tablet_bootstrap.cc:654] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.907289 22394 leader_election.cc:290] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:35.960879 22385 raft_consensus.cc:359] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.963179 22418 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:35.963819 22452 consensus_queue.cc:1048] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.964466 22385 raft_consensus.cc:385] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.964344 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:35.964918 22385 raft_consensus.cc:740] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.965152 22265 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.965754 22385 consensus_queue.cc:260] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:35.966461 22387 tablet_bootstrap.cc:654] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.981370 22385 ts_tablet_manager.cc:1434] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.001s
I20260709 13:09:35.979393 22460 leader_election.cc:290] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:35.968485 22420 raft_consensus.cc:697] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:35.991963 22386 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:35.992449 22386 ts_tablet_manager.cc:1403] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.000s
I20260709 13:09:35.995605 22266 raft_consensus.cc:2468] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:35.997103 22486 raft_consensus.cc:493] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.997663 22486 raft_consensus.cc:515] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.000102 22486 leader_election.cc:290] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.001509 22385 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.006888 22265 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:36.006506 22420 consensus_queue.cc:237] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:35.984992 22158 leader_election.cc:304] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:36.011161 22082 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:36.011132 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:36.012874 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.013123 22339 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.014823 22476 raft_consensus.cc:2804] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.023672 22476 raft_consensus.cc:697] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:36.024674 22476 consensus_queue.cc:237] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.019266 22266 raft_consensus.cc:2468] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:36.029338 22157 leader_election.cc:304] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:36.030009 22116 raft_consensus.cc:3060] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.030242 22460 raft_consensus.cc:2804] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.030663 22460 raft_consensus.cc:493] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.031006 22460 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.014178 22486 raft_consensus.cc:2804] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.032806 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.034094 22486 raft_consensus.cc:697] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:36.035006 22486 consensus_queue.cc:237] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:36.036873 22155 leader_election.cc:343] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.039179 22402 consensus_queue.cc:1048] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.033726 22386 raft_consensus.cc:359] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.040330 22386 raft_consensus.cc:385] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.039501 22397 raft_consensus.cc:493] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.040746 22386 raft_consensus.cc:740] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.041476 22339 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:36.043118 22386 consensus_queue.cc:260] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.045512 22386 ts_tablet_manager.cc:1434] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:09:36.046509 22397 raft_consensus.cc:515] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.050613 22386 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.055460 22385 tablet_bootstrap.cc:654] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.057049 22459 raft_consensus.cc:493] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.057614 22459 raft_consensus.cc:515] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.058630 22397 leader_election.cc:290] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.058157 22012 catalog_manager.cc:5697] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.059782 22459 leader_election.cc:290] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.060482 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.061371 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:36.063588 22306 leader_election.cc:343] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:36.064815 22155 consensus_peers.cc:597] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Couldn't send request to peer 3f0e42f9dab447d5bc309baaacba2ee7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.066118 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:36.066583 22305 leader_election.cc:343] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.067083 22305 leader_election.cc:304] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.061791 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:36.069098 22082 leader_election.cc:343] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:36.069866 22080 leader_election.cc:343] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.070317 22080 leader_election.cc:304] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.073537 22386 tablet_bootstrap.cc:654] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.073922 22459 raft_consensus.cc:2749] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.075227 22397 raft_consensus.cc:2749] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.087587 22388 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.088089 22388 ts_tablet_manager.cc:1403] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.148s	user 0.009s	sys 0.008s
I20260709 13:09:36.092646 22388 raft_consensus.cc:359] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.093644 22388 raft_consensus.cc:385] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.094008 22388 raft_consensus.cc:740] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.097623 22388 consensus_queue.cc:260] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.103098 22388 ts_tablet_manager.cc:1434] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:09:36.104327 22388 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:36.105695 22013 catalog_manager.cc:5697] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.113559 22460 raft_consensus.cc:515] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.115170 22388 tablet_bootstrap.cc:654] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.123032 22387 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.123673 22387 ts_tablet_manager.cc:1403] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.171s	user 0.017s	sys 0.008s
I20260709 13:09:36.129053 22397 consensus_queue.cc:1048] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.128930 22387 raft_consensus.cc:359] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.130337 22387 raft_consensus.cc:385] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.130856 22387 raft_consensus.cc:740] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.132076 22387 consensus_queue.cc:260] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.138764 22387 ts_tablet_manager.cc:1434] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:09:36.141366 22385 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:36.141979 22385 ts_tablet_manager.cc:1403] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.002s
I20260709 13:09:36.150185 22385 raft_consensus.cc:359] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.150956 22385 raft_consensus.cc:385] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.151225 22385 raft_consensus.cc:740] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.151868 22385 consensus_queue.cc:260] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.157712 22388 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.158385 22388 ts_tablet_manager.cc:1403] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.014s
I20260709 13:09:36.164467 22387 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.169330 22385 ts_tablet_manager.cc:1434] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:09:36.174497 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:36.175189 22265 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.175961 22385 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.178269 22264 raft_consensus.cc:3060] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:36.179219 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:36.185838 22402 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.186497 22402 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.191288 22460 leader_election.cc:290] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.191500 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:36.193107 22155 leader_election.cc:343] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.195164 22265 raft_consensus.cc:2468] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:36.195679 22402 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.196357 22015 catalog_manager.cc:5697] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.208441 22397 consensus_queue.cc:1048] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.209700 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.210718 22339 raft_consensus.cc:2393] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:36.215199 22157 leader_election.cc:304] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:36.216933 22500 raft_consensus.cc:2804] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.217576 22500 raft_consensus.cc:697] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:36.218664 22500 consensus_queue.cc:237] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.231148 22387 tablet_bootstrap.cc:654] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.231818 22420 raft_consensus.cc:493] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.232467 22420 raft_consensus.cc:515] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.248782 22386 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.249378 22386 ts_tablet_manager.cc:1403] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.018s
I20260709 13:09:36.252925 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:36.254369 22229 leader_election.cc:343] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.256268 22476 raft_consensus.cc:493] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.256794 22476 raft_consensus.cc:515] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.258365 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.258953 22476 leader_election.cc:290] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.259248 22116 raft_consensus.cc:2468] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:36.260696 22385 tablet_bootstrap.cc:654] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.261472 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.261776 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.262765 22191 raft_consensus.cc:2393] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:36.262854 22232 leader_election.cc:304] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:36.264004 22394 raft_consensus.cc:2804] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.264426 22394 raft_consensus.cc:493] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.264760 22394 raft_consensus.cc:3060] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.251087 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.268723 22158 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:36.269089 22388 raft_consensus.cc:359] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.269814 22388 raft_consensus.cc:385] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.270099 22388 raft_consensus.cc:740] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.270854 22388 consensus_queue.cc:260] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.272835 22388 ts_tablet_manager.cc:1434] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.008s
I20260709 13:09:36.272636 22082 leader_election.cc:304] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.273247 22476 consensus_queue.cc:1048] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.273885 22459 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.274143 22386 raft_consensus.cc:359] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.274907 22386 raft_consensus.cc:385] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.275166 22386 raft_consensus.cc:740] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.275964 22386 consensus_queue.cc:260] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.276425 22500 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.278407 22386 ts_tablet_manager.cc:1434] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:09:36.279404 22386 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.255656 22420 leader_election.cc:290] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.285480 22386 tablet_bootstrap.cc:654] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.288182 22014 catalog_manager.cc:5697] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.289641 22387 tablet_bootstrap.cc:492] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.290253 22387 ts_tablet_manager.cc:1403] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.006s
I20260709 13:09:36.273919 22388 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:36.297385 22387 raft_consensus.cc:359] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.298316 22387 raft_consensus.cc:385] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.298589 22387 raft_consensus.cc:740] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.299628 22387 consensus_queue.cc:260] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.302376 22387 ts_tablet_manager.cc:1434] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:09:36.303457 22387 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.308059 22500 raft_consensus.cc:2749] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.309733 22387 tablet_bootstrap.cc:654] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.316218 22459 raft_consensus.cc:2749] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.319334 22394 raft_consensus.cc:515] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.331398 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:36.333396 22388 tablet_bootstrap.cc:654] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.338464 22394 leader_election.cc:290] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.339326 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:36.340258 22117 raft_consensus.cc:3060] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.352785 22385 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:36.353372 22385 ts_tablet_manager.cc:1403] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.000s
W20260709 13:09:36.354594 22229 leader_election.cc:343] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.356611 22459 consensus_queue.cc:1048] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.364615 22385 raft_consensus.cc:359] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.365384 22385 raft_consensus.cc:385] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.365679 22385 raft_consensus.cc:740] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.367179 22117 raft_consensus.cc:2468] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:36.368400 22232 leader_election.cc:304] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:36.369570 22420 raft_consensus.cc:2804] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.370092 22420 raft_consensus.cc:697] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:36.370927 22420 consensus_queue.cc:237] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.378875 22387 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.381224 22387 ts_tablet_manager.cc:1403] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.078s	user 0.025s	sys 0.026s
I20260709 13:09:36.380822 22385 consensus_queue.cc:260] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.383471 22385 ts_tablet_manager.cc:1434] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:09:36.387722 22387 raft_consensus.cc:359] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.388695 22387 raft_consensus.cc:385] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.389024 22387 raft_consensus.cc:740] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.389812 22387 consensus_queue.cc:260] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.390728 22385 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.394658 22388 tablet_bootstrap.cc:492] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.395195 22388 ts_tablet_manager.cc:1403] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.005s
I20260709 13:09:36.395823 22386 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.396364 22386 ts_tablet_manager.cc:1403] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.006s
I20260709 13:09:36.400475 22387 ts_tablet_manager.cc:1434] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:09:36.401672 22387 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.403132 22385 tablet_bootstrap.cc:654] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.402892 22386 raft_consensus.cc:359] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.403950 22386 raft_consensus.cc:385] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.404399 22386 raft_consensus.cc:740] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.405413 22386 consensus_queue.cc:260] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.410699 22387 tablet_bootstrap.cc:654] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.414487 22388 raft_consensus.cc:359] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.415629 22388 raft_consensus.cc:385] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.416002 22388 raft_consensus.cc:740] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.417577 22388 consensus_queue.cc:260] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.420080 22388 ts_tablet_manager.cc:1434] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:09:36.421687 22388 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:36.429901 22500 raft_consensus.cc:493] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.431589 22500 raft_consensus.cc:515] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.433715 22500 leader_election.cc:290] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.434861 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.435772 22386 ts_tablet_manager.cc:1434] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.001s
I20260709 13:09:36.437029 22386 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.438539 22385 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:36.439024 22385 ts_tablet_manager.cc:1403] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.005s
I20260709 13:09:36.444180 22420 consensus_queue.cc:1048] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:36.455468 22420 consensus_queue.cc:1048] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.455902 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90f7e1b06aa47b1a7a3bad9feba4d21" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.458055 22155 leader_election.cc:304] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.459328 22500 raft_consensus.cc:2749] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.458889 22011 catalog_manager.cc:5697] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.460253 22459 consensus_queue.cc:1048] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.471716 22385 raft_consensus.cc:359] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.472412 22385 raft_consensus.cc:385] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.472790 22385 raft_consensus.cc:740] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.474159 22388 tablet_bootstrap.cc:654] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.475317 22386 tablet_bootstrap.cc:654] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.473515 22385 consensus_queue.cc:260] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.479169 22385 ts_tablet_manager.cc:1434] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:09:36.480258 22385 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.485436 22387 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.491230 22387 ts_tablet_manager.cc:1403] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.000s
I20260709 13:09:36.500136 22387 raft_consensus.cc:359] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.500859 22387 raft_consensus.cc:385] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.501135 22387 raft_consensus.cc:740] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.509378 22388 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.509943 22388 ts_tablet_manager.cc:1403] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.002s
I20260709 13:09:36.512698 22387 consensus_queue.cc:260] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.512759 22452 raft_consensus.cc:493] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.519336 22387 ts_tablet_manager.cc:1434] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:09:36.523146 22385 tablet_bootstrap.cc:654] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.518639 22452 raft_consensus.cc:515] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.531345 22452 leader_election.cc:290] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:36.538707 22387 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.541738 22386 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.542518 22386 ts_tablet_manager.cc:1403] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.007s
I20260709 13:09:36.544621 22418 consensus_queue.cc:1048] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:09:36.552033 22500 consensus_queue.cc:1048] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.553978 22386 raft_consensus.cc:359] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.554839 22386 raft_consensus.cc:385] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.555034 22386 raft_consensus.cc:740] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.566349 22386 consensus_queue.cc:260] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.568236 22386 ts_tablet_manager.cc:1434] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.002s
I20260709 13:09:36.569315 22386 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.570456 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.572101 22387 tablet_bootstrap.cc:654] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.575426 22418 raft_consensus.cc:493] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.576030 22418 raft_consensus.cc:515] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.576615 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.578624 22418 leader_election.cc:290] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.575423 22386 tablet_bootstrap.cc:654] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.581763 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.582087 22388 raft_consensus.cc:359] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.582602 22264 raft_consensus.cc:2468] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:36.583081 22388 raft_consensus.cc:385] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.583467 22388 raft_consensus.cc:740] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.595330 22388 consensus_queue.cc:260] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.584116 22082 leader_election.cc:304] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:36.598537 22418 raft_consensus.cc:2804] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.599021 22418 raft_consensus.cc:493] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.599449 22418 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.601048 22388 ts_tablet_manager.cc:1434] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.001s
W20260709 13:09:36.584066 22306 leader_election.cc:343] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:36.604625 22306 leader_election.cc:343] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.605122 22306 leader_election.cc:304] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:36.589133 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.606076 22397 raft_consensus.cc:2749] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.609055 22418 raft_consensus.cc:515] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:36.609519 22083 leader_election.cc:343] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.611295 22192 raft_consensus.cc:3060] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.615284 22500 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.615936 22500 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.616466 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:36.617152 22264 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.619014 22500 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.621048 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:36.622831 22157 leader_election.cc:343] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.623885 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:36.625710 22158 leader_election.cc:343] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.626281 22158 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.627642 22500 raft_consensus.cc:2749] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.628916 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:36.629467 22459 raft_consensus.cc:493] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.630003 22459 raft_consensus.cc:515] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.632450 22459 leader_election.cc:290] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.634501 22338 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:36.634874 22083 leader_election.cc:343] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.636097 22264 raft_consensus.cc:2468] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:36.637456 22082 leader_election.cc:304] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:36.634510 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.638736 22418 leader_election.cc:290] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
W20260709 13:09:36.639600 22082 leader_election.cc:343] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.638391 22459 raft_consensus.cc:2804] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.640460 22459 raft_consensus.cc:697] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:36.640741 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.641505 22459 consensus_queue.cc:237] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:36.646602 22080 leader_election.cc:343] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.647146 22080 leader_election.cc:304] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.648888 22418 raft_consensus.cc:2749] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.658207 22386 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.659049 22386 ts_tablet_manager.cc:1403] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.036s
I20260709 13:09:36.662729 22500 consensus_queue.cc:1048] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.665056 22386 raft_consensus.cc:359] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.666194 22386 raft_consensus.cc:385] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.666828 22386 raft_consensus.cc:740] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.667981 22386 consensus_queue.cc:260] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.670461 22388 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:36.676380 22386 ts_tablet_manager.cc:1434] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:09:36.681774 22011 catalog_manager.cc:5697] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.688910 22388 tablet_bootstrap.cc:654] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.690752 22386 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.698046 22397 raft_consensus.cc:493] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.700810 22397 raft_consensus.cc:515] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.703317 22397 leader_election.cc:290] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.703922 22387 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.704511 22387 ts_tablet_manager.cc:1403] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.025s
I20260709 13:09:36.707409 22387 raft_consensus.cc:359] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.709020 22387 raft_consensus.cc:385] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.709223 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.709436 22387 raft_consensus.cc:740] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.710436 22387 consensus_queue.cc:260] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:36.711606 22305 leader_election.cc:343] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.707789 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.712468 22190 raft_consensus.cc:2468] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:36.714380 22387 ts_tablet_manager.cc:1434] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:36.715637 22387 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.715277 22306 leader_election.cc:304] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.717450 22397 raft_consensus.cc:2804] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.717845 22397 raft_consensus.cc:493] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.718225 22397 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.720258 22385 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:36.720958 22385 ts_tablet_manager.cc:1403] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.241s	user 0.028s	sys 0.031s
I20260709 13:09:36.723548 22386 tablet_bootstrap.cc:654] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.725283 22385 raft_consensus.cc:359] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.726996 22385 raft_consensus.cc:385] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.730821 22385 raft_consensus.cc:740] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.733758 22385 consensus_queue.cc:260] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.735906 22385 ts_tablet_manager.cc:1434] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:36.736562 22454 raft_consensus.cc:493] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.736949 22385 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.740590 22387 tablet_bootstrap.cc:654] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.737699 22454 raft_consensus.cc:515] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.736445 22397 raft_consensus.cc:515] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.743353 22454 leader_election.cc:290] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.747079 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.748769 22397 leader_election.cc:290] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.750448 22385 tablet_bootstrap.cc:654] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.751123 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:36.751854 22190 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.751211 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.752965 22265 raft_consensus.cc:2393] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:36.755259 22306 leader_election.cc:304] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.755722 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
W20260709 13:09:36.759959 22305 leader_election.cc:343] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.763824 22454 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.764137 22386 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.764827 22386 ts_tablet_manager.cc:1403] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.002s
I20260709 13:09:36.767640 22386 raft_consensus.cc:359] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.768380 22386 raft_consensus.cc:385] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.768705 22386 raft_consensus.cc:740] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.769495 22386 consensus_queue.cc:260] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.771854 22386 ts_tablet_manager.cc:1434] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:36.772929 22386 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.779126 22386 tablet_bootstrap.cc:654] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.794483 22386 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:36.799522 22387 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.800284 22387 ts_tablet_manager.cc:1403] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.014s
I20260709 13:09:36.807964 22460 consensus_queue.cc:1048] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.809535 22386 ts_tablet_manager.cc:1403] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.004s
I20260709 13:09:36.810253 22420 consensus_queue.cc:1048] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.813190 22388 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.813673 22388 ts_tablet_manager.cc:1403] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.009s
I20260709 13:09:36.813266 22386 raft_consensus.cc:359] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.814018 22386 raft_consensus.cc:385] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.814576 22386 raft_consensus.cc:740] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.814754 22387 raft_consensus.cc:359] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.815459 22387 raft_consensus.cc:385] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.815809 22387 raft_consensus.cc:740] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.815397 22386 consensus_queue.cc:260] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.816004 22388 raft_consensus.cc:359] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.816720 22388 raft_consensus.cc:385] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.816562 22387 consensus_queue.cc:260] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.817000 22388 raft_consensus.cc:740] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.818058 22386 ts_tablet_manager.cc:1434] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:36.818562 22387 ts_tablet_manager.cc:1434] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:09:36.819991 22387 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.819356 22388 consensus_queue.cc:260] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.826512 22387 tablet_bootstrap.cc:654] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.827539 22388 ts_tablet_manager.cc:1434] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:09:36.828554 22388 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:36.788880 22190 raft_consensus.cc:2468] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:36.833006 22394 raft_consensus.cc:493] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.833506 22192 raft_consensus.cc:3060] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.833753 22394 raft_consensus.cc:515] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.840456 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.841454 22339 raft_consensus.cc:2468] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:36.845455 22388 tablet_bootstrap.cc:654] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.845712 22418 raft_consensus.cc:493] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.851918 22386 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:36.860174 22387 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.860939 22387 ts_tablet_manager.cc:1403] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.020s
I20260709 13:09:36.861892 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.863061 22306 leader_election.cc:304] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
W20260709 13:09:36.863564 22232 leader_election.cc:343] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.864477 22387 raft_consensus.cc:359] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.864835 22229 leader_election.cc:304] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:36.865260 22387 raft_consensus.cc:385] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.865552 22387 raft_consensus.cc:740] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.866555 22487 raft_consensus.cc:2804] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.866353 22387 consensus_queue.cc:260] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.851905 22418 raft_consensus.cc:515] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.867002 22487 raft_consensus.cc:493] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.867383 22487 raft_consensus.cc:3060] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.868683 22418 leader_election.cc:290] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.868853 22387 ts_tablet_manager.cc:1434] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:36.847635 22394 leader_election.cc:290] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.869259 22397 raft_consensus.cc:2804] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.869989 22387 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:36.870769 22385 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:36.871263 22385 ts_tablet_manager.cc:1403] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.135s	user 0.007s	sys 0.026s
I20260709 13:09:36.872788 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.869810 22397 raft_consensus.cc:697] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:36.874884 22397 consensus_queue.cc:237] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.876561 22387 tablet_bootstrap.cc:654] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:36.879235 22082 leader_election.cc:343] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.881227 22385 raft_consensus.cc:359] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.881925 22385 raft_consensus.cc:385] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.882217 22385 raft_consensus.cc:740] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.883241 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.882915 22385 consensus_queue.cc:260] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:36.884776 22080 leader_election.cc:343] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.885224 22080 leader_election.cc:304] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.885545 22385 ts_tablet_manager.cc:1434] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
W20260709 13:09:36.887310 22229 consensus_peers.cc:597] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb -> Peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Couldn't send request to peer 3f0e42f9dab447d5bc309baaacba2ee7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.888692 22418 raft_consensus.cc:2749] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.876608 22454 raft_consensus.cc:2749] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.903460 22486 consensus_queue.cc:1048] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.891439 22385 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:36.922632 22487 raft_consensus.cc:515] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.931790 22387 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:36.954598 22387 ts_tablet_manager.cc:1403] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.009s
I20260709 13:09:36.956938 22487 leader_election.cc:290] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.949688 22452 raft_consensus.cc:493] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.973258 22452 raft_consensus.cc:515] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:36.976096 22452 leader_election.cc:290] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:36.957460 22387 raft_consensus.cc:359] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.976763 22387 raft_consensus.cc:385] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.977093 22387 raft_consensus.cc:740] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.958257 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:36.958906 22460 raft_consensus.cc:493] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1c2f73661f4fd28f53d294057790cb)
I20260709 13:09:36.977871 22387 consensus_queue.cc:260] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.978329 22460 raft_consensus.cc:515] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:36.979980 22387 ts_tablet_manager.cc:1434] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:09:36.961390 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:36.980698 22338 raft_consensus.cc:3060] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.981014 22387 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
W20260709 13:09:36.982898 22232 leader_election.cc:343] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.982821 22013 catalog_manager.cc:5697] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.983875 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.984519 22116 raft_consensus.cc:2468] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:36.986307 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:36.945622 22420 raft_consensus.cc:493] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.987376 22387 tablet_bootstrap.cc:654] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.987242 22420 raft_consensus.cc:515] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:36.989091 22460 leader_election.cc:290] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:36.989435 22420 leader_election.cc:290] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:36.990247 22388 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:36.990376 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37090b927d224c0d902fc48f6b211e37" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:36.990862 22388 ts_tablet_manager.cc:1403] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.010s
I20260709 13:09:36.991182 22306 leader_election.cc:304] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:36.992311 22452 raft_consensus.cc:2804] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.992810 22452 raft_consensus.cc:493] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.993239 22452 raft_consensus.cc:3060] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.993827 22157 leader_election.cc:304] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:36.994756 22388 raft_consensus.cc:359] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.991268 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:36.998247 22388 raft_consensus.cc:385] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.998626 22388 raft_consensus.cc:740] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.999310 22388 consensus_queue.cc:260] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:36.970983 22385 tablet_bootstrap.cc:654] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.003381 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:36.995591 22460 raft_consensus.cc:2749] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.004065 22192 raft_consensus.cc:2468] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:37.005344 22232 leader_election.cc:304] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:37.001753 22388 ts_tablet_manager.cc:1434] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:09:37.006645 22420 raft_consensus.cc:2804] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.007087 22388 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.007031 22420 raft_consensus.cc:493] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.007573 22420 raft_consensus.cc:3060] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:37.010892 22229 leader_election.cc:343] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.976912 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.012476 22264 raft_consensus.cc:2468] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:36.962978 22386 tablet_bootstrap.cc:654] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.024289 22385 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.024657 22387 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.024730 22385 ts_tablet_manager.cc:1403] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.012s
I20260709 13:09:37.025421 22387 ts_tablet_manager.cc:1403] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.010s
I20260709 13:09:37.027660 22385 raft_consensus.cc:359] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.028442 22385 raft_consensus.cc:385] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.028818 22385 raft_consensus.cc:740] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.028220 22387 raft_consensus.cc:359] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.030108 22387 raft_consensus.cc:385] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.029807 22385 consensus_queue.cc:260] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.030543 22387 raft_consensus.cc:740] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.031540 22387 consensus_queue.cc:260] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.032559 22385 ts_tablet_manager.cc:1434] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:37.034137 22385 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.035583 22387 ts_tablet_manager.cc:1434] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:37.036840 22387 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:37.041121 22388 tablet_bootstrap.cc:654] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.041723 22385 tablet_bootstrap.cc:654] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.044965 22387 tablet_bootstrap.cc:654] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.044538 22420 raft_consensus.cc:515] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.048195 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:37.049783 22229 leader_election.cc:343] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.051452 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:37.052070 22192 raft_consensus.cc:3060] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.054186 22338 raft_consensus.cc:2468] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:37.058179 22460 raft_consensus.cc:493] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.058873 22460 raft_consensus.cc:515] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.058995 22452 raft_consensus.cc:515] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.061018 22460 leader_election.cc:290] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.061707 22452 leader_election.cc:290] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.070914 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:37.071832 22385 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.072316 22385 ts_tablet_manager.cc:1403] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
W20260709 13:09:37.072530 22158 leader_election.cc:343] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.075181 22385 raft_consensus.cc:359] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.075855 22385 raft_consensus.cc:385] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.076128 22385 raft_consensus.cc:740] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.076606 22388 tablet_bootstrap.cc:492] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:37.077131 22388 ts_tablet_manager.cc:1403] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.007s
I20260709 13:09:37.079862 22476 consensus_queue.cc:1048] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.083711 22387 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.076756 22385 consensus_queue.cc:260] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.084225 22387 ts_tablet_manager.cc:1403] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.005s
I20260709 13:09:37.084349 22386 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:37.080298 22388 raft_consensus.cc:359] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.085625 22386 ts_tablet_manager.cc:1403] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.254s	user 0.013s	sys 0.001s
I20260709 13:09:37.086791 22388 raft_consensus.cc:385] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.087412 22388 raft_consensus.cc:740] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.086319 22385 ts_tablet_manager.cc:1434] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:09:37.091392 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.091809 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:37.092130 22338 raft_consensus.cc:2468] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:37.092401 22116 raft_consensus.cc:3060] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.093719 22155 leader_election.cc:304] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:37.095322 22460 raft_consensus.cc:2804] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.095809 22460 raft_consensus.cc:493] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.096223 22460 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.096580 22386 raft_consensus.cc:359] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.087518 22387 raft_consensus.cc:359] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.097565 22387 raft_consensus.cc:385] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.097847 22387 raft_consensus.cc:740] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.098516 22387 consensus_queue.cc:260] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.099305 22229 leader_election.cc:304] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:37.096371 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c2509cc82419a9564c2a7282f0f71" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:37.100467 22266 raft_consensus.cc:3060] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.100787 22385 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.103072 22476 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.103528 22476 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.104779 22460 raft_consensus.cc:515] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.105690 22476 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.106786 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.100052 22387 ts_tablet_manager.cc:1434] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:37.107272 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.105959 22487 raft_consensus.cc:2804] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.108922 22190 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:37.109433 22387 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:37.097224 22386 raft_consensus.cc:385] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.109965 22386 raft_consensus.cc:740] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.089516 22388 consensus_queue.cc:260] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:37.117518 22082 leader_election.cc:343] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.089020 22420 leader_election.cc:290] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:37.122896 22388 ts_tablet_manager.cc:1434] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:09:37.124266 22192 raft_consensus.cc:2468] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:37.124550 22388 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.125082 22386 consensus_queue.cc:260] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.126340 22083 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.127509 22386 ts_tablet_manager.cc:1434] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:09:37.128636 22386 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:37.128657 22190 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.130084 22418 raft_consensus.cc:2804] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.130534 22418 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.130879 22418 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.134508 22232 leader_election.cc:304] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:37.135742 22116 raft_consensus.cc:2468] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:37.137080 22306 leader_election.cc:304] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:37.134545 22266 raft_consensus.cc:2468] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:37.138191 22452 raft_consensus.cc:2804] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.138734 22452 raft_consensus.cc:697] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:37.139611 22452 consensus_queue.cc:237] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.140169 22394 raft_consensus.cc:2804] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.140514 22420 raft_consensus.cc:493] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.140666 22394 raft_consensus.cc:697] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:37.150849 22487 raft_consensus.cc:697] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:37.151899 22394 consensus_queue.cc:237] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.154837 22487 consensus_queue.cc:237] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.156461 22385 tablet_bootstrap.cc:654] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.172992 22486 raft_consensus.cc:493] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.173563 22486 raft_consensus.cc:515] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.152244 22420 raft_consensus.cc:515] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.175832 22486 leader_election.cc:290] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.176499 22420 leader_election.cc:290] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:37.177989 22460 leader_election.cc:290] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.179020 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:37.181668 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:37.182137 22339 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.173846 22387 tablet_bootstrap.cc:654] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.180025 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.185272 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:37.184908 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.191370 22459 consensus_queue.cc:1048] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:37.193114 22552 raft_consensus.cc:493] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.193264 22388 tablet_bootstrap.cc:654] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:37.192821 22232 leader_election.cc:343] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.179358 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.193694 22552 raft_consensus.cc:515] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:37.200028 22229 leader_election.cc:343] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.193899 22158 leader_election.cc:343] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.184883 22418 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.207973 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.210659 22158 leader_election.cc:304] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.211843 22460 raft_consensus.cc:2749] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:37.217202 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:37.202891 22552 leader_election.cc:290] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.218343 22460 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.224466 22386 tablet_bootstrap.cc:654] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.226366 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:37.226545 22080 leader_election.cc:343] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.224119 22460 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:37.227893 22083 leader_election.cc:343] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.228353 22083 leader_election.cc:304] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:37.229295 22460 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.209071 22229 leader_election.cc:304] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:37.231772 22012 catalog_manager.cc:5697] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.233933 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:37.235352 22158 leader_election.cc:343] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.237234 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:37.239396 22155 leader_election.cc:343] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.239956 22155 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:37.240886 22486 raft_consensus.cc:2749] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.243445 22418 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.244359 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:37.245471 22192 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.254386 22386 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:37.254940 22386 ts_tablet_manager.cc:1403] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.001s
I20260709 13:09:37.255604 22385 tablet_bootstrap.cc:492] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.256122 22385 ts_tablet_manager.cc:1403] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.156s	user 0.017s	sys 0.001s
I20260709 13:09:37.257730 22386 raft_consensus.cc:359] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.258428 22386 raft_consensus.cc:385] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.258697 22386 raft_consensus.cc:740] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.259209 22385 raft_consensus.cc:359] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.259858 22385 raft_consensus.cc:385] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.259503 22386 consensus_queue.cc:260] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.260228 22385 raft_consensus.cc:740] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.236063 22552 raft_consensus.cc:2749] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.270349 22385 consensus_queue.cc:260] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.270911 22386 ts_tablet_manager.cc:1434] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:37.249153 22394 raft_consensus.cc:2749] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:37.272874 22229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 72355.7us
I20260709 13:09:37.284381 22397 consensus_queue.cc:1048] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.285614 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
W20260709 13:09:37.287735 22082 leader_election.cc:343] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.289321 22387 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.289609 22397 raft_consensus.cc:493] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.289822 22387 ts_tablet_manager.cc:1403] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.000s
I20260709 13:09:37.290153 22397 raft_consensus.cc:515] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.278486 22386 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:37.287655 22388 tablet_bootstrap.cc:492] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:37.291580 22388 ts_tablet_manager.cc:1403] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.004s
I20260709 13:09:37.293242 22385 ts_tablet_manager.cc:1434] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.011s
I20260709 13:09:37.291456 22192 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:37.296105 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.300495 22397 leader_election.cc:290] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.305429 22394 raft_consensus.cc:493] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.306965 22394 raft_consensus.cc:515] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.309214 22460 raft_consensus.cc:493] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.309839 22394 leader_election.cc:290] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.309736 22460 raft_consensus.cc:515] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.306310 22083 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.304499 22388 raft_consensus.cc:359] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.311473 22388 raft_consensus.cc:385] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.311811 22388 raft_consensus.cc:740] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.307430 22387 raft_consensus.cc:359] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.305513 22013 catalog_manager.cc:5697] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.312469 22387 raft_consensus.cc:385] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.312777 22387 raft_consensus.cc:740] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.313418 22387 consensus_queue.cc:260] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.314230 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:37.314850 22460 leader_election.cc:290] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:37.314981 22116 raft_consensus.cc:2468] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:37.316306 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:37.317919 22157 leader_election.cc:343] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.318655 22339 raft_consensus.cc:2468] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:37.317934 22386 tablet_bootstrap.cc:654] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.312901 22552 raft_consensus.cc:2804] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.320034 22552 raft_consensus.cc:697] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:37.321064 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.320907 22552 consensus_queue.cc:237] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.322414 22013 catalog_manager.cc:5697] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.324561 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.301004 22418 raft_consensus.cc:493] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.326586 22385 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.326116 22388 consensus_queue.cc:260] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.328397 22387 ts_tablet_manager.cc:1434] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:09:37.328150 22155 leader_election.cc:304] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:37.329514 22460 raft_consensus.cc:2804] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.329978 22460 raft_consensus.cc:697] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:37.330873 22460 consensus_queue.cc:237] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.319264 22232 leader_election.cc:304] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
W20260709 13:09:37.329965 22155 leader_election.cc:343] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.333746 22155 leader_election.cc:304] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
W20260709 13:09:37.333798 22229 leader_election.cc:343] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.333806 22420 raft_consensus.cc:2804] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.333264 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ead399c25f4fba981e4ae8dc56595d" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.334592 22420 raft_consensus.cc:493] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.335253 22420 raft_consensus.cc:3060] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.335450 22190 raft_consensus.cc:2393] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:37.336469 22486 raft_consensus.cc:2749] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.346913 22388 ts_tablet_manager.cc:1434] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.055s	user 0.002s	sys 0.005s
I20260709 13:09:37.347909 22387 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:37.357188 22388 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.361111 22420 raft_consensus.cc:515] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.344894 22418 raft_consensus.cc:515] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.354446 22397 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.371730 22388 tablet_bootstrap.cc:654] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.369127 22397 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.380198 22397 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.370620 22306 leader_election.cc:304] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.387929 22397 raft_consensus.cc:3060] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.387707 22013 catalog_manager.cc:5697] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.390950 22418 leader_election.cc:290] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.392168 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:37.393846 22082 leader_election.cc:343] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.397562 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.399394 22386 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:37.406385 22386 ts_tablet_manager.cc:1403] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.010s
I20260709 13:09:37.406863 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.409314 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:37.411394 22083 leader_election.cc:343] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.407099 22385 tablet_bootstrap.cc:654] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.409344 22386 raft_consensus.cc:359] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.413914 22386 raft_consensus.cc:385] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.414279 22386 raft_consensus.cc:740] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.418076 22083 leader_election.cc:304] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.422821 22338 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.423956 22397 raft_consensus.cc:2749] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.393245 22010 catalog_manager.cc:5697] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.428038 22264 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.430115 22420 leader_election.cc:290] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.415143 22386 consensus_queue.cc:260] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.435669 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:37.437373 22229 leader_election.cc:343] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.443164 22387 tablet_bootstrap.cc:654] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.432119 22418 raft_consensus.cc:2749] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.463757 22386 ts_tablet_manager.cc:1434] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:09:37.471608 22388 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:37.472105 22388 ts_tablet_manager.cc:1403] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.117s	user 0.030s	sys 0.023s
I20260709 13:09:37.462702 22552 raft_consensus.cc:493] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.476543 22386 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:37.466230 22306 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:37.483453 22385 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.483880 22385 ts_tablet_manager.cc:1403] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.008s
I20260709 13:09:37.482445 22418 raft_consensus.cc:493] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.484323 22567 raft_consensus.cc:2749] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.481653 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:37.475806 22552 raft_consensus.cc:515] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.507081 22552 leader_election.cc:290] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.494587 22116 raft_consensus.cc:3060] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.510854 22394 raft_consensus.cc:493] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.511399 22394 raft_consensus.cc:515] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.512056 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.513091 22394 leader_election.cc:290] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:37.514235 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.487396 22418 raft_consensus.cc:515] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.516269 22418 leader_election.cc:290] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:37.503481 22567 consensus_queue.cc:1048] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:09:37.518008 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.519904 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.520006 22388 raft_consensus.cc:359] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.520887 22388 raft_consensus.cc:385] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.521164 22388 raft_consensus.cc:740] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.521648 22232 leader_election.cc:304] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:37.521826 22388 consensus_queue.cc:260] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.536638 22388 ts_tablet_manager.cc:1434] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:09:37.539563 22388 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.546772 22385 raft_consensus.cc:359] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.547454 22385 raft_consensus.cc:385] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.547652 22385 raft_consensus.cc:740] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.534638 22116 raft_consensus.cc:2468] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:37.557476 22385 consensus_queue.cc:260] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.567118 22232 leader_election.cc:304] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:37.567718 22386 tablet_bootstrap.cc:654] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.567950 22394 raft_consensus.cc:2804] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.568428 22388 tablet_bootstrap.cc:654] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.588966 22387 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.589641 22387 ts_tablet_manager.cc:1403] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.260s	user 0.028s	sys 0.018s
I20260709 13:09:37.591013 22385 ts_tablet_manager.cc:1434] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.001s
I20260709 13:09:37.568482 22394 raft_consensus.cc:697] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:37.598356 22385 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.593132 22420 raft_consensus.cc:2749] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.605700 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.607554 22339 raft_consensus.cc:2393] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:37.598464 22567 consensus_queue.cc:1048] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:37.609616 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75599b9dde5f4db2bd81f1872e371761" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:37.610307 22394 consensus_queue.cc:237] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.610692 22339 raft_consensus.cc:2393] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:37.622985 22567 raft_consensus.cc:493] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.623566 22567 raft_consensus.cc:515] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.625844 22567 leader_election.cc:290] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.629422 22487 consensus_queue.cc:1048] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.631100 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.631246 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.631847 22190 raft_consensus.cc:2468] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:37.632169 22266 raft_consensus.cc:2468] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:37.633522 22306 leader_election.cc:304] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:37.634482 22567 raft_consensus.cc:2804] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.635273 22567 raft_consensus.cc:493] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.641671 22567 raft_consensus.cc:3060] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.645200 22386 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:37.635325 22013 catalog_manager.cc:5697] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.645737 22386 ts_tablet_manager.cc:1403] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.174s	user 0.022s	sys 0.013s
I20260709 13:09:37.640345 22387 raft_consensus.cc:359] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.646203 22387 raft_consensus.cc:385] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.646488 22387 raft_consensus.cc:740] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.637892 22385 tablet_bootstrap.cc:654] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.650513 22080 leader_election.cc:304] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:37.651365 22387 consensus_queue.cc:260] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.651831 22080 leader_election.cc:304] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.655303 22387 ts_tablet_manager.cc:1434] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.002s
I20260709 13:09:37.656337 22387 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:37.660655 22418 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.670256 22571 raft_consensus.cc:3060] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.671340 22386 raft_consensus.cc:359] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.672068 22386 raft_consensus.cc:385] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.672341 22386 raft_consensus.cc:740] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.672981 22386 consensus_queue.cc:260] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.676180 22386 ts_tablet_manager.cc:1434] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 13:09:37.677209 22386 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:37.677279 22387 tablet_bootstrap.cc:654] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.677443 22418 raft_consensus.cc:2749] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.684966 22386 tablet_bootstrap.cc:654] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.693082 22385 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.693687 22385 ts_tablet_manager.cc:1403] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.003s
I20260709 13:09:37.685326 22394 consensus_queue.cc:1048] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:37.697420 22394 consensus_queue.cc:1048] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.701297 22385 raft_consensus.cc:359] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.702104 22385 raft_consensus.cc:385] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.702337 22385 raft_consensus.cc:740] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.703118 22385 consensus_queue.cc:260] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.712092 22454 consensus_queue.cc:1048] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.713850 22418 raft_consensus.cc:493] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.717383 22418 raft_consensus.cc:515] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.719537 22418 leader_election.cc:290] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.720681 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:37.722237 22385 ts_tablet_manager.cc:1434] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
W20260709 13:09:37.722177 22082 leader_election.cc:343] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.722836 22388 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:37.723340 22388 ts_tablet_manager.cc:1403] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.008s
I20260709 13:09:37.724792 22567 raft_consensus.cc:515] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.727386 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:37.732684 22083 leader_election.cc:343] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.733199 22083 leader_election.cc:304] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:37.736078 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:37.736747 22192 raft_consensus.cc:3060] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.738087 22552 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.738597 22552 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.741173 22556 raft_consensus.cc:2749] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.740753 22552 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.741834 22385 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.743129 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.743793 22191 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:37.744495 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:37.745999 22080 leader_election.cc:343] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.750902 22388 raft_consensus.cc:359] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.752565 22388 raft_consensus.cc:385] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.752938 22388 raft_consensus.cc:740] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.752321 22083 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:37.753633 22388 consensus_queue.cc:260] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.760586 22385 tablet_bootstrap.cc:654] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.765522 22388 ts_tablet_manager.cc:1434] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:09:37.762707 22418 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.764784 22567 leader_election.cc:290] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:37.784806 22388 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.776412 22571 raft_consensus.cc:2749] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.776757 22418 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.788303 22387 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.788795 22387 ts_tablet_manager.cc:1403] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.035s
I20260709 13:09:37.787487 22418 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.790791 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0585d90c03430d88a8fee355e3944b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:37.802527 22266 raft_consensus.cc:3060] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.795269 22264 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.797690 22388 tablet_bootstrap.cc:654] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.810691 22192 raft_consensus.cc:2468] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:37.812458 22306 leader_election.cc:304] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:37.813433 22568 raft_consensus.cc:2804] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.814013 22568 raft_consensus.cc:697] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:37.815153 22568 consensus_queue.cc:237] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:37.816278 22420 consensus_queue.cc:1048] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.818368 22386 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:37.818928 22386 ts_tablet_manager.cc:1403] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.142s	user 0.024s	sys 0.004s
I20260709 13:09:37.822281 22266 raft_consensus.cc:2468] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:37.824383 22387 raft_consensus.cc:359] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.826843 22387 raft_consensus.cc:385] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.827147 22387 raft_consensus.cc:740] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.821889 22386 raft_consensus.cc:359] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.827569 22386 raft_consensus.cc:385] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.821672 22418 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.827847 22387 consensus_queue.cc:260] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.828375 22556 consensus_queue.cc:1048] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.829735 22418 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.827885 22386 raft_consensus.cc:740] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.831056 22387 ts_tablet_manager.cc:1434] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:09:37.832355 22386 consensus_queue.cc:260] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.836863 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:37.837635 22192 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.838310 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:37.840230 22080 leader_election.cc:343] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.842403 22577 log.cc:927] Time spent T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: Append to log took a long time: real 0.066s	user 0.004s	sys 0.000s
I20260709 13:09:37.856745 22386 ts_tablet_manager.cc:1434] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:37.859680 22387 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:37.865705 22385 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:37.869419 22385 ts_tablet_manager.cc:1403] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.002s
I20260709 13:09:37.871785 22387 tablet_bootstrap.cc:654] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.872303 22388 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:37.872805 22388 ts_tablet_manager.cc:1403] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.013s
I20260709 13:09:37.873220 22486 consensus_queue.cc:1048] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.875448 22388 raft_consensus.cc:359] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.876158 22388 raft_consensus.cc:385] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.876420 22388 raft_consensus.cc:740] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.877081 22192 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:37.877343 22388 consensus_queue.cc:260] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.877874 22385 raft_consensus.cc:359] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.878806 22385 raft_consensus.cc:385] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.879112 22385 raft_consensus.cc:740] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.879390 22083 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:37.879956 22385 consensus_queue.cc:260] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.880575 22571 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.881116 22571 raft_consensus.cc:697] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:37.882498 22385 ts_tablet_manager.cc:1434] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:09:37.884060 22385 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:37.881996 22571 consensus_queue.cc:237] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.892592 22388 ts_tablet_manager.cc:1434] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:09:37.896906 22388 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:37.900863 22556 consensus_queue.cc:1048] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.904062 22388 tablet_bootstrap.cc:654] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.905936 22013 catalog_manager.cc:5697] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.906754 22386 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:37.912107 22486 consensus_queue.cc:1048] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.930804 22386 tablet_bootstrap.cc:654] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.951299 22387 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:37.951829 22387 ts_tablet_manager.cc:1403] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.005s
I20260709 13:09:37.946393 22568 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.962325 22397 raft_consensus.cc:493] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.968376 22568 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:37.968603 22397 raft_consensus.cc:515] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.970502 22568 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:37.974817 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:37.975705 22191 raft_consensus.cc:2393] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:37.978117 22567 raft_consensus.cc:493] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.978590 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:37.978685 22567 raft_consensus.cc:515] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:37.981208 22567 leader_election.cc:290] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.991600 22387 raft_consensus.cc:359] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:37.992887 22387 raft_consensus.cc:385] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.994688 22397 leader_election.cc:290] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:37.995733 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:37.996423 22116 raft_consensus.cc:2468] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:37.993321 22387 raft_consensus.cc:740] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.998764 22385 tablet_bootstrap.cc:654] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.013293 22306 leader_election.cc:304] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:38.013440 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.019001 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.019407 22306 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:38.021224 22568 raft_consensus.cc:2804] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.022600 22454 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.021732 22568 raft_consensus.cc:493] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.025095 22568 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:38.028486 22305 leader_election.cc:343] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.033417 22460 raft_consensus.cc:493] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.034267 22388 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:38.033965 22460 raft_consensus.cc:515] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.034762 22388 ts_tablet_manager.cc:1403] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.025s
I20260709 13:09:38.036093 22460 leader_election.cc:290] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.037418 22388 raft_consensus.cc:359] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:38.037685 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.038134 22388 raft_consensus.cc:385] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.038443 22388 raft_consensus.cc:740] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.038473 22264 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.039251 22388 consensus_queue.cc:260] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:38.039983 22157 leader_election.cc:304] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:38.041265 22568 raft_consensus.cc:515] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.041760 22486 raft_consensus.cc:2804] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.042954 22486 raft_consensus.cc:493] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.043313 22486 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.043797 22388 ts_tablet_manager.cc:1434] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:38.042150 22454 raft_consensus.cc:2749] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.046469 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2635674412cd401c9431a779ae71dcee" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.046663 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.046947 22388 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:38.047317 22117 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.052139 22339 raft_consensus.cc:3060] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.054097 22486 raft_consensus.cc:515] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.054857 22387 consensus_queue.cc:260] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.058604 22387 ts_tablet_manager.cc:1434] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.002s
I20260709 13:09:38.056388 22305 leader_election.cc:304] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:38.060861 22387 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:38.060608 22394 consensus_queue.cc:1048] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.061022 22388 tablet_bootstrap.cc:654] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.067499 22486 leader_election.cc:290] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.070417 22568 leader_election.cc:290] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.071424 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:38.072095 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:38.072265 22115 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.072715 22116 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.080520 22116 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:38.090217 22158 leader_election.cc:304] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.095633 22385 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:38.096271 22385 ts_tablet_manager.cc:1403] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.000s
I20260709 13:09:38.096345 22115 raft_consensus.cc:2468] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:38.082952 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:38.083832 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
W20260709 13:09:38.087706 22229 consensus_peers.cc:597] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb -> Peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Couldn't send request to peer 3f0e42f9dab447d5bc309baaacba2ee7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.098153 22265 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:38.098917 22305 leader_election.cc:343] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.081571 22387 tablet_bootstrap.cc:654] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.081645 22388 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:38.099462 22385 raft_consensus.cc:359] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.100008 22388 ts_tablet_manager.cc:1403] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.001s
I20260709 13:09:38.100184 22385 raft_consensus.cc:385] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.100533 22385 raft_consensus.cc:740] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.103642 22388 raft_consensus.cc:359] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.105402 22388 raft_consensus.cc:385] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.105762 22388 raft_consensus.cc:740] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.106863 22388 consensus_queue.cc:260] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.108801 22386 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:38.109287 22386 ts_tablet_manager.cc:1403] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.203s	user 0.013s	sys 0.005s
I20260709 13:09:38.109095 22306 leader_election.cc:304] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:38.109525 22388 ts_tablet_manager.cc:1434] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:38.110498 22568 raft_consensus.cc:2804] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.110877 22388 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:38.111325 22568 raft_consensus.cc:697] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:38.114179 22568 consensus_queue.cc:237] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.115584 22012 catalog_manager.cc:5697] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.118316 22385 consensus_queue.cc:260] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.119361 22387 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:38.121058 22387 ts_tablet_manager.cc:1403] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.001s
I20260709 13:09:38.121887 22385 ts_tablet_manager.cc:1434] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:09:38.125391 22388 tablet_bootstrap.cc:654] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.126430 22385 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:38.107331 22265 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:38.113029 22386 raft_consensus.cc:359] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.127242 22386 raft_consensus.cc:385] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.127557 22386 raft_consensus.cc:740] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.128356 22386 consensus_queue.cc:260] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.131078 22386 ts_tablet_manager.cc:1434] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:09:38.123828 22387 raft_consensus.cc:359] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.133716 22387 raft_consensus.cc:385] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.135039 22387 raft_consensus.cc:740] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.136029 22386 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:38.148487 22567 raft_consensus.cc:2749] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.152918 22385 tablet_bootstrap.cc:654] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.155483 22386 tablet_bootstrap.cc:654] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.157735 22387 consensus_queue.cc:260] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.160195 22604 raft_consensus.cc:2804] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.191674 22603 raft_consensus.cc:493] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.200103 22487 raft_consensus.cc:493] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.206467 22487 raft_consensus.cc:515] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.209265 22487 leader_election.cc:290] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:38.209955 22604 raft_consensus.cc:697] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:38.211364 22604 consensus_queue.cc:237] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.438426 22397 raft_consensus.cc:493] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.439044 22397 raft_consensus.cc:515] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:38.441517 22387 ts_tablet_manager.cc:1434] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.320s	user 0.055s	sys 0.124s
I20260709 13:09:38.442690 22387 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:38.408747 22552 raft_consensus.cc:493] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.447907 22552 raft_consensus.cc:515] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.449018 22387 tablet_bootstrap.cc:654] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.456756 22397 leader_election.cc:290] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.458041 22388 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:38.458663 22388 ts_tablet_manager.cc:1403] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.348s	user 0.036s	sys 0.130s
I20260709 13:09:38.459592 22386 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:38.460175 22386 ts_tablet_manager.cc:1403] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.328s	user 0.039s	sys 0.026s
I20260709 13:09:38.462990 22388 raft_consensus.cc:359] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.463526 22388 raft_consensus.cc:385] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.463721 22388 raft_consensus.cc:740] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.464229 22388 consensus_queue.cc:260] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.221639 22603 raft_consensus.cc:515] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.467718 22385 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:38.468158 22385 ts_tablet_manager.cc:1403] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.342s	user 0.011s	sys 0.015s
I20260709 13:09:38.461670 22552 leader_election.cc:290] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:38.473235 22388 ts_tablet_manager.cc:1434] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:09:38.494962 22388 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
W20260709 13:09:38.165131 22155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 73617.2us
I20260709 13:09:38.501744 22388 tablet_bootstrap.cc:654] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.511178 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:38.511562 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:38.512574 22386 raft_consensus.cc:359] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.512012 22339 raft_consensus.cc:2468] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.513196 22386 raft_consensus.cc:385] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.514302 22386 raft_consensus.cc:740] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
W20260709 13:09:38.516371 22080 leader_election.cc:343] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.520736 22387 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:38.521332 22387 ts_tablet_manager.cc:1403] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.036s
I20260709 13:09:38.521701 22385 raft_consensus.cc:359] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.526255 22385 raft_consensus.cc:385] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.526678 22385 raft_consensus.cc:740] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.527508 22385 consensus_queue.cc:260] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.526342 22386 consensus_queue.cc:260] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.526474 22155 leader_election.cc:304] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.529506 22601 raft_consensus.cc:2804] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.524540 22387 raft_consensus.cc:359] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.529902 22601 raft_consensus.cc:493] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.530117 22387 raft_consensus.cc:385] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.530365 22601 raft_consensus.cc:3060] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.530535 22387 raft_consensus.cc:740] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.531148 22385 ts_tablet_manager.cc:1434] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:09:38.531297 22387 consensus_queue.cc:260] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.532168 22603 leader_election.cc:290] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.537906 22385 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:38.538465 22387 ts_tablet_manager.cc:1434] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:09:38.539453 22387 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:38.529913 22386 ts_tablet_manager.cc:1434] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 13:09:38.540813 22386 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:38.544234 22385 tablet_bootstrap.cc:654] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.538935 22601 raft_consensus.cc:515] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.556321 22601 leader_election.cc:290] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.546347 22387 tablet_bootstrap.cc:654] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.557130 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:38.557883 22339 raft_consensus.cc:3060] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.571445 22568 raft_consensus.cc:493] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.572315 22568 raft_consensus.cc:515] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.578830 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:38.547823 22386 tablet_bootstrap.cc:654] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.548696 22388 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:38.585632 22388 ts_tablet_manager.cc:1403] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.006s
W20260709 13:09:38.628566 22083 leader_election.cc:343] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.629067 22486 raft_consensus.cc:493] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.629199 22083 leader_election.cc:304] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:38.630116 22486 raft_consensus.cc:515] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.631661 22418 raft_consensus.cc:2749] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.635311 22388 raft_consensus.cc:359] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.636049 22388 raft_consensus.cc:385] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.636317 22388 raft_consensus.cc:740] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.646337 22388 consensus_queue.cc:260] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.656985 22388 ts_tablet_manager.cc:1434] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:09:38.664280 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.665086 22113 raft_consensus.cc:2468] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.671515 22388 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:38.670331 22418 raft_consensus.cc:493] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.671249 22486 leader_election.cc:290] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.674058 22340 raft_consensus.cc:3060] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.672833 22418 raft_consensus.cc:515] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.689862 22568 leader_election.cc:290] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.694618 22387 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:38.695040 22387 ts_tablet_manager.cc:1403] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.156s	user 0.042s	sys 0.065s
I20260709 13:09:38.696374 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:38.706758 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:38.708230 22385 tablet_bootstrap.cc:492] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:38.708060 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.708783 22385 ts_tablet_manager.cc:1403] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.021s
I20260709 13:09:38.695935 22552 consensus_queue.cc:1048] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:09:38.709575 22191 raft_consensus.cc:2468] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:38.711756 22385 raft_consensus.cc:359] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:38.712473 22385 raft_consensus.cc:385] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.712734 22385 raft_consensus.cc:740] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.713449 22387 raft_consensus.cc:359] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.713544 22385 consensus_queue.cc:260] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:38.714210 22387 raft_consensus.cc:385] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.714538 22387 raft_consensus.cc:740] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.717020 22418 leader_election.cc:290] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.717353 22388 tablet_bootstrap.cc:654] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.716079 22387 consensus_queue.cc:260] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.718309 22601 raft_consensus.cc:493] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.718815 22601 raft_consensus.cc:515] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.720366 22387 ts_tablet_manager.cc:1434] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:09:38.720917 22601 leader_election.cc:290] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.721400 22387 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
W20260709 13:09:38.722249 22083 leader_election.cc:343] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.723465 22385 ts_tablet_manager.cc:1434] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:38.724613 22385 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:38.727023 22387 tablet_bootstrap.cc:654] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.737560 22385 tablet_bootstrap.cc:654] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.744535 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.745292 22116 raft_consensus.cc:2468] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.746970 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1339f58f4b83447ca1b957607bb81a0e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:38.747635 22337 raft_consensus.cc:2468] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.749135 22158 leader_election.cc:304] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.727612 22339 raft_consensus.cc:2468] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:38.749845 22397 consensus_queue.cc:1048] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.750552 22601 raft_consensus.cc:2804] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.750976 22601 raft_consensus.cc:493] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.751322 22601 raft_consensus.cc:3060] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.752533 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1339f58f4b83447ca1b957607bb81a0e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:38.754235 22158 leader_election.cc:343] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.759307 22601 raft_consensus.cc:515] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.763458 22155 leader_election.cc:304] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:38.766472 22486 raft_consensus.cc:2804] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.766978 22486 raft_consensus.cc:493] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.767377 22486 raft_consensus.cc:3060] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.772063 22306 leader_election.cc:304] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.774101 22454 raft_consensus.cc:2804] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.774289 22155 leader_election.cc:304] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.774618 22454 raft_consensus.cc:493] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.775099 22454 raft_consensus.cc:3060] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.778214 22567 consensus_queue.cc:1048] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.784524 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b0e3fbce6246c6b6701af14d2add23" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:38.785439 22112 raft_consensus.cc:3060] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.794543 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.795368 22116 raft_consensus.cc:2468] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:38.797804 22604 raft_consensus.cc:2804] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.798460 22604 raft_consensus.cc:697] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:38.799319 22604 consensus_queue.cc:237] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.799561 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:38.802486 22189 raft_consensus.cc:2393] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:38.804728 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:38.805406 22114 raft_consensus.cc:3060] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.809157 22112 raft_consensus.cc:2468] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:38.870532 22608 raft_consensus.cc:493] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.871091 22608 raft_consensus.cc:515] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:38.873021 22114 raft_consensus.cc:2468] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:38.874787 22158 leader_election.cc:304] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.875711 22603 raft_consensus.cc:2804] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.876169 22603 raft_consensus.cc:697] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:38.876740 22603 consensus_queue.cc:237] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.881173 22608 leader_election.cc:290] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:38.884914 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 105995us
I20260709 13:09:38.891775 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.892956 22265 raft_consensus.cc:2468] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:38.901850 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b9fff09c6c3456a80ff8246e5641523" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.908128 22265 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.909550 22385 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:38.909677 22232 leader_election.cc:304] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:38.910950 22624 raft_consensus.cc:2804] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.911341 22624 raft_consensus.cc:493] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.911666 22624 raft_consensus.cc:3060] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.910163 22385 ts_tablet_manager.cc:1403] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.017s
I20260709 13:09:38.923000 22624 raft_consensus.cc:515] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.925228 22624 leader_election.cc:290] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:38.948097 22624 raft_consensus.cc:493] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.948649 22624 raft_consensus.cc:515] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.950865 22624 leader_election.cc:290] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:38.954655 22615 raft_consensus.cc:493] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.955355 22615 raft_consensus.cc:515] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:38.959304 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:38.961512 22083 leader_election.cc:343] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.961033 22615 leader_election.cc:290] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:38.964941 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:38.969718 22082 leader_election.cc:343] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.970216 22082 leader_election.cc:304] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:38.972673 22552 raft_consensus.cc:2749] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.974745 22385 raft_consensus.cc:359] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.975479 22385 raft_consensus.cc:385] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.975760 22385 raft_consensus.cc:740] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.976531 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:38.976390 22385 consensus_queue.cc:260] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:38.977555 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:38.978317 22114 raft_consensus.cc:2468] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:38.979061 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:38.979461 22158 leader_election.cc:304] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:38.980619 22603 raft_consensus.cc:2804] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.980989 22603 raft_consensus.cc:493] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.981314 22603 raft_consensus.cc:3060] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.981985 22385 ts_tablet_manager.cc:1434] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.064s	user 0.001s	sys 0.005s
W20260709 13:09:38.979766 22082 leader_election.cc:343] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.987768 22385 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:38.991955 22486 raft_consensus.cc:515] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.000841 22571 consensus_queue.cc:1048] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.004415 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.005381 22265 raft_consensus.cc:2393] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:38.985751 22082 leader_election.cc:304] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:39.007831 22459 raft_consensus.cc:2749] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.009153 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.011695 22265 raft_consensus.cc:2393] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:39.010748 22601 leader_election.cc:290] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.013471 22601 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.018057 22601 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.020777 22601 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.027091 22385 tablet_bootstrap.cc:654] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.022555 22486 leader_election.cc:290] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.035885 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.028327 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1339f58f4b83447ca1b957607bb81a0e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:39.039515 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1339f58f4b83447ca1b957607bb81a0e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.039994 22454 raft_consensus.cc:515] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:39.023617 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 99840us
I20260709 13:09:39.037778 22603 raft_consensus.cc:515] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.044977 22388 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.054821 22388 ts_tablet_manager.cc:1403] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.391s	user 0.023s	sys 0.016s
I20260709 13:09:39.048669 22420 raft_consensus.cc:493] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.057484 22158 leader_election.cc:343] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:39.058343 22158 leader_election.cc:343] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.059324 22420 raft_consensus.cc:515] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.053107 22339 raft_consensus.cc:3060] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.063238 22420 leader_election.cc:290] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.074463 22339 raft_consensus.cc:2468] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:39.076175 22187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:39.076848 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.077595 22114 raft_consensus.cc:2468] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:39.078292 22603 leader_election.cc:290] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.081936 22454 leader_election.cc:290] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.057098 22010 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44610 (request call id 46) took 1011 ms. Trace:
I20260709 13:09:39.082887 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0142c870a43c41b7bcb815fcee196201" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.082858 22010 rpcz_store.cc:276] 0709 13:09:38.044896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.045024 (+   128us) service_pool.cc:224] Handling call
0709 13:09:39.055971 (+1010947us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60723,"reported_tablets":2}
I20260709 13:09:39.084010 22117 raft_consensus.cc:2393] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:39.062445 22388 raft_consensus.cc:359] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.086170 22388 raft_consensus.cc:385] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.084986 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.086478 22388 raft_consensus.cc:740] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.087215 22388 consensus_queue.cc:260] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.088819 22232 leader_election.cc:304] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.089490 22388 ts_tablet_manager.cc:1434] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260709 13:09:39.090404 22630 raft_consensus.cc:2804] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.090603 22388 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:39.090807 22630 raft_consensus.cc:493] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.091315 22630 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.092129 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.094259 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.094839 22114 raft_consensus.cc:3060] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.097623 22486 consensus_queue.cc:1048] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.099049 22388 tablet_bootstrap.cc:654] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.099416 22604 consensus_queue.cc:1048] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.099812 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:39.110600 22232 leader_election.cc:304] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:39.112744 22420 raft_consensus.cc:2749] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:09:39.116775 22232 leader_election.cc:343] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.118115 22386 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:39.118800 22386 ts_tablet_manager.cc:1403] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.578s	user 0.026s	sys 0.026s
I20260709 13:09:39.120824 22630 raft_consensus.cc:515] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.129101 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.129225 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:39.129855 22117 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.130117 22188 raft_consensus.cc:3060] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.130403 22624 raft_consensus.cc:493] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.131104 22624 raft_consensus.cc:515] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.121488 22386 raft_consensus.cc:359] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.132694 22386 raft_consensus.cc:385] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.133056 22386 raft_consensus.cc:740] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.133800 22630 leader_election.cc:290] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.135210 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.136991 22624 leader_election.cc:290] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.133708 22155 leader_election.cc:304] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:39.137549 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a6f0c3a1204df3b6e06881227e59a7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:39.138872 22155 leader_election.cc:343] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.139935 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.141232 22486 raft_consensus.cc:2804] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.141858 22486 raft_consensus.cc:697] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:39.143452 22486 consensus_queue.cc:237] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.139446 22155 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.226570 22386 consensus_queue.cc:260] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.231453 22387 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:39.232190 22387 ts_tablet_manager.cc:1403] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.511s	user 0.017s	sys 0.038s
W20260709 13:09:39.145455 22232 leader_election.cc:343] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.144920 22117 raft_consensus.cc:2468] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 2.
I20260709 13:09:39.243978 22386 ts_tablet_manager.cc:1434] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.001s
I20260709 13:09:39.146240 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.234953 22603 raft_consensus.cc:2749] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:39.244782 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 99361.4us
I20260709 13:09:39.256203 22114 raft_consensus.cc:2468] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
W20260709 13:09:39.242538 22155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 103714us
W20260709 13:09:39.258165 22155 leader_election.cc:343] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.263688 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.265707 22117 raft_consensus.cc:1240] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Rejecting Update request from peer 3f0e42f9dab447d5bc309baaacba2ee7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:09:39.266829 22229 leader_election.cc:343] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.267331 22229 leader_election.cc:304] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.267643 22188 raft_consensus.cc:2468] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:39.271143 22387 raft_consensus.cc:359] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.275034 22388 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.275223 22387 raft_consensus.cc:385] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.275563 22388 ts_tablet_manager.cc:1403] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.032s
I20260709 13:09:39.275666 22387 raft_consensus.cc:740] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
W20260709 13:09:39.276479 22155 leader_election.cc:343] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.277661 22387 consensus_queue.cc:260] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.280104 22387 ts_tablet_manager.cc:1434] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260709 13:09:39.279919 22388 raft_consensus.cc:359] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.280592 22388 raft_consensus.cc:385] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.280871 22388 raft_consensus.cc:740] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.281138 22387 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:39.281502 22388 consensus_queue.cc:260] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:39.268785 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:39.269791 22385 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:39.288066 22385 ts_tablet_manager.cc:1403] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.301s	user 0.037s	sys 0.051s
I20260709 13:09:39.270403 22630 raft_consensus.cc:2749] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:39.271121 22229 leader_election.cc:343] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.289996 22229 leader_election.cc:304] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
W20260709 13:09:39.291145 22338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.019s	sys 0.031s
W20260709 13:09:39.291563 22338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.019s	sys 0.032s
I20260709 13:09:39.292232 22630 raft_consensus.cc:2749] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.271660 22397 consensus_queue.cc:1059] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.291188 22385 raft_consensus.cc:359] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.294433 22397 raft_consensus.cc:3055] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.294669 22385 raft_consensus.cc:385] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.294803 22397 raft_consensus.cc:740] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:39.294977 22385 raft_consensus.cc:740] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.295737 22385 consensus_queue.cc:260] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.295634 22397 consensus_queue.cc:260] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.296875 22397 raft_consensus.cc:3060] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.297806 22388 ts_tablet_manager.cc:1434] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:39.299111 22388 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:39.309064 22232 leader_election.cc:304] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.309950 22624 raft_consensus.cc:2804] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.310611 22624 raft_consensus.cc:697] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:39.311470 22624 consensus_queue.cc:237] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.313509 22385 ts_tablet_manager.cc:1434] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:39.313934 22388 tablet_bootstrap.cc:654] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.328148 22158 leader_election.cc:304] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.331348 22306 leader_election.cc:304] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:39.332612 22604 raft_consensus.cc:2804] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.333180 22604 raft_consensus.cc:697] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:39.333077 22387 tablet_bootstrap.cc:654] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.335857 22385 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:39.341487 22625 raft_consensus.cc:2804] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.342135 22625 raft_consensus.cc:697] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:39.342887 22388 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.343465 22388 ts_tablet_manager.cc:1403] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.004s
I20260709 13:09:39.342989 22625 consensus_queue.cc:237] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.349606 22388 raft_consensus.cc:359] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.350226 22388 raft_consensus.cc:385] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.350476 22388 raft_consensus.cc:740] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.351604 22388 consensus_queue.cc:260] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.335052 22604 consensus_queue.cc:237] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.354199 22601 consensus_queue.cc:1048] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.359388 22388 ts_tablet_manager.cc:1434] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:39.360803 22388 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
W20260709 13:09:39.361770 22305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.364847 22608 raft_consensus.cc:493] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.365506 22608 raft_consensus.cc:515] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.367765 22608 leader_election.cc:290] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:39.368497 22388 tablet_bootstrap.cc:654] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.368419 22386 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:39.371285 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84b3305904946d38911396e3454a49c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.385668 22265 raft_consensus.cc:3060] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.387686 22305 leader_election.cc:304] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:39.388859 22568 consensus_queue.cc:1048] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.391567 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.394593 22632 raft_consensus.cc:2749] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:39.395418 22157 leader_election.cc:343] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.399993 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.404796 22265 raft_consensus.cc:2468] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:39.422727 22608 consensus_queue.cc:1048] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.426900 22385 tablet_bootstrap.cc:654] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.427641 22386 tablet_bootstrap.cc:654] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.428439 22552 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.428942 22552 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.436313 22388 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.436844 22388 ts_tablet_manager.cc:1403] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.005s
I20260709 13:09:39.438786 22387 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:39.439288 22387 ts_tablet_manager.cc:1403] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.158s	user 0.024s	sys 0.002s
I20260709 13:09:39.446491 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:39.447522 22192 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:39.453159 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.456943 22387 raft_consensus.cc:359] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.457746 22387 raft_consensus.cc:385] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.440881 22552 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:39.458011 22387 raft_consensus.cc:740] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.460038 22337 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:39.470839 22387 consensus_queue.cc:260] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.466884 22011 catalog_manager.cc:5697] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 2, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 2 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.474129 22011 catalog_manager.cc:5697] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } }
I20260709 13:09:39.479378 22080 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:39.477763 22388 raft_consensus.cc:359] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.480142 22388 raft_consensus.cc:385] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.480366 22552 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.480504 22388 raft_consensus.cc:740] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.480990 22552 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.481456 22552 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.481983 22388 consensus_queue.cc:260] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:39.460928 22155 leader_election.cc:343] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.484812 22155 leader_election.cc:304] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:39.485289 22387 ts_tablet_manager.cc:1434] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:09:39.486404 22387 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:39.486498 22608 raft_consensus.cc:2749] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.487505 22460 consensus_queue.cc:1048] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.495025 22388 ts_tablet_manager.cc:1434] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:09:39.498821 22460 consensus_queue.cc:1048] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.502151 22385 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:39.502656 22385 ts_tablet_manager.cc:1403] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.002s
I20260709 13:09:39.505517 22385 raft_consensus.cc:359] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.506693 22385 raft_consensus.cc:385] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.510664 22388 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:39.507056 22385 raft_consensus.cc:740] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.514497 22420 raft_consensus.cc:493] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.515019 22420 raft_consensus.cc:515] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.517237 22420 leader_election.cc:290] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:39.522403 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.523160 22111 raft_consensus.cc:2468] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:39.520010 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:39.517235 22385 consensus_queue.cc:260] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.532152 22386 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:39.532646 22386 ts_tablet_manager.cc:1403] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.008s
I20260709 13:09:39.532721 22385 ts_tablet_manager.cc:1434] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:39.533838 22385 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:39.535699 22232 leader_election.cc:304] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
W20260709 13:09:39.541931 22232 leader_election.cc:343] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.542950 22420 raft_consensus.cc:2804] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.542819 22386 raft_consensus.cc:359] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.543424 22420 raft_consensus.cc:493] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.543705 22386 raft_consensus.cc:385] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.543787 22420 raft_consensus.cc:3060] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.544008 22386 raft_consensus.cc:740] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.544790 22386 consensus_queue.cc:260] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.546131 22388 tablet_bootstrap.cc:654] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.550662 22387 tablet_bootstrap.cc:654] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.553435 22386 ts_tablet_manager.cc:1434] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:39.554581 22386 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:39.553117 22552 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.558676 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:39.559263 22339 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.560322 22386 tablet_bootstrap.cc:654] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.583352 22632 raft_consensus.cc:493] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.584162 22632 raft_consensus.cc:515] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.584991 22339 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:39.586369 22080 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:39.586911 22632 leader_election.cc:290] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.587811 22615 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.588368 22615 raft_consensus.cc:697] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:39.589195 22615 consensus_queue.cc:237] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.590739 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.587656 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.593672 22264 raft_consensus.cc:2468] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.595050 22305 leader_election.cc:304] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:39.595479 22420 raft_consensus.cc:515] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.591389 22111 raft_consensus.cc:2468] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.597846 22632 raft_consensus.cc:2804] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.598328 22632 raft_consensus.cc:493] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.599263 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.600229 22111 raft_consensus.cc:3060] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.602553 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:39.603488 22188 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.612360 22385 tablet_bootstrap.cc:654] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.598723 22632 raft_consensus.cc:3060] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.599239 22552 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:39.618230 22486 raft_consensus.cc:493] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.622073 22486 raft_consensus.cc:515] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.624977 22486 leader_election.cc:290] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.625665 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.626392 22113 raft_consensus.cc:2468] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:39.627636 22158 leader_election.cc:304] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:39.628474 22486 raft_consensus.cc:2804] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.629411 22486 raft_consensus.cc:493] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.629755 22486 raft_consensus.cc:3060] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.629846 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:39.631434 22157 leader_election.cc:343] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.637219 22486 raft_consensus.cc:515] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.640249 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.640902 22117 raft_consensus.cc:3060] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.642931 22111 raft_consensus.cc:2468] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:39.643952 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.644871 22486 leader_election.cc:290] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.646795 22188 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:39.650518 22232 leader_election.cc:304] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:39.651050 22420 leader_election.cc:290] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:39.651718 22420 raft_consensus.cc:2804] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:39.650615 22157 leader_election.cc:343] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.652362 22420 raft_consensus.cc:697] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:39.653280 22420 consensus_queue.cc:237] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.656142 22625 raft_consensus.cc:493] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.656693 22625 raft_consensus.cc:515] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.658864 22625 leader_election.cc:290] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:39.660341 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:39.658073 22117 raft_consensus.cc:2468] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:39.667858 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:39.669623 22232 leader_election.cc:343] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.670864 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3cb8a2bc034a8fbd075e0b21f622e4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.671693 22111 raft_consensus.cc:2393] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:39.671557 22632 raft_consensus.cc:515] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.672952 22306 leader_election.cc:304] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:39.673557 22386 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:39.674117 22386 ts_tablet_manager.cc:1403] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.007s
I20260709 13:09:39.671607 22388 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.676111 22388 ts_tablet_manager.cc:1403] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.166s	user 0.036s	sys 0.023s
I20260709 13:09:39.682857 22397 raft_consensus.cc:493] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.683415 22158 leader_election.cc:304] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:39.683365 22397 raft_consensus.cc:515] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.684671 22486 raft_consensus.cc:2804] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.684181 22388 raft_consensus.cc:359] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.685169 22486 raft_consensus.cc:697] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:39.685268 22388 raft_consensus.cc:385] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.685559 22397 leader_election.cc:290] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.685774 22388 raft_consensus.cc:740] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.686079 22486 consensus_queue.cc:237] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.686533 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.687091 22264 raft_consensus.cc:3060] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.686807 22388 consensus_queue.cc:260] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.689570 22388 ts_tablet_manager.cc:1434] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:09:39.678992 22625 raft_consensus.cc:3060] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.693421 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.695238 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:39.695662 22117 raft_consensus.cc:3060] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.697119 22632 leader_election.cc:290] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.693585 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:39.701399 22305 leader_election.cc:343] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.702181 22117 raft_consensus.cc:2468] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
W20260709 13:09:39.704098 22306 leader_election.cc:343] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.704605 22306 leader_election.cc:304] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:39.705804 22306 leader_election.cc:304] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:39.706557 22397 raft_consensus.cc:2749] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.707170 22632 raft_consensus.cc:2804] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.707739 22632 raft_consensus.cc:697] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:39.708071 22386 raft_consensus.cc:359] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.708485 22632 consensus_queue.cc:237] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.708827 22386 raft_consensus.cc:385] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.709805 22386 raft_consensus.cc:740] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.710598 22388 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:39.711375 22386 consensus_queue.cc:260] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:39.714021 22625 raft_consensus.cc:2749] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.715533 22264 raft_consensus.cc:2468] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:39.719794 22386 ts_tablet_manager.cc:1434] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.005s
I20260709 13:09:39.725889 22386 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:39.728739 22385 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:39.729444 22385 ts_tablet_manager.cc:1403] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.008s
I20260709 13:09:39.740458 22604 consensus_queue.cc:1048] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.737128 22385 raft_consensus.cc:359] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.743908 22385 raft_consensus.cc:385] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.744207 22385 raft_consensus.cc:740] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.745370 22385 consensus_queue.cc:260] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.747289 22386 tablet_bootstrap.cc:654] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.748397 22387 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:39.748821 22387 ts_tablet_manager.cc:1403] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.263s	user 0.019s	sys 0.009s
I20260709 13:09:39.750222 22388 tablet_bootstrap.cc:654] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.751838 22387 raft_consensus.cc:359] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.752521 22387 raft_consensus.cc:385] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.752799 22387 raft_consensus.cc:740] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.754755 22385 ts_tablet_manager.cc:1434] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 13:09:39.755884 22385 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:39.759835 22387 consensus_queue.cc:260] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:39.763669 22387 ts_tablet_manager.cc:1434] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:39.764083 22388 tablet_bootstrap.cc:492] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:39.765021 22387 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:39.765530 22117 raft_consensus.cc:3060] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.771637 22387 tablet_bootstrap.cc:654] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.777433 22385 tablet_bootstrap.cc:654] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.783349 22388 ts_tablet_manager.cc:1403] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.010s
I20260709 13:09:39.786119 22625 consensus_queue.cc:1048] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.787401 22387 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:39.787954 22387 ts_tablet_manager.cc:1403] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:09:39.790532 22111 raft_consensus.cc:1275] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Refusing update from remote peer ca1c2f73661f4fd28f53d294057790cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:39.790809 22387 raft_consensus.cc:359] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.791215 22604 consensus_queue.cc:1048] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.793102 22420 consensus_queue.cc:1048] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.793501 22388 raft_consensus.cc:359] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.794241 22388 raft_consensus.cc:385] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.794520 22388 raft_consensus.cc:740] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.794044 22013 catalog_manager.cc:5697] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.795184 22388 consensus_queue.cc:260] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.796373 22387 raft_consensus.cc:385] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.797757 22630 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.821132 22630 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.821790 22386 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:39.825323 22387 raft_consensus.cc:740] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.839613 22386 ts_tablet_manager.cc:1403] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.003s
I20260709 13:09:39.824519 22630 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:39.802563 22287 debug-util.cc:398] Leaking SignalData structure 0x7b08001720a0 after lost signal to thread 14477
W20260709 13:09:39.841082 22287 debug-util.cc:398] Leaking SignalData structure 0x7b08002317c0 after lost signal to thread 22049
W20260709 13:09:39.842515 22287 debug-util.cc:398] Leaking SignalData structure 0x7b080026dbe0 after lost signal to thread 22141
W20260709 13:09:39.843819 22287 debug-util.cc:398] Leaking SignalData structure 0x7b080023c1e0 after lost signal to thread 22216
I20260709 13:09:39.842705 22386 raft_consensus.cc:359] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.844308 22386 raft_consensus.cc:385] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:39.845161 22287 debug-util.cc:398] Leaking SignalData structure 0x7b0800245c80 after lost signal to thread 22290
I20260709 13:09:39.846076 22385 tablet_bootstrap.cc:492] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:39.846616 22385 ts_tablet_manager.cc:1403] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.000s
I20260709 13:09:39.846309 22387 consensus_queue.cc:260] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.844605 22386 raft_consensus.cc:740] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.796204 22013 catalog_manager.cc:5697] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.827960 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.824323 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.853019 22386 consensus_queue.cc:260] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.834846 22454 consensus_queue.cc:1048] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.836951 22397 raft_consensus.cc:493] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.855412 22397 raft_consensus.cc:515] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.856047 22386 ts_tablet_manager.cc:1434] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:39.857062 22386 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:39.857523 22397 leader_election.cc:290] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
W20260709 13:09:39.863415 22229 leader_election.cc:343] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.863075 22013 catalog_manager.cc:5697] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.864679 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:39.865350 22192 raft_consensus.cc:2468] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.866070 22337 raft_consensus.cc:1275] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer ca1c2f73661f4fd28f53d294057790cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:39.866478 22337 pending_rounds.cc:85] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Aborting all ops after (but not including) 0
I20260709 13:09:39.866721 22337 pending_rounds.cc:107] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:39.867017 22337 raft_consensus.cc:2889] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.848825 22387 ts_tablet_manager.cc:1434] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.001s
I20260709 13:09:39.868793 22385 raft_consensus.cc:359] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.869508 22385 raft_consensus.cc:385] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.869771 22385 raft_consensus.cc:740] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.869947 22630 consensus_queue.cc:1048] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.870500 22306 leader_election.cc:304] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:39.870491 22385 consensus_queue.cc:260] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.871634 22625 raft_consensus.cc:2804] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.871989 22625 raft_consensus.cc:493] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.872341 22625 raft_consensus.cc:3060] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.872776 22387 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
W20260709 13:09:39.873936 22232 leader_election.cc:343] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.874456 22232 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:39.875837 22633 raft_consensus.cc:2749] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:39.875789 22287 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3be0 after lost signal to thread 22364
I20260709 13:09:39.878342 22385 ts_tablet_manager.cc:1434] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:09:39.879279 22385 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:39.882400 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.883100 22264 raft_consensus.cc:2468] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.799054 22388 ts_tablet_manager.cc:1434] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:39.884572 22388 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:39.888931 22397 raft_consensus.cc:493] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.889508 22397 raft_consensus.cc:515] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.889535 22625 raft_consensus.cc:515] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.893187 22387 tablet_bootstrap.cc:654] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.893337 22625 leader_election.cc:290] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:39.893759 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:39.892733 22397 leader_election.cc:290] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.894805 22113 raft_consensus.cc:2468] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.895407 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:39.896051 22265 raft_consensus.cc:2468] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:39.903170 22386 tablet_bootstrap.cc:654] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.904706 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.905359 22266 raft_consensus.cc:3060] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.906068 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543bace83eba44d6ab8955f3c9fdb2f8" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:39.899197 22306 leader_election.cc:304] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:39.906719 22192 raft_consensus.cc:3060] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.906448 22010 catalog_manager.cc:5697] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.907503 22397 raft_consensus.cc:2804] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.909294 22397 raft_consensus.cc:493] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.909629 22397 raft_consensus.cc:3060] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.938966 22192 raft_consensus.cc:2468] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:39.944222 22306 leader_election.cc:304] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:39.945007 22454 raft_consensus.cc:2804] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.945523 22454 raft_consensus.cc:697] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:39.947723 22454 consensus_queue.cc:237] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.954208 22601 raft_consensus.cc:493] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.954758 22601 raft_consensus.cc:515] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:39.956836 22601 leader_election.cc:290] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:39.963224 22388 tablet_bootstrap.cc:654] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.964391 22011 catalog_manager.cc:5697] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.969147 22385 tablet_bootstrap.cc:654] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.957439 22397 raft_consensus.cc:515] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.970757 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:39.971390 22339 raft_consensus.cc:2468] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:39.972097 22386 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:39.972638 22386 ts_tablet_manager.cc:1403] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.018s
I20260709 13:09:39.974463 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:39.975092 22263 raft_consensus.cc:3060] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.974587 22155 leader_election.cc:304] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:39.976428 22397 leader_election.cc:290] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:39.976544 22460 raft_consensus.cc:2804] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.977037 22460 raft_consensus.cc:493] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.977424 22460 raft_consensus.cc:3060] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.975605 22386 raft_consensus.cc:359] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.981151 22386 raft_consensus.cc:385] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.981498 22386 raft_consensus.cc:740] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.983815 22386 consensus_queue.cc:260] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:39.994359 22604 consensus_queue.cc:1048] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.995002 22263 raft_consensus.cc:2468] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:39.995947 22604 consensus_queue.cc:1048] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.007073 22386 ts_tablet_manager.cc:1434] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:40.009392 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.021858 22265 raft_consensus.cc:2468] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:40.019896 22305 leader_election.cc:304] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:40.020212 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98aeacddec914f1d8a82fe805dedcf91" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:40.029943 22117 raft_consensus.cc:3060] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.030671 22632 raft_consensus.cc:2804] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.031453 22632 raft_consensus.cc:697] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:40.032564 22632 consensus_queue.cc:237] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.041383 22385 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:40.042042 22385 ts_tablet_manager.cc:1403] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.003s
I20260709 13:09:40.047165 22117 raft_consensus.cc:2468] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:40.052022 22386 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:40.053108 22266 raft_consensus.cc:2468] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:40.056988 22385 raft_consensus.cc:359] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.057833 22385 raft_consensus.cc:385] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.058125 22385 raft_consensus.cc:740] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.058817 22385 consensus_queue.cc:260] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.060271 22386 tablet_bootstrap.cc:654] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.060880 22385 ts_tablet_manager.cc:1434] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:09:40.061995 22385 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:40.063539 22460 raft_consensus.cc:515] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.066429 22460 leader_election.cc:290] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:40.066738 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:40.067385 22266 raft_consensus.cc:3060] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.067865 22385 tablet_bootstrap.cc:654] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.073333 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f372f4163d984cce8f4884fa17505bee" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:40.074004 22337 raft_consensus.cc:3060] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.079253 22012 catalog_manager.cc:5697] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.082260 22012 catalog_manager.cc:5697] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.080107 22266 raft_consensus.cc:2468] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:40.099349 22337 raft_consensus.cc:2468] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:40.102859 22387 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:40.103590 22387 ts_tablet_manager.cc:1403] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.013s
I20260709 13:09:40.100445 22615 consensus_queue.cc:1048] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:40.122430 22157 leader_election.cc:304] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:40.123531 22604 raft_consensus.cc:2804] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.124315 22604 raft_consensus.cc:697] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:40.125391 22604 consensus_queue.cc:237] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.121826 22387 raft_consensus.cc:359] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.132194 22387 raft_consensus.cc:385] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.132464 22387 raft_consensus.cc:740] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.133100 22387 consensus_queue.cc:260] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.142104 22387 ts_tablet_manager.cc:1434] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:09:40.143754 22387 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:40.149235 22010 catalog_manager.cc:5697] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.150280 22615 consensus_queue.cc:1048] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.152241 22010 catalog_manager.cc:5697] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.155436 22386 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:40.155912 22386 ts_tablet_manager.cc:1403] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.010s
I20260709 13:09:40.160665 22387 tablet_bootstrap.cc:654] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.167637 22386 raft_consensus.cc:359] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.170001 22386 raft_consensus.cc:385] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.170298 22386 raft_consensus.cc:740] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.172667 22386 consensus_queue.cc:260] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.181303 22388 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:40.181833 22388 ts_tablet_manager.cc:1403] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.297s	user 0.030s	sys 0.032s
I20260709 13:09:40.185329 22388 raft_consensus.cc:359] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.186146 22388 raft_consensus.cc:385] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.187590 22386 ts_tablet_manager.cc:1434] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.005s
I20260709 13:09:40.187279 22012 catalog_manager.cc:5697] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.186470 22388 raft_consensus.cc:740] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.199954 22388 consensus_queue.cc:260] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.204577 22388 ts_tablet_manager.cc:1434] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 13:09:40.205988 22386 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:40.201896 22604 raft_consensus.cc:493] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.217737 22385 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:40.218321 22385 ts_tablet_manager.cc:1403] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.024s
I20260709 13:09:40.220176 22013 catalog_manager.cc:5697] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.221367 22385 raft_consensus.cc:359] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.222148 22385 raft_consensus.cc:385] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.222384 22604 raft_consensus.cc:515] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.224701 22604 leader_election.cc:290] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:40.221498 22388 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:40.226316 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:40.226958 22117 raft_consensus.cc:2468] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:40.227314 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.228580 22158 leader_election.cc:304] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
W20260709 13:09:40.229179 22157 leader_election.cc:343] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.222421 22385 raft_consensus.cc:740] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.231397 22385 consensus_queue.cc:260] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.231132 22460 raft_consensus.cc:2804] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.232728 22460 raft_consensus.cc:493] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.233057 22460 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.240599 22387 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:40.241204 22387 ts_tablet_manager.cc:1403] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.021s
I20260709 13:09:40.242362 22633 consensus_queue.cc:1048] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.243335 22604 raft_consensus.cc:493] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.243820 22604 raft_consensus.cc:515] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.245996 22604 leader_election.cc:290] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:40.246701 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:40.247500 22113 raft_consensus.cc:2393] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:40.249471 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88301f9a41d1408a954402329da2f773" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.249802 22460 raft_consensus.cc:515] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.251971 22460 leader_election.cc:290] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:40.253194 22158 leader_election.cc:304] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:40.255219 22486 raft_consensus.cc:3060] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.255983 22388 tablet_bootstrap.cc:654] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.258678 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:40.259331 22113 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.259688 22385 ts_tablet_manager.cc:1434] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:09:40.260811 22385 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:40.257625 22011 catalog_manager.cc:5697] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.268026 22386 tablet_bootstrap.cc:654] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.271270 22385 tablet_bootstrap.cc:654] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.272117 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
W20260709 13:09:40.273761 22157 leader_election.cc:343] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.274531 22387 raft_consensus.cc:359] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.275272 22387 raft_consensus.cc:385] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.275539 22387 raft_consensus.cc:740] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.276153 22387 consensus_queue.cc:260] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.282981 22387 ts_tablet_manager.cc:1434] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:09:40.285923 22387 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:40.282262 22633 raft_consensus.cc:493] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.287148 22633 raft_consensus.cc:515] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.290604 22633 leader_election.cc:290] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:40.291853 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:40.296434 22114 raft_consensus.cc:2393] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:40.304617 22387 tablet_bootstrap.cc:654] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.312016 22486 raft_consensus.cc:2749] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.329797 22388 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:40.330510 22388 ts_tablet_manager.cc:1403] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.004s
I20260709 13:09:40.330734 22454 consensus_queue.cc:1048] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.340358 22388 raft_consensus.cc:359] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.343317 22388 raft_consensus.cc:385] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.343626 22388 raft_consensus.cc:740] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.344022 22486 consensus_queue.cc:1048] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.349740 22388 consensus_queue.cc:260] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.349911 22113 raft_consensus.cc:2468] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:40.366050 22158 leader_election.cc:304] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:40.366297 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:40.370203 22601 raft_consensus.cc:2804] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.370388 22420 consensus_queue.cc:1048] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.366518 22552 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.371306 22552 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.371838 22601 raft_consensus.cc:697] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:40.372746 22601 consensus_queue.cc:237] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.377854 22232 leader_election.cc:304] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:40.373801 22552 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:40.384567 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:40.385720 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.386473 22265 raft_consensus.cc:2468] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
W20260709 13:09:40.387203 22080 leader_election.cc:343] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.379315 22633 raft_consensus.cc:3060] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.387753 22082 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:40.389070 22552 raft_consensus.cc:2804] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.389430 22552 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.389763 22552 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.390369 22385 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:40.390861 22385 ts_tablet_manager.cc:1403] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.022s
I20260709 13:09:40.392563 22632 consensus_queue.cc:1048] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.393572 22385 raft_consensus.cc:359] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.394287 22385 raft_consensus.cc:385] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.394546 22385 raft_consensus.cc:740] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.395358 22385 consensus_queue.cc:260] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.397135 22385 ts_tablet_manager.cc:1434] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:40.402849 22385 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:40.409353 22388 ts_tablet_manager.cc:1434] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:09:40.415288 22388 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:40.423646 22386 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:40.424180 22386 ts_tablet_manager.cc:1403] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.020s
I20260709 13:09:40.431092 22387 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:40.431716 22387 ts_tablet_manager.cc:1403] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.012s
I20260709 13:09:40.434762 22387 raft_consensus.cc:359] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.437490 22387 raft_consensus.cc:385] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.441241 22387 raft_consensus.cc:740] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.453235 22386 raft_consensus.cc:359] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.455073 22386 raft_consensus.cc:385] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.455528 22386 raft_consensus.cc:740] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.460071 22633 raft_consensus.cc:2749] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.460750 22454 consensus_queue.cc:1048] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.460969 22386 consensus_queue.cc:260] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.465631 22387 consensus_queue.cc:260] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.475062 22385 tablet_bootstrap.cc:654] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.480886 22386 ts_tablet_manager.cc:1434] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:09:40.493069 22387 ts_tablet_manager.cc:1434] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:09:40.504776 22386 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:40.520418 22387 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:40.533623 22388 tablet_bootstrap.cc:654] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.509300 22704 raft_consensus.cc:493] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.552897 22704 raft_consensus.cc:515] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.555140 22704 leader_election.cc:290] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:40.556696 22387 tablet_bootstrap.cc:654] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.536464 22397 consensus_queue.cc:1048] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:40.579473 22386 tablet_bootstrap.cc:654] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.561784 22552 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:40.585187 22701 log.cc:927] Time spent T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:40.586822 22552 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:40.593598 22632 raft_consensus.cc:493] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.607393 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 135788us
I20260709 13:09:40.606596 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:40.617180 22114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:40.618147 22114 raft_consensus.cc:2393] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:40.619415 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:40.610216 22632 raft_consensus.cc:515] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.622699 22698 consensus_queue.cc:1048] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:40.627966 22080 leader_election.cc:343] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.631017 22388 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:40.631695 22388 ts_tablet_manager.cc:1403] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.222s	user 0.022s	sys 0.007s
I20260709 13:09:40.633710 22187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:40.634684 22388 raft_consensus.cc:359] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.635691 22388 raft_consensus.cc:385] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.635969 22388 raft_consensus.cc:740] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.636652 22388 consensus_queue.cc:260] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.638489 22388 ts_tablet_manager.cc:1434] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:40.639454 22604 consensus_queue.cc:1048] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:40.647244 22306 leader_election.cc:343] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.650082 22232 leader_election.cc:304] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:40.647382 22454 raft_consensus.cc:493] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.689353 22454 raft_consensus.cc:515] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.691722 22454 leader_election.cc:290] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:40.696425 22632 leader_election.cc:290] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:40.711385 22568 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.712147 22568 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.717990 22604 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.718658 22604 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.729621 22388 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:40.738826 22385 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:40.742403 22385 ts_tablet_manager.cc:1403] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.340s	user 0.013s	sys 0.031s
I20260709 13:09:40.734599 22454 consensus_queue.cc:1048] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.728708 22420 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.750742 22015 catalog_manager.cc:5697] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.757339 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:40.764791 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:40.743039 22568 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:40.766019 22719 raft_consensus.cc:493] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.767441 22698 consensus_queue.cc:1048] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:40.751801 22718 log.cc:927] Time spent T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:09:40.769430 22264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:40.770107 22264 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.771571 22704 raft_consensus.cc:493] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.772130 22704 raft_consensus.cc:515] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.774716 22704 leader_election.cc:290] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:40.785185 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:40.786067 22117 raft_consensus.cc:2393] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:40.787037 22264 raft_consensus.cc:2468] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:40.788038 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:40.786790 22306 leader_election.cc:343] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.788234 22082 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:40.791603 22386 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:40.792109 22386 ts_tablet_manager.cc:1403] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.293s	user 0.015s	sys 0.000s
I20260709 13:09:40.767316 22719 raft_consensus.cc:515] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:40.795912 22232 leader_election.cc:343] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.792002 22706 raft_consensus.cc:2804] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.732259 22632 consensus_queue.cc:1048] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260709 13:09:40.825673 22385 raft_consensus.cc:359] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.836426 22385 raft_consensus.cc:385] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.836823 22385 raft_consensus.cc:740] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.829450 22386 raft_consensus.cc:359] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.837476 22386 raft_consensus.cc:385] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.837785 22386 raft_consensus.cc:740] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.816186 22706 raft_consensus.cc:697] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:40.844494 22706 consensus_queue.cc:237] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:40.848488 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:40.849231 22339 raft_consensus.cc:2468] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:40.853197 22388 tablet_bootstrap.cc:654] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.855057 22604 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:40.876192 22258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.876616 22259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.877184 22258 raft_consensus.cc:2393] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:40.855698 22386 consensus_queue.cc:260] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:40.879598 22386 ts_tablet_manager.cc:1434] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 13:09:40.861809 22385 consensus_queue.cc:260] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:40.882700 22385 ts_tablet_manager.cc:1434] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.000s
I20260709 13:09:40.883836 22385 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:40.868794 22260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.869838 22719 leader_election.cc:290] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:40.870952 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:40.886390 22260 raft_consensus.cc:2468] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:40.886497 22261 raft_consensus.cc:2468] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:40.888819 22420 raft_consensus.cc:2749] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.880892 22386 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:40.894912 22157 leader_election.cc:304] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:40.897483 22719 raft_consensus.cc:2804] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.898100 22719 raft_consensus.cc:493] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.898619 22719 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.905328 22711 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.905925 22711 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:40.909238 22229 leader_election.cc:304] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:40.916014 22714 raft_consensus.cc:2804] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.916574 22714 raft_consensus.cc:493] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.917007 22714 raft_consensus.cc:3060] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.907460 22387 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:40.920470 22387 ts_tablet_manager.cc:1403] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.410s	user 0.028s	sys 0.013s
W20260709 13:09:40.921952 22305 leader_election.cc:343] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.929705 22305 leader_election.cc:304] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:40.936482 22716 raft_consensus.cc:2749] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.937038 22460 consensus_queue.cc:1048] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:40.980561 22305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 56546.3us
I20260709 13:09:40.989382 22305 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:40.991358 22305 leader_election.cc:304] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
W20260709 13:09:40.961066 22229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 51916.8us
I20260709 13:09:40.997859 22397 raft_consensus.cc:2804] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.000968 22397 raft_consensus.cc:493] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.001482 22397 raft_consensus.cc:3060] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.004164 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:41.033300 22386 tablet_bootstrap.cc:654] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.001444 22625 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:40.968237 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 192569us
I20260709 13:09:41.038827 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:41.070437 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:41.071296 22116 raft_consensus.cc:2468] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:41.058915 22387 raft_consensus.cc:359] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.061901 22625 raft_consensus.cc:2749] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:41.062808 22155 leader_election.cc:343] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.063481 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:41.065335 22719 raft_consensus.cc:515] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.073844 22387 raft_consensus.cc:385] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.079121 22387 raft_consensus.cc:740] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.076669 22385 tablet_bootstrap.cc:654] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.080088 22387 consensus_queue.cc:260] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.093359 22397 raft_consensus.cc:515] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:41.099718 22387 ts_tablet_manager.cc:1434] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.001s
I20260709 13:09:41.113685 22388 tablet_bootstrap.cc:492] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:41.114485 22388 ts_tablet_manager.cc:1403] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.395s	user 0.043s	sys 0.065s
I20260709 13:09:41.116273 22719 leader_election.cc:290] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:41.118739 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:41.119765 22261 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.120280 22387 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:41.123145 22397 leader_election.cc:290] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:41.123651 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:41.124979 22388 raft_consensus.cc:359] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.126466 22388 raft_consensus.cc:385] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.126878 22388 raft_consensus.cc:740] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
W20260709 13:09:41.131577 22155 leader_election.cc:343] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.102332 22711 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
W20260709 13:09:41.153718 22080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 74528.8us
W20260709 13:09:41.156322 22080 leader_election.cc:343] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.157480 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:41.168282 22388 consensus_queue.cc:260] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.169585 22337 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.170827 22386 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:41.171367 22386 ts_tablet_manager.cc:1403] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.291s	user 0.016s	sys 0.013s
I20260709 13:09:41.175220 22386 raft_consensus.cc:359] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:41.175979 22386 raft_consensus.cc:385] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.177000 22386 raft_consensus.cc:740] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.183404 22386 consensus_queue.cc:260] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:41.202824 22385 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:41.203389 22385 ts_tablet_manager.cc:1403] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.320s	user 0.023s	sys 0.019s
I20260709 13:09:41.193672 22158 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:41.201314 22714 raft_consensus.cc:515] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:41.208510 22604 raft_consensus.cc:2804] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.208994 22604 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.209348 22604 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.212482 22385 raft_consensus.cc:359] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.212990 22385 raft_consensus.cc:385] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.211894 22261 raft_consensus.cc:2468] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:41.213167 22385 raft_consensus.cc:740] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.217356 22385 consensus_queue.cc:260] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.218958 22386 ts_tablet_manager.cc:1434] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:09:41.219990 22386 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:41.229522 22157 leader_election.cc:304] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:41.231189 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:41.231586 22460 raft_consensus.cc:2804] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.232105 22460 raft_consensus.cc:697] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:41.225929 22601 consensus_queue.cc:1048] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:41.233017 22460 consensus_queue.cc:237] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.235913 22387 tablet_bootstrap.cc:654] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.243846 22604 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.244967 22266 raft_consensus.cc:2393] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:41.251494 22714 leader_election.cc:290] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:41.259451 22337 raft_consensus.cc:2468] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:41.260542 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:41.262292 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:41.272742 22386 tablet_bootstrap.cc:654] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.273413 22385 ts_tablet_manager.cc:1434] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.000s
I20260709 13:09:41.288100 22015 catalog_manager.cc:5697] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.299317 22189 raft_consensus.cc:2393] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:41.295418 22601 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.301570 22388 ts_tablet_manager.cc:1434] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.187s	user 0.011s	sys 0.001s
I20260709 13:09:41.312103 22385 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:41.313378 22388 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:41.304847 22111 raft_consensus.cc:3060] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.327194 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:41.308884 22601 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.333873 22305 leader_election.cc:304] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:41.334457 22601 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:41.335283 22730 raft_consensus.cc:2749] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.337249 22387 tablet_bootstrap.cc:492] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:41.338040 22387 ts_tablet_manager.cc:1403] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.218s	user 0.022s	sys 0.006s
I20260709 13:09:41.343474 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb552418dae949178152d5fd607910e7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:41.344651 22335 raft_consensus.cc:2393] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
W20260709 13:09:41.353533 22155 leader_election.cc:343] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.353528 22083 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:41.361234 22552 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.361867 22552 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.368502 22552 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:41.370769 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:41.372480 22157 leader_election.cc:343] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.375717 22385 tablet_bootstrap.cc:654] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.380108 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:41.381045 22117 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:41.391249 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:41.392019 22188 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:41.394536 22388 tablet_bootstrap.cc:654] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.396574 22083 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:41.393723 22387 raft_consensus.cc:359] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.399709 22387 raft_consensus.cc:385] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.400054 22387 raft_consensus.cc:740] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.389495 22552 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.401160 22387 consensus_queue.cc:260] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.412878 22387 ts_tablet_manager.cc:1434] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:09:41.415777 22387 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:41.429738 22703 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.430451 22703 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.414669 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:41.435774 22158 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:41.437654 22711 consensus_queue.cc:1048] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.437763 22111 raft_consensus.cc:2468] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:41.439126 22706 consensus_queue.cc:1048] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.440075 22460 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.440594 22460 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.441012 22460 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.450412 22232 leader_election.cc:304] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:41.453109 22633 raft_consensus.cc:2804] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.437883 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:41.453791 22633 raft_consensus.cc:697] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:41.461109 22633 consensus_queue.cc:237] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:41.461617 22082 leader_election.cc:343] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.433576 22703 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.404865 22604 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:41.521023 22714 raft_consensus.cc:493] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.539649 22714 raft_consensus.cc:515] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.541745 22714 leader_election.cc:290] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:41.550074 22386 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:41.549384 22460 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.549806 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:41.562490 22386 ts_tablet_manager.cc:1403] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.343s	user 0.026s	sys 0.008s
I20260709 13:09:41.562754 22188 raft_consensus.cc:2468] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:41.564764 22232 leader_election.cc:304] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:41.565860 22714 raft_consensus.cc:2804] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.566457 22714 raft_consensus.cc:493] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.565408 22386 raft_consensus.cc:359] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.570477 22386 raft_consensus.cc:385] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.560798 22387 tablet_bootstrap.cc:654] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.570873 22386 raft_consensus.cc:740] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.566931 22714 raft_consensus.cc:3060] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.578395 22386 consensus_queue.cc:260] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.581580 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:41.582458 22337 raft_consensus.cc:2468] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:41.591349 22460 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:41.593948 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:41.599793 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:41.601040 22385 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:41.601758 22385 ts_tablet_manager.cc:1403] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.294s	user 0.044s	sys 0.035s
I20260709 13:09:41.605475 22385 raft_consensus.cc:359] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.606511 22385 raft_consensus.cc:385] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.605468 22552 raft_consensus.cc:2749] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.606791 22703 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.608537 22116 raft_consensus.cc:2393] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:41.609757 22703 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
W20260709 13:09:41.614065 22157 leader_election.cc:343] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.614650 22157 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:41.611793 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:41.606873 22385 raft_consensus.cc:740] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.618213 22604 raft_consensus.cc:2749] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.617699 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:41.623135 22115 raft_consensus.cc:2468] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:41.625017 22158 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:41.626331 22460 raft_consensus.cc:2804] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.626830 22460 raft_consensus.cc:697] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:41.627722 22460 consensus_queue.cc:237] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.632086 22188 raft_consensus.cc:2393] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:41.612540 22714 raft_consensus.cc:515] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.639057 22385 consensus_queue.cc:260] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.645998 22386 ts_tablet_manager.cc:1434] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:09:41.646358 22266 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.647511 22386 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:41.648741 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:41.649423 22188 raft_consensus.cc:3060] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.651139 22388 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:41.651793 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2ad0d0d17848deb4a3f21d5b04a3c7" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:41.652554 22335 raft_consensus.cc:3060] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.655596 22266 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:41.656576 22387 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:41.657088 22387 ts_tablet_manager.cc:1403] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.241s	user 0.012s	sys 0.000s
I20260709 13:09:41.658262 22082 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:41.660573 22387 raft_consensus.cc:359] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.661294 22387 raft_consensus.cc:385] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.661554 22387 raft_consensus.cc:740] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.662210 22387 consensus_queue.cc:260] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.664482 22387 ts_tablet_manager.cc:1434] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:41.664814 22385 ts_tablet_manager.cc:1434] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.063s	user 0.002s	sys 0.006s
I20260709 13:09:41.665381 22387 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:41.668977 22711 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.669747 22711 raft_consensus.cc:697] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:41.670773 22711 consensus_queue.cc:237] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.665843 22385 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:41.673624 22698 consensus_queue.cc:1048] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.677017 22387 tablet_bootstrap.cc:654] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.651814 22388 ts_tablet_manager.cc:1403] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.343s	user 0.030s	sys 0.012s
I20260709 13:09:41.668663 22335 raft_consensus.cc:2468] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:41.681372 22229 leader_election.cc:304] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:41.682871 22738 raft_consensus.cc:2804] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.683624 22738 raft_consensus.cc:697] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:41.686712 22738 consensus_queue.cc:237] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.645773 22714 leader_election.cc:290] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:41.708186 22013 catalog_manager.cc:5697] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.711179 22188 raft_consensus.cc:2468] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:41.714329 22604 consensus_queue.cc:1048] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.714526 22388 raft_consensus.cc:359] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.720443 22388 raft_consensus.cc:385] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.720722 22386 tablet_bootstrap.cc:654] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.720891 22388 raft_consensus.cc:740] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.758761 22388 consensus_queue.cc:260] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.775972 22385 tablet_bootstrap.cc:654] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.791929 22388 ts_tablet_manager.cc:1434] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 13:09:41.793499 22388 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:41.787526 22733 raft_consensus.cc:493] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.795835 22733 raft_consensus.cc:515] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.800894 22387 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:41.801468 22387 ts_tablet_manager.cc:1403] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.000s
I20260709 13:09:41.805081 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:41.808238 22733 leader_election.cc:290] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
W20260709 13:09:41.812014 22080 leader_election.cc:343] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.841952 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:41.868481 22385 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:41.869071 22385 ts_tablet_manager.cc:1403] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.012s
I20260709 13:09:41.870878 22388 tablet_bootstrap.cc:654] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.871833 22385 raft_consensus.cc:359] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.872557 22385 raft_consensus.cc:385] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.872829 22385 raft_consensus.cc:740] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.873488 22385 consensus_queue.cc:260] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.876027 22385 ts_tablet_manager.cc:1434] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:41.876223 22387 raft_consensus.cc:359] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.876971 22387 raft_consensus.cc:385] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.877019 22385 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:41.877283 22387 raft_consensus.cc:740] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.879652 22386 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:41.880195 22386 ts_tablet_manager.cc:1403] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.233s	user 0.010s	sys 0.035s
I20260709 13:09:41.861738 22625 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.883118 22386 raft_consensus.cc:359] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.884001 22386 raft_consensus.cc:385] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.883708 22625 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.884341 22386 raft_consensus.cc:740] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.885048 22386 consensus_queue.cc:260] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:41.878012 22387 consensus_queue.cc:260] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:41.887331 22386 ts_tablet_manager.cc:1434] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:41.888191 22387 ts_tablet_manager.cc:1434] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:09:41.888332 22386 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:41.888499 22083 leader_election.cc:343] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.889102 22387 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:41.890085 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:41.898520 22386 tablet_bootstrap.cc:654] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.888975 22083 leader_election.cc:304] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:41.904151 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:41.904999 22111 raft_consensus.cc:2393] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:41.907001 22306 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:41.907799 22568 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.909220 22460 raft_consensus.cc:493] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.909782 22460 raft_consensus.cc:515] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.914454 22387 tablet_bootstrap.cc:654] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:41.926270 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:41.929818 22385 tablet_bootstrap.cc:654] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.912878 22013 catalog_manager.cc:5697] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.885936 22625 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:41.902864 22711 raft_consensus.cc:2749] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.936734 22460 leader_election.cc:290] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:41.939525 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:41.940387 22262 raft_consensus.cc:2468] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:41.940644 22568 raft_consensus.cc:2749] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.943222 22157 leader_election.cc:304] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:41.945036 22460 raft_consensus.cc:2804] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.945448 22460 raft_consensus.cc:493] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.945796 22460 raft_consensus.cc:3060] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.948155 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:41.951926 22155 leader_election.cc:343] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.952261 22738 consensus_queue.cc:1048] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:41.974691 22387 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:41.975258 22387 ts_tablet_manager.cc:1403] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.023s
I20260709 13:09:41.977329 22012 catalog_manager.cc:5697] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.987139 22738 consensus_queue.cc:1048] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.988422 22460 raft_consensus.cc:515] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:41.990053 22386 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:41.990594 22386 ts_tablet_manager.cc:1403] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.013s
I20260709 13:09:41.991310 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:41.991952 22261 raft_consensus.cc:3060] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.996321 22012 catalog_manager.cc:5697] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.998822 22386 raft_consensus.cc:359] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:41.999589 22386 raft_consensus.cc:385] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.999904 22386 raft_consensus.cc:740] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.003209 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:42.004487 22155 leader_election.cc:343] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.005390 22460 leader_election.cc:290] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:41.996340 22385 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:42.006259 22385 ts_tablet_manager.cc:1403] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.004s
I20260709 13:09:41.996289 22387 raft_consensus.cc:359] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.008283 22387 raft_consensus.cc:385] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.006623 22388 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:42.006338 22386 consensus_queue.cc:260] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.009416 22388 ts_tablet_manager.cc:1403] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.004s
I20260709 13:09:42.008744 22387 raft_consensus.cc:740] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.015079 22386 ts_tablet_manager.cc:1434] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:09:42.017457 22386 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:42.021950 22385 raft_consensus.cc:359] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.022738 22385 raft_consensus.cc:385] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.023000 22385 raft_consensus.cc:740] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.024777 22261 raft_consensus.cc:2468] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:42.026206 22157 leader_election.cc:304] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:42.027871 22388 raft_consensus.cc:359] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.028642 22388 raft_consensus.cc:385] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.028959 22388 raft_consensus.cc:740] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.029609 22388 consensus_queue.cc:260] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.018761 22387 consensus_queue.cc:260] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.032753 22387 ts_tablet_manager.cc:1434] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.003s
I20260709 13:09:42.033689 22387 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:42.027868 22460 raft_consensus.cc:2804] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.034672 22460 raft_consensus.cc:697] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:42.035467 22460 consensus_queue.cc:237] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.038164 22386 tablet_bootstrap.cc:654] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.039677 22387 tablet_bootstrap.cc:654] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.023654 22385 consensus_queue.cc:260] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.043931 22385 ts_tablet_manager.cc:1434] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:09:42.044924 22385 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:42.047832 22388 ts_tablet_manager.cc:1434] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:09:42.051259 22388 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:42.053089 22015 catalog_manager.cc:5697] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.061093 22385 tablet_bootstrap.cc:654] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.067881 22388 tablet_bootstrap.cc:654] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.078004 22387 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:42.078518 22387 ts_tablet_manager.cc:1403] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 13:09:42.082202 22387 raft_consensus.cc:359] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.083038 22387 raft_consensus.cc:385] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.083334 22387 raft_consensus.cc:740] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.085382 22385 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:42.085879 22385 ts_tablet_manager.cc:1403] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:09:42.090353 22388 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:42.090860 22388 ts_tablet_manager.cc:1403] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:09:42.094340 22385 raft_consensus.cc:359] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.095054 22385 raft_consensus.cc:385] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.095307 22385 raft_consensus.cc:740] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.095932 22385 consensus_queue.cc:260] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.100833 22387 consensus_queue.cc:260] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.099994 22388 raft_consensus.cc:359] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.104409 22388 raft_consensus.cc:385] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.104693 22388 raft_consensus.cc:740] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.105357 22388 consensus_queue.cc:260] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.106173 22387 ts_tablet_manager.cc:1434] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:09:42.107380 22388 ts_tablet_manager.cc:1434] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:42.108224 22387 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:42.107380 22385 ts_tablet_manager.cc:1434] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 13:09:42.109477 22385 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:42.107796 22011 catalog_manager.cc:5697] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.108266 22388 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:42.115118 22387 tablet_bootstrap.cc:654] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.120150 22386 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:42.120764 22386 ts_tablet_manager.cc:1403] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.003s
I20260709 13:09:42.124291 22386 raft_consensus.cc:359] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.125181 22386 raft_consensus.cc:385] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.125522 22386 raft_consensus.cc:740] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.126896 22386 consensus_queue.cc:260] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.133085 22388 tablet_bootstrap.cc:654] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.136090 22386 ts_tablet_manager.cc:1434] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:09:42.137481 22386 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:42.139439 22714 raft_consensus.cc:493] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.139947 22714 raft_consensus.cc:515] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.141624 22601 consensus_queue.cc:1048] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.142268 22714 leader_election.cc:290] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:42.145453 22387 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:42.146095 22387 ts_tablet_manager.cc:1403] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.012s
I20260709 13:09:42.147194 22385 tablet_bootstrap.cc:654] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.149049 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ae63d58cc3409fac6679d9f14f3145" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:42.148916 22387 raft_consensus.cc:359] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.150102 22387 raft_consensus.cc:385] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.150441 22387 raft_consensus.cc:740] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.153872 22460 consensus_queue.cc:1048] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.152683 22387 consensus_queue.cc:260] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.158331 22714 consensus_queue.cc:1048] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:42.163831 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ae63d58cc3409fac6679d9f14f3145" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.158326 22733 consensus_queue.cc:1048] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:42.175194 22111 raft_consensus.cc:2468] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:42.149838 22188 raft_consensus.cc:2468] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:42.168259 22386 tablet_bootstrap.cc:654] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.187561 22232 leader_election.cc:304] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.188505 22633 raft_consensus.cc:2804] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.188895 22633 raft_consensus.cc:493] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.189235 22633 raft_consensus.cc:3060] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.186825 22387 ts_tablet_manager.cc:1434] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:09:42.190758 22387 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:42.210491 22460 raft_consensus.cc:493] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.211335 22460 raft_consensus.cc:515] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.218201 22460 leader_election.cc:290] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.223224 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:42.224062 22335 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:42.231513 22385 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:42.232074 22385 ts_tablet_manager.cc:1403] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.003s
I20260709 13:09:42.234516 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.235301 22115 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:42.237185 22155 leader_election.cc:304] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:42.237398 22385 raft_consensus.cc:359] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.238164 22385 raft_consensus.cc:385] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.238469 22385 raft_consensus.cc:740] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.239739 22601 raft_consensus.cc:2804] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.240336 22601 raft_consensus.cc:493] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.239840 22385 consensus_queue.cc:260] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.240698 22601 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.241034 22703 consensus_queue.cc:1048] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.242357 22385 ts_tablet_manager.cc:1434] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:09:42.243813 22385 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:42.244037 22633 raft_consensus.cc:515] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.246956 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ae63d58cc3409fac6679d9f14f3145" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:42.247617 22112 raft_consensus.cc:3060] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.253552 22601 raft_consensus.cc:515] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.257280 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:42.257890 22335 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.258348 22601 leader_election.cc:290] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.258881 22112 raft_consensus.cc:2468] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:42.260629 22232 leader_election.cc:304] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.261786 22704 raft_consensus.cc:2804] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.262476 22704 raft_consensus.cc:697] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:42.263648 22704 consensus_queue.cc:237] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.264750 22335 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:42.266388 22155 leader_election.cc:304] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:42.267277 22601 raft_consensus.cc:2804] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.281136 22601 raft_consensus.cc:697] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:42.282341 22601 consensus_queue.cc:237] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.296687 22633 leader_election.cc:290] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:42.296474 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:42.296329 22738 consensus_queue.cc:1048] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:42.301095 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ae63d58cc3409fac6679d9f14f3145" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:42.301788 22192 raft_consensus.cc:3060] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.304653 22111 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.319725 22386 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:42.320395 22386 ts_tablet_manager.cc:1403] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.018s
I20260709 13:09:42.314276 22733 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.328161 22733 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.342777 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:42.339152 22192 raft_consensus.cc:2468] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:42.351295 22733 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:42.353107 22386 raft_consensus.cc:359] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.354238 22386 raft_consensus.cc:385] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.354612 22386 raft_consensus.cc:740] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.355772 22388 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:42.355563 22386 consensus_queue.cc:260] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.356441 22388 ts_tablet_manager.cc:1403] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.248s	user 0.022s	sys 0.009s
W20260709 13:09:42.362567 22776 log.cc:927] Time spent T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:09:42.364822 22080 leader_election.cc:343] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.381904 22460 raft_consensus.cc:493] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.382938 22460 raft_consensus.cc:515] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.396030 22386 ts_tablet_manager.cc:1434] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 13:09:42.398283 22460 leader_election.cc:290] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:42.404126 22387 tablet_bootstrap.cc:654] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.400288 22388 raft_consensus.cc:359] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.406499 22388 raft_consensus.cc:385] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.406900 22388 raft_consensus.cc:740] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.410482 22388 consensus_queue.cc:260] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.412189 22460 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.413159 22460 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.397982 22386 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:42.422279 22388 ts_tablet_manager.cc:1434] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.002s
I20260709 13:09:42.423537 22388 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
W20260709 13:09:42.425019 22083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 91942.5us
I20260709 13:09:42.425832 22385 tablet_bootstrap.cc:654] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.429530 22460 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.431288 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:42.443377 22738 raft_consensus.cc:493] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.442176 22625 raft_consensus.cc:493] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.443122 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:42.448621 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:42.468297 22155 leader_election.cc:343] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.480769 22625 raft_consensus.cc:515] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:42.486421 22155 leader_election.cc:343] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:42.479311 22774 log.cc:927] Time spent T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:42.494374 22386 tablet_bootstrap.cc:654] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.478561 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:42.513703 22388 tablet_bootstrap.cc:654] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.516007 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:42.519152 22780 log.cc:927] Time spent T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:42.470940 22738 raft_consensus.cc:515] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.524844 22012 catalog_manager.cc:5697] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.484165 22190 raft_consensus.cc:2468] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:42.508090 22703 raft_consensus.cc:493] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.550599 22703 raft_consensus.cc:515] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.548091 22113 raft_consensus.cc:2468] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:42.529968 22111 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:42.552838 22703 leader_election.cc:290] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:42.556031 22625 leader_election.cc:290] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:42.534855 22155 consensus_peers.cc:597] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Couldn't send request to peer 3f0e42f9dab447d5bc309baaacba2ee7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.559497 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:42.560220 22266 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:42.561239 22738 leader_election.cc:290] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.561937 22305 leader_election.cc:304] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.563376 22568 raft_consensus.cc:2804] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.563848 22568 raft_consensus.cc:493] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.564307 22568 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.571959 22157 leader_election.cc:343] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.572479 22157 leader_election.cc:304] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:42.572871 22083 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:42.574772 22781 raft_consensus.cc:2804] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.575146 22781 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.575486 22781 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.577251 22486 raft_consensus.cc:2749] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.582237 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.583145 22112 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:42.584674 22568 raft_consensus.cc:515] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.579224 22015 catalog_manager.cc:5697] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.590293 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:42.591303 22266 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.593137 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.591428 22232 leader_election.cc:304] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.593869 22112 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:42.599795 22266 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:42.602056 22738 raft_consensus.cc:2764] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:42.604513 22387 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:42.605031 22387 ts_tablet_manager.cc:1403] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.414s	user 0.037s	sys 0.023s
I20260709 13:09:42.604945 22305 leader_election.cc:304] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.606014 22625 raft_consensus.cc:2804] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.606722 22625 raft_consensus.cc:697] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:42.607436 22625 consensus_queue.cc:237] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.610632 22385 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:42.610837 22386 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:42.611268 22385 ts_tablet_manager.cc:1403] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.368s	user 0.017s	sys 0.020s
I20260709 13:09:42.611410 22386 ts_tablet_manager.cc:1403] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.214s	user 0.004s	sys 0.009s
I20260709 13:09:42.601260 22568 leader_election.cc:290] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.613207 22387 raft_consensus.cc:359] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.613922 22387 raft_consensus.cc:385] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.614681 22388 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:42.614230 22387 raft_consensus.cc:740] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.615309 22388 ts_tablet_manager.cc:1403] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.007s
I20260709 13:09:42.615666 22387 consensus_queue.cc:260] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.617782 22387 ts_tablet_manager.cc:1434] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:42.614213 22385 raft_consensus.cc:359] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.621407 22385 raft_consensus.cc:385] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.621774 22385 raft_consensus.cc:740] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.622555 22385 consensus_queue.cc:260] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.623879 22387 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:42.624589 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:42.618580 22388 raft_consensus.cc:359] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.626654 22388 raft_consensus.cc:385] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.627382 22388 raft_consensus.cc:740] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.625303 22112 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.628512 22385 ts_tablet_manager.cc:1434] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:09:42.637880 22385 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
W20260709 13:09:42.641965 22080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 144508us
I20260709 13:09:42.643469 22158 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:42.643342 22388 consensus_queue.cc:260] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.647634 22388 ts_tablet_manager.cc:1434] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:09:42.646844 22386 raft_consensus.cc:359] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.651796 22386 raft_consensus.cc:385] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.652040 22386 raft_consensus.cc:740] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.652694 22386 consensus_queue.cc:260] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.644508 22792 raft_consensus.cc:493] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.658878 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:42.655066 22725 consensus_queue.cc:1048] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:42.664034 22792 raft_consensus.cc:515] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.648923 22786 raft_consensus.cc:2804] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.667346 22786 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.659241 22260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:42.667801 22385 tablet_bootstrap.cc:654] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.667763 22786 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.686784 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ad3d419e304cec828f5104f51047f6" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:42.687225 22260 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:42.687531 22262 raft_consensus.cc:2468] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:42.689052 22157 leader_election.cc:304] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:42.683449 22386 ts_tablet_manager.cc:1434] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:09:42.684952 22792 leader_election.cc:290] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:42.696075 22725 raft_consensus.cc:2804] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.696626 22725 raft_consensus.cc:493] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.696986 22725 raft_consensus.cc:3060] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.690344 22386 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:42.707613 22387 tablet_bootstrap.cc:654] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.709173 22388 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:42.732086 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ad3d419e304cec828f5104f51047f6" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.732874 22117 raft_consensus.cc:2468] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
I20260709 13:09:42.768601 22725 raft_consensus.cc:515] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:42.769480 22792 consensus_queue.cc:1048] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.770493 22112 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:42.738171 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:42.758460 22229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 52169.6us
I20260709 13:09:42.708531 22781 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.786239 22625 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.803143 22625 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.804539 22385 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:42.805095 22385 ts_tablet_manager.cc:1403] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.000s
I20260709 13:09:42.805264 22625 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:42.811689 22791 consensus_queue.cc:1048] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.812736 22781 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:42.827239 22189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:42.790208 22335 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:42.828965 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:42.830452 22112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:42.830981 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:42.831691 22334 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.831768 22112 raft_consensus.cc:2393] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:42.835160 22080 leader_election.cc:304] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:42.835726 22306 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:42.839404 22733 raft_consensus.cc:2804] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.844674 22733 raft_consensus.cc:493] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.852218 22733 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.852636 22010 catalog_manager.cc:5697] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 1 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.852905 22385 raft_consensus.cc:359] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.853930 22385 raft_consensus.cc:385] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.854264 22385 raft_consensus.cc:740] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.855185 22385 consensus_queue.cc:260] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:42.861701 22460 consensus_queue.cc:1048] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.864283 22387 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:42.864833 22387 ts_tablet_manager.cc:1403] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.241s	user 0.032s	sys 0.023s
I20260709 13:09:42.875067 22385 ts_tablet_manager.cc:1434] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:09:42.876579 22385 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:42.881399 22387 raft_consensus.cc:359] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.882202 22387 raft_consensus.cc:385] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.882468 22387 raft_consensus.cc:740] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.883159 22387 consensus_queue.cc:260] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:42.884158 22386 tablet_bootstrap.cc:654] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.893031 22387 ts_tablet_manager.cc:1434] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:09:42.895776 22387 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:42.901150 22786 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:42.862372 22082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 68719.9us
I20260709 13:09:42.931308 22725 leader_election.cc:290] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:42.932309 22733 raft_consensus.cc:515] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:42.942065 22388 tablet_bootstrap.cc:654] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.945072 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 59547.2us
W20260709 13:09:42.962522 22229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 68098.4us
I20260709 13:09:42.956229 22733 leader_election.cc:290] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:42.980404 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:43.003350 22334 raft_consensus.cc:2468] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:43.004112 22625 raft_consensus.cc:2749] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.003430 22340 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.998939 22189 raft_consensus.cc:2393] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17194feb726e4445801d2097dd68067d in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:43.006088 22791 consensus_queue.cc:1048] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:43.008206 22725 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.008757 22725 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:43.010965 22725 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:42.988731 22116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ad3d419e304cec828f5104f51047f6" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:43.015654 22385 tablet_bootstrap.cc:654] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.994319 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ad3d419e304cec828f5104f51047f6" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:43.013455 22080 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:43.020747 22387 tablet_bootstrap.cc:654] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.024008 22386 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:43.024554 22386 ts_tablet_manager.cc:1403] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.334s	user 0.018s	sys 0.020s
I20260709 13:09:42.999723 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:43.042373 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
W20260709 13:09:43.044123 22158 leader_election.cc:343] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.023528 22261 raft_consensus.cc:3060] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.020186 22116 raft_consensus.cc:3060] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.047353 22262 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.046010 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:43.043881 22787 raft_consensus.cc:2804] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.056790 22787 raft_consensus.cc:697] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:43.057880 22787 consensus_queue.cc:237] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:43.064759 22155 leader_election.cc:343] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.067625 22155 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:43.109284 22388 tablet_bootstrap.cc:492] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:43.109864 22388 ts_tablet_manager.cc:1403] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.408s	user 0.015s	sys 0.018s
I20260709 13:09:43.057971 22340 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:43.108407 22800 raft_consensus.cc:2749] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.132712 22388 raft_consensus.cc:359] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.133551 22388 raft_consensus.cc:385] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.138625 22386 raft_consensus.cc:359] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:43.139362 22386 raft_consensus.cc:385] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.139624 22386 raft_consensus.cc:740] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.140554 22262 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:43.148298 22386 consensus_queue.cc:260] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:43.133819 22388 raft_consensus.cc:740] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.126439 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:43.154745 22388 consensus_queue.cc:260] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.155615 22334 raft_consensus.cc:2393] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:43.157025 22388 ts_tablet_manager.cc:1434] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:09:43.159508 22386 ts_tablet_manager.cc:1434] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.001s
I20260709 13:09:43.160055 22786 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:43.158013 22388 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:43.165172 22730 consensus_queue.cc:1048] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.169528 22082 leader_election.cc:304] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:43.141695 22261 raft_consensus.cc:2468] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:43.206396 22703 raft_consensus.cc:2804] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.222159 22703 raft_consensus.cc:697] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:43.223166 22703 consensus_queue.cc:237] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:43.233376 22385 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:43.234203 22385 ts_tablet_manager.cc:1403] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.358s	user 0.015s	sys 0.000s
I20260709 13:09:43.257477 22116 raft_consensus.cc:2468] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:43.240427 22730 raft_consensus.cc:493] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.259781 22387 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:43.260320 22387 ts_tablet_manager.cc:1403] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.366s	user 0.011s	sys 0.002s
I20260709 13:09:43.259933 22730 raft_consensus.cc:515] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:43.263131 22080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 90883.8us
I20260709 13:09:43.264923 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:43.273916 22158 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:43.280928 22730 leader_election.cc:290] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:43.283159 22387 raft_consensus.cc:359] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:43.284191 22387 raft_consensus.cc:385] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.284686 22387 raft_consensus.cc:740] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.287492 22386 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:43.289114 22385 raft_consensus.cc:359] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.294597 22385 raft_consensus.cc:385] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.294970 22385 raft_consensus.cc:740] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.297013 22385 consensus_queue.cc:260] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.294195 22388 tablet_bootstrap.cc:654] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.285563 22387 consensus_queue.cc:260] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:43.316870 22385 ts_tablet_manager.cc:1434] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:09:43.318325 22385 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
W20260709 13:09:43.322556 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 119874us
I20260709 13:09:43.337961 22792 raft_consensus.cc:2749] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.349319 22158 leader_election.cc:304] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:43.351502 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:43.351933 22460 raft_consensus.cc:2804] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.352240 22192 raft_consensus.cc:2468] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:43.352454 22460 raft_consensus.cc:697] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:43.356487 22791 raft_consensus.cc:493] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.353754 22460 consensus_queue.cc:237] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:43.357208 22791 raft_consensus.cc:515] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.362601 22791 leader_election.cc:290] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:43.365622 22306 leader_election.cc:304] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:43.367934 22387 ts_tablet_manager.cc:1434] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.000s
I20260709 13:09:43.369125 22387 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
W20260709 13:09:43.416042 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 44744.4us
W20260709 13:09:43.422372 22305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 74127.2us
I20260709 13:09:43.415127 22625 raft_consensus.cc:2804] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.462518 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:43.463682 22192 raft_consensus.cc:2468] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:43.474174 22265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:43.474942 22265 raft_consensus.cc:2468] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:43.479311 22232 leader_election.cc:304] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:43.480187 22797 raft_consensus.cc:2804] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.480571 22797 raft_consensus.cc:493] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.480908 22797 raft_consensus.cc:3060] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.486574 22797 raft_consensus.cc:515] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.465987 22787 raft_consensus.cc:493] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.487815 22787 raft_consensus.cc:515] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:43.489895 22797 leader_election.cc:290] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:43.490494 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:43.465893 22625 raft_consensus.cc:493] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.531064 22388 tablet_bootstrap.cc:492] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:43.531836 22388 ts_tablet_manager.cc:1403] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.374s	user 0.008s	sys 0.009s
I20260709 13:09:43.513090 22625 raft_consensus.cc:3060] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.550148 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:43.550894 22815 log.cc:927] Time spent T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:43.551079 22190 raft_consensus.cc:3060] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.555403 22258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:43.533557 22787 leader_election.cc:290] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:43.563304 22386 tablet_bootstrap.cc:654] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.567746 22387 tablet_bootstrap.cc:654] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:43.569981 22082 leader_election.cc:343] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.571780 22460 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.583132 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:43.583581 22625 raft_consensus.cc:515] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.584893 22337 raft_consensus.cc:2393] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:43.572422 22460 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:43.598093 22460 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
W20260709 13:09:43.613756 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.632174 22388 raft_consensus.cc:359] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.640339 22801 consensus_queue.cc:1048] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.643705 22385 tablet_bootstrap.cc:654] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.644687 22258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:43.646212 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:43.659276 22010 catalog_manager.cc:5697] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:43.679994 22080 leader_election.cc:343] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.673938 22388 raft_consensus.cc:385] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.680524 22080 leader_election.cc:304] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:43.680964 22388 raft_consensus.cc:740] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
W20260709 13:09:43.674582 22305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 193145us
I20260709 13:09:43.682714 22397 consensus_queue.cc:1048] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:43.688310 22157 leader_election.cc:343] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.692109 22388 consensus_queue.cc:260] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:43.718425 22388 ts_tablet_manager.cc:1434] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.186s	user 0.011s	sys 0.000s
I20260709 13:09:43.697048 22190 raft_consensus.cc:2468] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:43.738788 22788 raft_consensus.cc:2749] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.740124 22115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:43.744525 22711 consensus_queue.cc:1048] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.759511 22388 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:43.766601 22387 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:43.775655 22625 leader_election.cc:290] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:43.776233 22387 ts_tablet_manager.cc:1403] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.407s	user 0.011s	sys 0.010s
I20260709 13:09:43.777978 22386 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:43.778492 22386 ts_tablet_manager.cc:1403] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.491s	user 0.014s	sys 0.008s
I20260709 13:09:43.779480 22387 raft_consensus.cc:359] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:43.780400 22387 raft_consensus.cc:385] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.780725 22387 raft_consensus.cc:740] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.781087 22386 raft_consensus.cc:359] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:43.781806 22386 raft_consensus.cc:385] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.768301 22807 consensus_queue.cc:1048] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:43.783239 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 52029.2us
I20260709 13:09:43.781479 22387 consensus_queue.cc:260] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:43.790270 22158 leader_election.cc:343] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.790923 22386 raft_consensus.cc:740] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.812094 22232 leader_election.cc:304] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:43.810160 22158 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:43.811234 22386 consensus_queue.cc:260] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:43.826633 22386 ts_tablet_manager.cc:1434] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:09:43.838114 22386 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:43.838788 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 48550.2us
I20260709 13:09:43.821601 22738 raft_consensus.cc:2804] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.841295 22387 ts_tablet_manager.cc:1434] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:09:43.823630 22711 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.842694 22828 raft_consensus.cc:2749] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.850585 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
W20260709 13:09:43.911202 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 71236us
W20260709 13:09:43.921257 22305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 59211.5us
I20260709 13:09:43.852185 22711 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:43.946862 22388 tablet_bootstrap.cc:654] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.960552 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf3d2ff31fb49d0afde438cabaf1883" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:43.961690 22387 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: Bootstrap starting.
I20260709 13:09:43.975862 22738 raft_consensus.cc:697] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:44.002533 22711 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:44.002328 22738 consensus_queue.cc:237] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.009490 22386 tablet_bootstrap.cc:654] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.010908 22385 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:44.011669 22385 ts_tablet_manager.cc:1403] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.694s	user 0.032s	sys 0.019s
I20260709 13:09:44.012897 22188 raft_consensus.cc:2393] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:43.978483 22800 consensus_queue.cc:1048] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
W20260709 13:09:44.034528 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 47972.7us
I20260709 13:09:44.051105 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:44.051832 22190 raft_consensus.cc:2468] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:44.053645 22385 raft_consensus.cc:359] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.054448 22385 raft_consensus.cc:385] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.054705 22385 raft_consensus.cc:740] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.055369 22385 consensus_queue.cc:260] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.060290 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:44.061782 22817 raft_consensus.cc:493] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.062384 22817 raft_consensus.cc:515] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.064674 22817 leader_election.cc:290] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
W20260709 13:09:44.074267 22080 leader_election.cc:343] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.080350 22785 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.081086 22785 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:44.098194 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:44.087625 22083 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:44.082429 22822 raft_consensus.cc:493] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.102192 22822 raft_consensus.cc:515] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.110841 22385 ts_tablet_manager.cc:1434] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.004s
I20260709 13:09:44.111804 22385 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
W20260709 13:09:44.112726 22229 leader_election.cc:343] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.097301 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:44.077353 22787 consensus_queue.cc:1048] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
W20260709 13:09:44.129365 22232 leader_election.cc:343] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.129879 22232 leader_election.cc:304] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:44.131393 22843 raft_consensus.cc:2749] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.133409 22822 leader_election.cc:290] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:44.136802 22785 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:44.110893 22711 raft_consensus.cc:2804] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.139391 22711 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.139773 22711 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.142107 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:44.121744 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e1f8df0714984a5c04e9a4c53c90b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:44.124243 22387 tablet_bootstrap.cc:654] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.151235 22306 leader_election.cc:304] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:44.167774 22460 consensus_queue.cc:1048] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.180028 22844 raft_consensus.cc:2749] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:44.264689 22155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 45506us
I20260709 13:09:44.266590 22385 tablet_bootstrap.cc:654] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.266950 22333 raft_consensus.cc:3060] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.291401 22388 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:44.292028 22388 ts_tablet_manager.cc:1403] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.533s	user 0.015s	sys 0.019s
W20260709 13:09:44.271898 22082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 48625.6us
I20260709 13:09:44.329877 22388 raft_consensus.cc:359] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:44.330626 22388 raft_consensus.cc:385] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.330874 22388 raft_consensus.cc:740] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.331472 22388 consensus_queue.cc:260] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:44.335186 22791 raft_consensus.cc:493] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.335716 22791 raft_consensus.cc:515] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.343060 22388 ts_tablet_manager.cc:1434] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:09:44.354751 22791 leader_election.cc:290] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:44.359961 22711 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:44.361312 22850 log.cc:927] Time spent T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:44.361951 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:44.362310 22711 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:44.362857 22117 raft_consensus.cc:2468] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:44.369895 22232 leader_election.cc:304] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:44.372718 22738 raft_consensus.cc:2804] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.373195 22738 raft_consensus.cc:493] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.373600 22738 raft_consensus.cc:3060] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.395351 22854 log.cc:927] Time spent T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:44.403800 22305 leader_election.cc:304] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:44.404824 22827 raft_consensus.cc:2749] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.415603 22386 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:44.415792 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:44.416394 22386 ts_tablet_manager.cc:1403] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.586s	user 0.025s	sys 0.020s
I20260709 13:09:44.421171 22388 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:44.423377 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:44.424222 22332 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.428180 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
W20260709 13:09:44.432791 22229 leader_election.cc:343] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.452775 22386 raft_consensus.cc:359] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:44.453920 22386 raft_consensus.cc:385] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.457710 22388 tablet_bootstrap.cc:654] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.558774 22386 raft_consensus.cc:740] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.559855 22386 consensus_queue.cc:260] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:44.460026 22155 leader_election.cc:343] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.471963 22113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:44.454980 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:44.544224 22157 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:44441, user_credentials={real_user=slave}} blocked reactor thread for 59663us
W20260709 13:09:44.561683 22155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 101702us
I20260709 13:09:44.583737 22386 ts_tablet_manager.cc:1434] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.002s
I20260709 13:09:44.611369 22387 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: No bootstrap required, opened a new log
I20260709 13:09:44.612066 22387 ts_tablet_manager.cc:1403] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent bootstrapping tablet: real 0.651s	user 0.065s	sys 0.069s
I20260709 13:09:44.613543 22386 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:44.577237 22190 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:44.633229 22158 leader_election.cc:343] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.633879 22158 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:44.651350 22816 consensus_queue.cc:1048] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.646778 22824 raft_consensus.cc:2749] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.704300 22387 raft_consensus.cc:359] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.705936 22387 raft_consensus.cc:385] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.708897 22387 raft_consensus.cc:740] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Initialized, Role: FOLLOWER
W20260709 13:09:44.712561 22860 log.cc:927] Time spent T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: Append to log took a long time: real 0.114s	user 0.003s	sys 0.000s
I20260709 13:09:44.730093 22387 consensus_queue.cc:260] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
W20260709 13:09:44.750240 22858 log.cc:927] Time spent T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:44.752480 22388 tablet_bootstrap.cc:492] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:44.753011 22388 ts_tablet_manager.cc:1403] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.332s	user 0.027s	sys 0.031s
I20260709 13:09:44.753683 22385 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:44.754201 22385 ts_tablet_manager.cc:1403] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.643s	user 0.010s	sys 0.022s
I20260709 13:09:44.754134 22332 raft_consensus.cc:2468] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:44.755599 22190 raft_consensus.cc:2468] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:44.755757 22388 raft_consensus.cc:359] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.756441 22388 raft_consensus.cc:385] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.747225 22843 consensus_queue.cc:1048] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:44.756883 22388 raft_consensus.cc:740] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.757438 22387 ts_tablet_manager.cc:1434] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: Time spent starting tablet: real 0.145s	user 0.010s	sys 0.000s
I20260709 13:09:44.766507 22386 tablet_bootstrap.cc:654] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.766494 22738 raft_consensus.cc:515] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.777465 22388 consensus_queue.cc:260] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:44.780997 22385 raft_consensus.cc:359] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.783457 22385 raft_consensus.cc:385] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.783847 22385 raft_consensus.cc:740] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.787119 22385 consensus_queue.cc:260] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:44.796298 22738 leader_election.cc:290] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:44.799078 22386 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:44.800390 22386 ts_tablet_manager.cc:1403] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.009s
I20260709 13:09:44.800449 22388 ts_tablet_manager.cc:1434] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:09:44.803120 22386 raft_consensus.cc:359] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:44.803808 22386 raft_consensus.cc:385] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.803987 22386 raft_consensus.cc:740] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.804134 22388 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:44.804438 22386 consensus_queue.cc:260] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:44.805565 22386 ts_tablet_manager.cc:1434] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:09:44.799081 22385 ts_tablet_manager.cc:1434] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:09:44.806370 22386 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:44.807221 22385 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: Bootstrap starting.
I20260709 13:09:44.810178 22388 tablet_bootstrap.cc:654] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.859555 22083 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:44.867779 22011 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44624 (request call id 62) took 1208 ms. Trace:
I20260709 13:09:44.868472 22011 rpcz_store.cc:276] 0709 13:09:43.659464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.659588 (+   124us) service_pool.cc:224] Handling call
0709 13:09:44.867481 (+1207893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23260,"reported_tablets":3}
I20260709 13:09:44.913190 22386 tablet_bootstrap.cc:700] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Time spent opening tablet: real 0.103s	user 0.004s	sys 0.000s
I20260709 13:09:44.914638 22386 tablet_bootstrap.cc:654] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.915416 22787 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.916738 22787 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:44.917040 22012 catalog_manager.cc:5697] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.955894 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:44.940845 22012 catalog_manager.cc:5697] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.969583 22825 raft_consensus.cc:2804] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.992987 22385 tablet_bootstrap.cc:654] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.996177 22787 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:45.000362 22785 raft_consensus.cc:493] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.003199 22825 raft_consensus.cc:697] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
W20260709 13:09:44.970718 22083 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 111792us
I20260709 13:09:45.018229 22844 raft_consensus.cc:493] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.019241 22844 raft_consensus.cc:515] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:45.018217 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:45.024770 22082 leader_election.cc:343] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.001338 22785 raft_consensus.cc:515] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:45.026746 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:45.029331 22844 leader_election.cc:290] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:45.029465 22785 leader_election.cc:290] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:45.032303 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:45.033437 22186 raft_consensus.cc:2468] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:45.027875 22111 raft_consensus.cc:3060] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.048756 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:45.049892 22261 raft_consensus.cc:2468] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
W20260709 13:09:45.054448 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:45.054929 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:45.055716 22336 raft_consensus.cc:2468] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 0.
W20260709 13:09:45.057878 22229 leader_election.cc:343] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.005139 22825 consensus_queue.cc:237] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.091445 22157 leader_election.cc:304] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:45.092152 22258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:45.093081 22258 raft_consensus.cc:2468] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 0.
I20260709 13:09:45.093799 22811 raft_consensus.cc:2804] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.094302 22811 raft_consensus.cc:493] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.094668 22811 raft_consensus.cc:3060] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.107862 22305 leader_election.cc:304] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:45.110491 22846 raft_consensus.cc:2804] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.110895 22811 raft_consensus.cc:515] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:45.110920 22846 raft_consensus.cc:493] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.112656 22846 raft_consensus.cc:3060] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.114418 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:45.115149 22261 raft_consensus.cc:3060] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.116693 22811 leader_election.cc:290] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:45.123478 22083 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:45.168910 22261 raft_consensus.cc:2468] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:45.177551 22157 leader_election.cc:304] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:45.178650 22486 raft_consensus.cc:2804] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.179116 22386 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: No bootstrap required, opened a new log
I20260709 13:09:45.179240 22486 raft_consensus.cc:697] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:45.180277 22386 ts_tablet_manager.cc:1403] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.374s	user 0.013s	sys 0.021s
I20260709 13:09:45.180733 22486 consensus_queue.cc:237] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:45.169875 22388 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:45.191340 22781 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.192039 22781 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.173655 22846 raft_consensus.cc:515] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:09:45.207063 22388 ts_tablet_manager.cc:1403] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.403s	user 0.026s	sys 0.031s
I20260709 13:09:45.224114 22111 raft_consensus.cc:2468] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:45.224035 22386 raft_consensus.cc:359] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.225076 22386 raft_consensus.cc:385] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.225394 22386 raft_consensus.cc:740] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.234392 22816 raft_consensus.cc:493] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.235057 22816 raft_consensus.cc:515] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.235791 22232 leader_election.cc:304] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:45.238093 22385 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: No bootstrap required, opened a new log
I20260709 13:09:45.238941 22841 raft_consensus.cc:2804] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.237710 22816 leader_election.cc:290] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:45.239498 22841 raft_consensus.cc:697] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:45.240600 22841 consensus_queue.cc:237] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.241760 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ecd61e5f504f318519347d1299751e" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:45.246223 22385 ts_tablet_manager.cc:1403] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: Time spent bootstrapping tablet: real 0.439s	user 0.015s	sys 0.019s
I20260709 13:09:45.249127 22788 raft_consensus.cc:2804] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.249629 22788 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.249548 22385 raft_consensus.cc:359] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:45.250125 22788 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.260056 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:45.261101 22261 raft_consensus.cc:2393] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:45.264439 22846 leader_election.cc:290] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:45.269120 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:45.270888 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:45.271870 22336 raft_consensus.cc:2393] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 1: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:45.275832 22388 raft_consensus.cc:359] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.276723 22388 raft_consensus.cc:385] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.276994 22388 raft_consensus.cc:740] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.278852 22385 raft_consensus.cc:385] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.279181 22385 raft_consensus.cc:740] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.277721 22388 consensus_queue.cc:260] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.281601 22386 consensus_queue.cc:260] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.293326 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ecd61e5f504f318519347d1299751e" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:45.295558 22111 raft_consensus.cc:2468] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 0.
I20260709 13:09:45.298619 22232 leader_election.cc:304] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:45.300834 22816 raft_consensus.cc:2804] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.301206 22816 raft_consensus.cc:493] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.301579 22816 raft_consensus.cc:3060] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:45.304545 22229 leader_election.cc:343] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.311484 22781 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:45.313097 22788 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:45.313306 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:45.315033 22190 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 0.
I20260709 13:09:45.316999 22083 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:45.318346 22781 raft_consensus.cc:2804] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.318761 22781 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.319406 22781 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.320698 22388 ts_tablet_manager.cc:1434] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.002s
I20260709 13:09:45.322197 22388 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:45.290997 22385 consensus_queue.cc:260] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:45.336788 22386 ts_tablet_manager.cc:1434] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.156s	user 0.010s	sys 0.000s
I20260709 13:09:45.338644 22333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:45.338601 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:45.348672 22385 ts_tablet_manager.cc:1434] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 13:09:45.343791 22190 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.352782 22704 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.353318 22884 log.cc:927] Time spent T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:45.353396 22704 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:45.354133 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a853eea2e64e4bb361d4720592e9a4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
W20260709 13:09:45.359575 22080 leader_election.cc:343] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.364583 22704 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:45.365051 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:45.365731 22262 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.365911 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:45.371644 22781 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.377108 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:45.377950 22117 raft_consensus.cc:2393] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:45.361259 22788 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:45.379032 22781 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:45.380201 22232 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:45.389865 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:45.391047 22188 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.394315 22190 raft_consensus.cc:2468] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:45.396350 22262 raft_consensus.cc:2468] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:45.397181 22841 raft_consensus.cc:2749] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.399309 22188 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 1.
I20260709 13:09:45.403239 22083 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:45.404667 22083 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:45.405475 22781 raft_consensus.cc:2804] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.406004 22781 raft_consensus.cc:697] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:45.407054 22781 consensus_queue.cc:237] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:45.409705 22825 raft_consensus.cc:2804] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.410604 22825 raft_consensus.cc:697] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:09:45.411506 22825 consensus_queue.cc:237] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.412173 22306 leader_election.cc:304] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:45.409469 22816 raft_consensus.cc:515] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.420941 22846 raft_consensus.cc:2749] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.424520 22816 leader_election.cc:290] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:45.424717 22117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ecd61e5f504f318519347d1299751e" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:45.425472 22117 raft_consensus.cc:3060] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.425580 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
W20260709 13:09:45.430465 22080 leader_election.cc:343] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.431813 22012 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44596 (request call id 59) took 1672 ms. Trace:
I20260709 13:09:45.434387 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ecd61e5f504f318519347d1299751e" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:45.391042 22388 tablet_bootstrap.cc:654] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.444545 22011 catalog_manager.cc:5697] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:45.446302 22229 leader_election.cc:343] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.447125 22117 raft_consensus.cc:2468] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:45.449532 22015 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44632 (request call id 64) took 1133 ms. Trace:
I20260709 13:09:45.449977 22015 rpcz_store.cc:276] 0709 13:09:44.318091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.318215 (+   124us) service_pool.cc:224] Handling call
0709 13:09:44.604482 (+286267us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001e2154. stack: 00007f2d928f4343 00007f2d928f4240 00007f2d922831d4 00007f2d9bfc1304 00007f2d9bfc1299 00007f2d9597d090 00007f2d95a1bf3a 00007f2d9b7d21cc 00007f2d9b8d037e 00007f2d99d912a4 00007f2d99d91232 00007f2d99d91161 00007f2d99d910dc 00007f2d99d90392 00007f2d93d4e48c 00007f2d93d4d8c6
0709 13:09:45.448621 (+844139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22161,"reported_tablets":1,"spinlock_wait_cycles":651431296}
I20260709 13:09:45.432263 22012 rpcz_store.cc:276] 0709 13:09:43.759290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.759445 (+   155us) service_pool.cc:224] Handling call
0709 13:09:45.431752 (+1672307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:45.259426 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:45.260102 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:45.260152 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:09:45.260180 (+    28us) tablet.cc:662] Decoding operations
0709 13:09:45.260695 (+   515us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:45.260803 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:45.260842 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:45.261471 (+   629us) tablet.cc:701] Row locks acquired
0709 13:09:45.261542 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:09:45.261746 (+   204us) write_op.cc:270] Start()
0709 13:09:45.261925 (+   179us) write_op.cc:276] Timestamp: P: 1783602585261661 usec, L: 0
0709 13:09:45.261961 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:09:45.262770 (+   809us) log.cc:844] Serialized 928 byte log entry
0709 13:09:45.362889 (+100119us) op_driver.cc:464] REPLICATION: finished
0709 13:09:45.413569 (+ 50680us) write_op.cc:301] APPLY: starting
0709 13:09:45.413659 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:45.413806 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:45.413944 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:45.414380 (+   436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:45.414644 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:45.414711 (+    67us) write_op.cc:312] APPLY: finished
0709 13:09:45.415011 (+   300us) log.cc:844] Serialized 28 byte log entry
0709 13:09:45.426766 (+ 11755us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.426861 (+    95us) write_op.cc:454] Released schema lock
0709 13:09:45.426918 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:45.427388 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.427419 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":50402,"apply.run_cpu_time_us":2254,"apply.run_wall_time_us":13777,"num_ops":2,"prepare.queue_time_us":163488,"prepare.run_cpu_time_us":3638,"prepare.run_wall_time_us":6663,"replication_time_us":97227,"thread_start_us":167743,"threads_started":2}]]}
I20260709 13:09:45.462535 22232 leader_election.cc:304] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:45.467764 22816 raft_consensus.cc:2804] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.468999 22816 raft_consensus.cc:697] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:45.475451 22816 consensus_queue.cc:237] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.492731 22015 catalog_manager.cc:5697] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 0 to 1, leader changed from <none> to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.514994 22011 catalog_manager.cc:5697] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.522620 22011 catalog_manager.cc:5697] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 1 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.523593 22388 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:45.524224 22388 ts_tablet_manager.cc:1403] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.002s
I20260709 13:09:45.528107 22388 raft_consensus.cc:359] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.529887 22388 raft_consensus.cc:385] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.531445 22388 raft_consensus.cc:740] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.534904 22388 consensus_queue.cc:260] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.561215 22388 ts_tablet_manager.cc:1434] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:45.571202 22010 catalog_manager.cc:5697] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.573544 22010 catalog_manager.cc:5697] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.597071 22825 consensus_queue.cc:1048] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.598726 22886 raft_consensus.cc:493] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.601220 22886 raft_consensus.cc:515] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.610357 22886 leader_election.cc:290] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:45.629245 22781 consensus_queue.cc:1048] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.611647 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:45.629654 22010 catalog_manager.cc:5697] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 1 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.630631 22111 raft_consensus.cc:2393] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate ca1c2f73661f4fd28f53d294057790cb in this term.
I20260709 13:09:45.610390 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f399f589fa4347108c35bf247c543fb6" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:45.633484 22305 leader_election.cc:304] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:45.634639 22886 raft_consensus.cc:3060] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.640945 22388 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: Bootstrap starting.
I20260709 13:09:45.648903 22388 tablet_bootstrap.cc:654] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.653636 22886 raft_consensus.cc:2749] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.662099 22486 consensus_queue.cc:1048] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.722137 22388 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: No bootstrap required, opened a new log
I20260709 13:09:45.722723 22388 ts_tablet_manager.cc:1403] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.000s
I20260709 13:09:45.729116 22785 consensus_queue.cc:1048] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:45.773170 22704 consensus_queue.cc:1048] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.779335 22388 raft_consensus.cc:359] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.780349 22388 raft_consensus.cc:385] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.780669 22388 raft_consensus.cc:740] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.789311 22886 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.790335 22886 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:45.798378 22886 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:45.803813 22111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:45.813012 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:45.826658 22191 raft_consensus.cc:2393] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 1: Already voted for candidate 17194feb726e4445801d2097dd68067d in this term.
I20260709 13:09:45.781459 22388 consensus_queue.cc:260] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:45.832023 22388 ts_tablet_manager.cc:1434] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:09:45.834636 22704 consensus_queue.cc:1048] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.835851 22306 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:45.837363 22846 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.850683 22846 raft_consensus.cc:2749] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.882627 22901 consensus_queue.cc:1048] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:45.905046 22901 consensus_queue.cc:1048] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.911715 22901 consensus_queue.cc:1048] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.912544 22332 raft_consensus.cc:3060] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.937690 22816 consensus_queue.cc:1048] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:45.939764 22906 log.cc:927] Time spent T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:09:45.945398 22901 consensus_queue.cc:1048] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:46.049074 22841 consensus_queue.cc:1048] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.114972 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
W20260709 13:09:46.128126 22232 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:09:46.192550 22232 consensus_peers.cc:597] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.193346 22232 consensus_peers.cc:597] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.257762 22232 consensus_peers.cc:597] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.273404 22158 consensus_peers.cc:597] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.274292 22158 consensus_peers.cc:597] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.286602 22158 consensus_peers.cc:597] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.298786 22232 consensus_peers.cc:597] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.305101 22232 consensus_peers.cc:597] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.324983 22306 consensus_peers.cc:597] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.331032 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:46.334067 14474 tablet_replica.cc:333] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.335218 14474 raft_consensus.cc:2243] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.335932 14474 raft_consensus.cc:2272] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.341040 14474 tablet_replica.cc:333] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.342130 14474 raft_consensus.cc:2243] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.343283 14474 raft_consensus.cc:2272] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.346799 14474 tablet_replica.cc:333] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.347911 14474 raft_consensus.cc:2243] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.348526 14474 raft_consensus.cc:2272] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.354664 14474 tablet_replica.cc:333] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.356529 14474 raft_consensus.cc:2243] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:46.357247 22232 consensus_peers.cc:597] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.357158 14474 raft_consensus.cc:2272] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.360833 14474 tablet_replica.cc:333] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.361881 14474 raft_consensus.cc:2243] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.362560 14474 raft_consensus.cc:2272] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.364877 22158 consensus_peers.cc:597] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.372081 22306 consensus_peers.cc:597] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.370678 14474 tablet_replica.cc:333] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
W20260709 13:09:46.372897 22158 consensus_peers.cc:597] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.373700 14474 raft_consensus.cc:2243] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.374998 14474 raft_consensus.cc:2272] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.377902 22158 consensus_peers.cc:597] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.378626 14474 tablet_replica.cc:333] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.379706 14474 raft_consensus.cc:2243] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.380348 14474 raft_consensus.cc:2272] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.384585 22306 consensus_peers.cc:597] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.387727 14474 tablet_replica.cc:333] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.389784 14474 raft_consensus.cc:2243] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.390956 14474 raft_consensus.cc:2272] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.394170 14474 tablet_replica.cc:333] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.395339 14474 raft_consensus.cc:2243] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.396011 14474 raft_consensus.cc:2272] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.399102 14474 tablet_replica.cc:333] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.399767 14474 raft_consensus.cc:2243] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.400691 14474 raft_consensus.cc:2272] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.403546 14474 tablet_replica.cc:333] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.404469 14474 raft_consensus.cc:2243] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.405575 14474 raft_consensus.cc:2272] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.409153 14474 tablet_replica.cc:333] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: stopping tablet replica
W20260709 13:09:46.410127 22232 consensus_peers.cc:597] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.411761 14474 raft_consensus.cc:2243] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.413687 14474 raft_consensus.cc:2272] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.418323 14474 tablet_replica.cc:333] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.419193 14474 raft_consensus.cc:2243] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.420008 14474 raft_consensus.cc:2272] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.422993 22232 consensus_peers.cc:597] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.423636 14474 tablet_replica.cc:333] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.424775 14474 raft_consensus.cc:2243] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.425462 14474 raft_consensus.cc:2272] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.428869 14474 tablet_replica.cc:333] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.432276 14474 raft_consensus.cc:2243] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.433480 14474 raft_consensus.cc:2272] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.434126 22158 consensus_peers.cc:597] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.436797 14474 tablet_replica.cc:333] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.437764 14474 raft_consensus.cc:2243] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.438424 14474 raft_consensus.cc:2272] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.441656 14474 tablet_replica.cc:333] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.442752 14474 raft_consensus.cc:2243] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.443380 14474 raft_consensus.cc:2272] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.447090 14474 tablet_replica.cc:333] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.448037 14474 raft_consensus.cc:2243] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.448642 14474 raft_consensus.cc:2272] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.453012 22232 consensus_peers.cc:597] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.455468 14474 tablet_replica.cc:333] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.456466 14474 raft_consensus.cc:2243] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.457683 14474 raft_consensus.cc:2272] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.461486 14474 tablet_replica.cc:333] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.462291 14474 raft_consensus.cc:2243] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.462858 14474 raft_consensus.cc:2272] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.466125 14474 tablet_replica.cc:333] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.467557 14474 raft_consensus.cc:2243] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.468154 14474 raft_consensus.cc:2272] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.471371 14474 tablet_replica.cc:333] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.472216 14474 raft_consensus.cc:2243] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.472848 14474 raft_consensus.cc:2272] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.476135 14474 tablet_replica.cc:333] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.477092 14474 raft_consensus.cc:2243] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.477756 14474 raft_consensus.cc:2272] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.481308 14474 tablet_replica.cc:333] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.482223 14474 raft_consensus.cc:2243] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.483366 14474 raft_consensus.cc:2272] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.492769 22232 consensus_peers.cc:597] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.493443 14474 tablet_replica.cc:333] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.494376 14474 raft_consensus.cc:2243] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.495460 14474 raft_consensus.cc:2272] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.498998 14474 tablet_replica.cc:333] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.499871 14474 raft_consensus.cc:2243] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.500401 14474 raft_consensus.cc:2272] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.503278 14474 tablet_replica.cc:333] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.504112 14474 raft_consensus.cc:2243] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.505338 14474 raft_consensus.cc:2272] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.511061 14474 tablet_replica.cc:333] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.511849 14474 raft_consensus.cc:2243] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.512910 14474 raft_consensus.cc:2272] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.513725 22158 consensus_peers.cc:597] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.515498 14474 tablet_replica.cc:333] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.516203 14474 raft_consensus.cc:2243] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.516709 14474 raft_consensus.cc:2272] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.520655 14474 tablet_replica.cc:333] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.521517 14474 raft_consensus.cc:2243] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.522107 14474 raft_consensus.cc:2272] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.524992 14474 tablet_replica.cc:333] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.525729 14474 raft_consensus.cc:2243] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.526294 14474 raft_consensus.cc:2272] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.527760 22158 consensus_peers.cc:597] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.529107 14474 tablet_replica.cc:333] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.530045 14474 raft_consensus.cc:2243] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.530674 14474 raft_consensus.cc:2272] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.533721 14474 tablet_replica.cc:333] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.534737 14474 raft_consensus.cc:2243] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.535396 14474 raft_consensus.cc:2272] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.538275 14474 tablet_replica.cc:333] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.542757 14474 raft_consensus.cc:2243] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.543665 14474 raft_consensus.cc:2272] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.552291 14474 tablet_replica.cc:333] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
W20260709 13:09:46.552903 22158 consensus_peers.cc:597] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.553229 14474 raft_consensus.cc:2243] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.555816 14474 raft_consensus.cc:2272] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.556329 22306 consensus_peers.cc:597] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.559453 14474 tablet_replica.cc:333] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.560309 14474 raft_consensus.cc:2243] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.561450 14474 raft_consensus.cc:2272] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.564456 14474 tablet_replica.cc:333] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.565335 14474 raft_consensus.cc:2243] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.566071 14474 raft_consensus.cc:2272] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.569747 14474 tablet_replica.cc:333] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.570601 14474 raft_consensus.cc:2243] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.571962 14474 raft_consensus.cc:2272] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.575516 14474 tablet_replica.cc:333] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.576570 14474 raft_consensus.cc:2243] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.577242 14474 raft_consensus.cc:2272] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.580562 14474 tablet_replica.cc:333] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.581394 14474 raft_consensus.cc:2243] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.582038 14474 raft_consensus.cc:2272] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.584959 14474 tablet_replica.cc:333] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.585716 14474 raft_consensus.cc:2243] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.586313 14474 raft_consensus.cc:2272] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.589232 14474 tablet_replica.cc:333] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.590009 14474 raft_consensus.cc:2243] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.590674 14474 raft_consensus.cc:2272] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.594151 14474 tablet_replica.cc:333] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.594942 14474 raft_consensus.cc:2243] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.595574 14474 raft_consensus.cc:2272] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.598641 14474 tablet_replica.cc:333] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.599406 14474 raft_consensus.cc:2243] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.600019 14474 raft_consensus.cc:2272] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.602924 14474 tablet_replica.cc:333] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: stopping tablet replica
I20260709 13:09:46.603652 14474 raft_consensus.cc:2243] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.604899 14474 raft_consensus.cc:2272] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.624660 22158 consensus_peers.cc:597] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.633662 22232 consensus_peers.cc:597] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.649567 22306 consensus_peers.cc:597] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.669286 22158 consensus_peers.cc:597] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.673282 22158 consensus_peers.cc:597] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.698225 22083 connection.cc:466] server connection from 127.0.0.1:40268 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40268 (request call id 225) could send its response
W20260709 13:09:46.709956 22232 connection.cc:769] client connection to 127.14.34.129:33489 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:09:46.712494 22232 consensus_peers.cc:597] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.719602 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
W20260709 13:09:46.937387 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 49532.2us
I20260709 13:09:47.027148 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:47.080266 22926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:47.089890 22927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:47.094071 22929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.094183 14474 server_base.cc:1061] running on GCE node
I20260709 13:09:47.096268 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:47.096613 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:47.096863 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602587096844 us; error 0 us; skew 500 ppm
I20260709 13:09:47.097832 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:47.102363 14474 webserver.cc:533] Webserver started at http://127.14.34.129:44475/ using document root <none> and password file <none>
I20260709 13:09:47.103152 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:47.103479 14474 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:47.111083 14474 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:47.130154 22934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.131310 14474 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:09:47.131794 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "17194feb726e4445801d2097dd68067d"
format_stamp: "Formatted at 2026-07-09 13:09:32 on dist-test-slave-nr1f"
I20260709 13:09:47.132424 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:47.210098 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:47.220806 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:47.230084 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:47.246156 22941 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:09:47.476503 22840 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.477252 22840 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.488000 22846 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.489492 22922 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.490183 22922 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.488730 22846 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.502014 22922 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.502724 22846 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.521596 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.525498 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:47.526396 22261 raft_consensus.cc:2468] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.528098 22157 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.530076 22925 raft_consensus.cc:2804] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.530565 22925 raft_consensus.cc:493] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.530990 22925 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.540850 22923 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.540755 22925 raft_consensus.cc:515] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.541554 22923 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.544839 22923 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.558771 22333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.559530 22333 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
W20260709 13:09:47.560655 22306 leader_election.cc:336] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.561151 22306 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:47.561744 22886 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.562356 22886 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.566311 22917 raft_consensus.cc:2749] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.567814 22886 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.570181 22155 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:47.570582 22925 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.571084 22785 raft_consensus.cc:2804] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.571556 22785 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.571942 22785 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.581921 22306 leader_election.cc:336] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.583984 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:47.584877 22261 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.593353 22840 leader_election.cc:290] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.595077 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c183a828104c4ec7bb186876a7fcf7d8" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.596204 22188 raft_consensus.cc:2393] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:47.611616 22846 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.612365 22846 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.613746 22917 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.614537 22917 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.616906 22917 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.613415 22886 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.617981 22886 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.620188 22840 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.626236 22886 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.674386 22840 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:47.644781 22232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 44767us
I20260709 13:09:47.662223 22925 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
W20260709 13:09:47.663295 22306 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.675539 22925 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:47.675896 22306 leader_election.cc:336] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.672500 22846 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.639696 22785 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.674926 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.677625 22925 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.679536 22922 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.680371 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.680213 22922 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.681039 22190 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:47.681427 22841 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.682067 22841 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.684533 22841 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.685217 22846 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.685882 22840 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.685765 22846 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.688308 22846 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.690018 22922 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.691468 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:47.692171 22262 raft_consensus.cc:2468] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:47.693431 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
W20260709 13:09:47.693704 22232 leader_election.cc:336] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.694089 22190 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:47.694185 22232 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:47.695129 22925 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.695644 22925 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.701285 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:47.701993 22262 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.703785 22157 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.704593 22840 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.704747 22925 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.705211 22840 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.705787 22840 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.707417 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.708462 22943 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.708989 22943 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.711959 22943 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.713286 22305 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:47.714339 22944 raft_consensus.cc:2804] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.714627 22886 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.715481 22886 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.714835 22944 raft_consensus.cc:493] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.716447 22944 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.717819 22886 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.722003 22840 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.728470 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.729048 22188 raft_consensus.cc:2393] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
W20260709 13:09:47.729547 22232 leader_election.cc:336] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.730239 22232 leader_election.cc:336] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.731529 22306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 46592us
I20260709 13:09:47.733743 22840 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.724509 22785 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.732762 22944 raft_consensus.cc:515] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.732743 22232 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:47.734849 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:47.737272 22262 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.738849 22944 leader_election.cc:290] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.744801 22262 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:47.745421 22785 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.745934 22944 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.746136 22785 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.746578 22944 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.748961 22785 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:47.749583 22158 leader_election.cc:336] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.749648 22944 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.754148 22943 raft_consensus.cc:2749] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.751366 22157 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.752653 22333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.755060 22333 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.753813 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.753029 22339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:47.755648 22785 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.755831 22338 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.756080 22339 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.756471 22785 raft_consensus.cc:697] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:47.759362 22840 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.757506 22785 consensus_queue.cc:237] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.760069 22840 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.762905 22840 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:47.758816 22158 leader_election.cc:336] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.763630 22158 leader_election.cc:336] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.764137 22339 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:47.764786 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:47.768793 22266 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.768905 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.769660 22336 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.770747 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.764998 22263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:47.774945 22155 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:47.775755 22840 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.776160 22840 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.776566 22840 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.777366 22266 raft_consensus.cc:2468] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:09:47.779039 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32223739e62f42aeb7edc9209035b260" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.754153 22261 raft_consensus.cc:2468] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
W20260709 13:09:47.766434 22232 leader_election.cc:336] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.779956 22336 raft_consensus.cc:2393] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1c2f73661f4fd28f53d294057790cb in current term 2: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:47.779877 22922 raft_consensus.cc:2749] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.780135 22232 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:47.781281 22922 raft_consensus.cc:2749] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.783288 22922 raft_consensus.cc:493] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.783792 22922 raft_consensus.cc:515] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.776152 22155 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:47.785238 22157 leader_election.cc:304] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:47.785643 22155 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:47.786981 22925 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.787237 22922 leader_election.cc:290] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.787410 22925 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.787892 22925 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.790616 22947 raft_consensus.cc:2804] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.790827 22923 raft_consensus.cc:2804] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.791256 22947 raft_consensus.cc:697] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:47.791402 22923 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.791926 22923 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.793476 22305 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.794610 22846 raft_consensus.cc:2804] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.799145 22846 raft_consensus.cc:697] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:47.800274 22846 consensus_queue.cc:237] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:47.802181 22232 leader_election.cc:336] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.810488 22306 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.814807 22947 consensus_queue.cc:237] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.815985 22840 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.822063 22946 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.821859 22923 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.822865 22946 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.824190 22923 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.825027 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:47.826726 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:09:47.830555 22922 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.831171 22922 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.833348 22922 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.833952 14474 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:47.810747 22925 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.842607 22229 leader_election.cc:304] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:47.827124 22840 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.848029 22925 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.851222 22306 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:47.852497 22306 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:47.857090 22942 raft_consensus.cc:2749] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.858460 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.863600 22011 catalog_manager.cc:5697] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 2 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.855406 22917 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.867638 22917 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.868214 22917 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.853066 22922 raft_consensus.cc:2749] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.862768 22840 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.875403 22840 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:47.876075 22232 leader_election.cc:336] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.850553 22923 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.877100 22923 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.878573 22840 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.878952 22946 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.873365 22942 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.883443 22942 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.884785 22923 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.880412 22155 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:47.889561 22925 raft_consensus.cc:2804] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.890146 22925 raft_consensus.cc:697] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:47.892545 22925 consensus_queue.cc:237] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.895219 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.896512 22188 raft_consensus.cc:2393] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:47.885782 22942 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.899976 22941 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:47.901036 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:47.907502 22306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 54221.2us
W20260709 13:09:47.907918 22158 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.908643 22306 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
W20260709 13:09:47.908869 22158 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.907053 22886 raft_consensus.cc:493] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.914394 22846 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.914552 22886 raft_consensus.cc:515] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:47.915001 22846 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.915477 22846 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.916743 22886 leader_election.cc:290] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.902019 22261 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.905903 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.918810 22186 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
W20260709 13:09:47.909745 22306 leader_election.cc:336] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.920560 22306 leader_election.cc:336] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.921286 22306 leader_election.cc:336] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.909790 22158 leader_election.cc:336] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.922004 22306 leader_election.cc:336] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.922809 22306 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
W20260709 13:09:47.922331 22158 leader_election.cc:336] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.922358 22157 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.924643 22951 raft_consensus.cc:2804] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.925257 22951 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
W20260709 13:09:47.925448 22158 leader_election.cc:336] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.925647 22951 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.926299 22158 leader_election.cc:336] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:47.928043 22158 leader_election.cc:336] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:47.928488 22158 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:47.929426 22948 raft_consensus.cc:2749] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.930925 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:47.931634 22261 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:47.936025 22229 leader_election.cc:304] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:47.940286 22305 leader_election.cc:304] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:47.943583 22952 raft_consensus.cc:2804] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.944411 22952 raft_consensus.cc:493] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.944839 22952 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.945195 22944 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.945752 22944 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.937067 22886 raft_consensus.cc:2749] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.947275 22948 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.947860 22948 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.950744 22917 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:47.951887 22948 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:47.952941 22917 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:47.952803 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:47.941897 22922 raft_consensus.cc:2749] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.954131 22332 raft_consensus.cc:2393] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 2: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:47.991238 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:47.992018 22186 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:47.983677 22948 raft_consensus.cc:493] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:47.994397 22948 raft_consensus.cc:515] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:47.995779 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.996496 22331 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 1.
I20260709 13:09:47.996753 22948 leader_election.cc:290] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.998159 22336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.998870 22336 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.999140 22333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:47.999790 22333 raft_consensus.cc:2468] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:47.983341 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:47.987038 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:48.002046 22332 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.994102 22335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:48.006755 22335 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
W20260709 13:09:48.006119 22158 leader_election.cc:336] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.010628 22158 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.012981 22155 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
W20260709 13:09:48.011626 22158 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.014295 22158 leader_election.cc:336] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.016676 22229 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
W20260709 13:09:48.017025 22158 leader_election.cc:336] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.017688 22158 leader_election.cc:336] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.020123 22306 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:48.027086 22155 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:47.990065 22944 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:48.032770 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:48.024415 22816 raft_consensus.cc:2804] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.034178 22816 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.034103 22846 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.034816 22816 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.035070 22785 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.035506 22785 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.035900 22785 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.036340 22846 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:48.014565 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:48.037179 22338 raft_consensus.cc:2393] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 2: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:48.037446 22261 raft_consensus.cc:2468] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:48.032223 22155 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:48.032847 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:48.038599 22950 raft_consensus.cc:2804] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.038898 22191 raft_consensus.cc:2468] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:48.039043 22950 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.024444 22947 raft_consensus.cc:2749] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.039600 22950 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.039623 22951 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.042300 22186 raft_consensus.cc:2393] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:48.043545 22951 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:47.959843 22952 raft_consensus.cc:515] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:48.048050 22952 leader_election.cc:290] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:48.059333 22158 leader_election.cc:336] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.069141 22229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 49836.3us
I20260709 13:09:48.074337 22157 leader_election.cc:304] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.075240 22951 raft_consensus.cc:2804] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.075726 22951 raft_consensus.cc:493] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.076150 22951 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.079874 22306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 54806.1us
I20260709 13:09:48.078722 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:48.080538 22306 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.081171 22261 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.081387 22952 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.081852 22952 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.082239 22952 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.085232 22816 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:48.085371 22785 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.088613 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8819d5105462fadf17a4783b64e02" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:48.089676 22785 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:48.090301 22266 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.090906 22306 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:48.091648 22306 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:48.099082 22266 raft_consensus.cc:2468] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
W20260709 13:09:48.099599 22158 leader_election.cc:336] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.100760 22305 leader_election.cc:304] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
W20260709 13:09:48.101068 22306 leader_election.cc:336] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.101724 22306 leader_election.cc:336] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.104506 22155 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.105571 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:48.106423 22191 raft_consensus.cc:2393] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:48.107290 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:48.103579 22846 raft_consensus.cc:2804] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.109517 22846 raft_consensus.cc:697] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:48.094156 22917 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.111438 22155 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:48.111836 22917 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.112238 22917 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.112661 22948 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.113058 22948 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.113397 22948 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.118194 22923 raft_consensus.cc:2749] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.110435 22846 consensus_queue.cc:237] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:48.118597 22261 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:48.102911 22944 raft_consensus.cc:2804] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.120656 22944 raft_consensus.cc:493] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:09:48.121153 22944 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.123432 22157 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:48.124418 22946 raft_consensus.cc:2804] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.124904 22946 raft_consensus.cc:697] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:48.125746 22946 consensus_queue.cc:237] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:48.129766 22158 leader_election.cc:336] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.131083 22012 catalog_manager.cc:5697] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.138149 22012 catalog_manager.cc:5697] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.148092 22816 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:48.148916 22948 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.159173 22941 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.160171 22941 tablet_bootstrap.cc:492] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.160809 22941 ts_tablet_manager.cc:1403] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.261s	user 0.025s	sys 0.004s
I20260709 13:09:48.162804 22950 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:48.163447 22232 leader_election.cc:336] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.164477 22158 leader_election.cc:336] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.164968 22950 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:48.157845 22332 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:48.167037 22942 raft_consensus.cc:2749] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:48.171039 22158 leader_election.cc:336] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.175252 22941 raft_consensus.cc:359] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.175880 22941 raft_consensus.cc:740] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
W20260709 13:09:48.176498 22306 leader_election.cc:336] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.181524 22917 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.183539 22948 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:48.183812 22917 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:48.176266 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:48.176731 22941 consensus_queue.cc:260] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.185657 22332 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.143352 22952 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:48.181480 22306 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.186652 22306 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
W20260709 13:09:48.187881 22306 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.190773 22306 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:48.202188 22886 raft_consensus.cc:2749] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.204097 22944 raft_consensus.cc:515] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.207916 22332 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 2.
I20260709 13:09:48.213171 22941 ts_tablet_manager.cc:1434] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:09:48.214555 22941 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:48.236523 22229 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 17194feb726e4445801d2097dd68067d
W20260709 13:09:48.239130 22155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.132:36873, user_credentials={real_user=slave}} blocked reactor thread for 109163us
I20260709 13:09:48.243001 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:48.243844 22186 raft_consensus.cc:2393] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:48.210264 22917 raft_consensus.cc:2749] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.243057 22337 raft_consensus.cc:2393] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 2: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:48.234550 22951 raft_consensus.cc:515] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.248746 22951 leader_election.cc:290] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:48.242533 22922 raft_consensus.cc:2804] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.250057 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f66b966ecab4e0292876583bb462dcc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:09:48.250283 22922 raft_consensus.cc:697] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:09:48.250700 22261 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.251214 22922 consensus_queue.cc:237] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
W20260709 13:09:48.256157 22158 leader_election.cc:336] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.257020 22266 raft_consensus.cc:1275] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.258436 22261 raft_consensus.cc:2468] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:48.261704 22944 leader_election.cc:290] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:48.259578 22157 leader_election.cc:304] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:09:48.262370 22942 consensus_queue.cc:1048] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.263895 22925 raft_consensus.cc:2804] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.264400 22925 raft_consensus.cc:697] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:48.265285 22925 consensus_queue.cc:237] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:48.268378 22158 consensus_peers.cc:597] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.268793 22158 leader_election.cc:336] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:48.278573 22306 leader_election.cc:336] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.290225 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6d7c28c00b4ce7ac2826c1959ada78" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:48.291074 22186 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.289915 22306 leader_election.cc:336] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.295042 22306 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:48.295774 22952 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
W20260709 13:09:48.302634 22306 leader_election.cc:336] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.304026 22886 raft_consensus.cc:2749] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.312218 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:48.313145 22191 raft_consensus.cc:2393] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 2: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:48.320323 22155 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.311349 22011 catalog_manager.cc:5697] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 2 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.321316 22947 raft_consensus.cc:2804] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.321929 22947 raft_consensus.cc:697] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:48.322919 22947 consensus_queue.cc:237] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
W20260709 13:09:48.331816 22306 leader_election.cc:336] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:48.341037 22155 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:48.343531 22946 raft_consensus.cc:2749] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.348340 22186 raft_consensus.cc:2468] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:09:48.355444 22941 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.356580 22941 tablet_bootstrap.cc:492] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.333652 22306 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:48.358103 22886 raft_consensus.cc:2749] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.360278 22011 catalog_manager.cc:5697] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 2 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.361493 22334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:48.365617 22334 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.362326 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:48.370242 22337 raft_consensus.cc:2393] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 2: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:48.375818 22334 raft_consensus.cc:2468] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:48.384805 22010 catalog_manager.cc:5697] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.386771 22010 catalog_manager.cc:5697] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.357295 22941 ts_tablet_manager.cc:1403] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.005s
I20260709 13:09:48.389129 22010 catalog_manager.cc:5697] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.391811 22941 raft_consensus.cc:359] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.392585 22941 raft_consensus.cc:740] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.393325 22941 consensus_queue.cc:260] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.396384 22306 leader_election.cc:304] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.397996 22965 raft_consensus.cc:2804] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.398376 22155 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:48.398787 22965 raft_consensus.cc:697] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:48.399233 22925 raft_consensus.cc:2749] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.399962 22965 consensus_queue.cc:237] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.400552 22155 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:48.401387 22925 raft_consensus.cc:2804] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.401914 22925 raft_consensus.cc:697] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:48.402809 22925 consensus_queue.cc:237] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.391736 22010 catalog_manager.cc:5697] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.409188 22266 raft_consensus.cc:1275] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.410625 22947 consensus_queue.cc:1048] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.419901 22261 raft_consensus.cc:1275] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.422610 22925 consensus_queue.cc:1048] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.446552 22941 ts_tablet_manager.cc:1434] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:09:48.447516 22941 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:48.449244 22012 catalog_manager.cc:5697] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.452174 22306 consensus_peers.cc:597] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.502553 22337 raft_consensus.cc:1275] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:48.506090 22158 consensus_peers.cc:597] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.531490 22946 consensus_queue.cc:1048] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.575091 22011 catalog_manager.cc:5697] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 2, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 2 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.588387 22263 raft_consensus.cc:1275] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:48.597707 22158 consensus_peers.cc:597] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.601060 22886 consensus_queue.cc:1048] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:48.604475 22158 consensus_peers.cc:597] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.638309 22232 consensus_peers.cc:597] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.608121 22941 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.639998 22941 tablet_bootstrap.cc:492] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.644090 14474 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:48.645967 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.812s	user 0.277s	sys 0.029s
I20260709 13:09:48.649936 22941 ts_tablet_manager.cc:1403] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.203s	user 0.039s	sys 0.004s
W20260709 13:09:48.651120 22232 consensus_peers.cc:597] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.656872 22941 raft_consensus.cc:359] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.666457 22941 raft_consensus.cc:740] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.667176 22941 consensus_queue.cc:260] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.669708 22941 ts_tablet_manager.cc:1434] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:48.670485 22941 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:48.678891 22306 consensus_peers.cc:597] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.705375 22941 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.706362 22941 tablet_bootstrap.cc:492] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.707019 22941 ts_tablet_manager.cc:1403] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.011s
I20260709 13:09:48.710625 22941 raft_consensus.cc:359] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.712205 22941 raft_consensus.cc:740] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.712926 22941 consensus_queue.cc:260] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.716570 22941 ts_tablet_manager.cc:1434] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:48.717235 22941 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:48.740079 22941 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.741098 22941 tablet_bootstrap.cc:492] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.741758 22941 ts_tablet_manager.cc:1403] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:09:48.744396 22941 raft_consensus.cc:359] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.745146 22941 raft_consensus.cc:740] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.746778 22941 consensus_queue.cc:260] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:48.749111 22941 ts_tablet_manager.cc:1434] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:48.749954 22941 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:48.755584 22266 raft_consensus.cc:1275] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.761968 22946 consensus_queue.cc:1048] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:48.778273 22263 raft_consensus.cc:1275] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.781615 22946 consensus_queue.cc:1048] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:48.850018 22158 consensus_peers.cc:597] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.872748 22334 raft_consensus.cc:1275] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer ca1c2f73661f4fd28f53d294057790cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.890116 22941 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.891281 22941 tablet_bootstrap.cc:492] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.892058 22941 ts_tablet_manager.cc:1403] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.142s	user 0.024s	sys 0.011s
I20260709 13:09:48.894583 22941 raft_consensus.cc:359] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:48.895172 22941 raft_consensus.cc:740] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.904803 22941 consensus_queue.cc:260] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:48.915513 22941 ts_tablet_manager.cc:1434] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:48.916406 22941 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:48.941614 22158 consensus_peers.cc:597] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.942263 22158 consensus_peers.cc:597] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.943920 22158 consensus_peers.cc:597] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.944516 22158 consensus_peers.cc:597] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.961123 22188 raft_consensus.cc:1275] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.964473 22922 consensus_queue.cc:1048] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.969624 22941 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.970809 22941 tablet_bootstrap.cc:492] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:48.971529 22941 ts_tablet_manager.cc:1403] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.000s
I20260709 13:09:48.974344 22941 raft_consensus.cc:359] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.975104 22941 raft_consensus.cc:740] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
W20260709 13:09:48.976817 22158 consensus_peers.cc:597] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.976699 22941 consensus_queue.cc:260] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:48.979147 22941 ts_tablet_manager.cc:1434] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:48.980165 22941 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:48.991637 22965 consensus_queue.cc:1048] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.994752 22334 raft_consensus.cc:1275] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:48.996088 22232 consensus_peers.cc:597] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.996806 22232 consensus_peers.cc:597] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.005613 22158 consensus_peers.cc:597] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.005640 22232 consensus_peers.cc:597] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.026894 22941 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.037549 22941 tablet_bootstrap.cc:492] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.038411 22941 ts_tablet_manager.cc:1403] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.019s
I20260709 13:09:49.041152 22941 raft_consensus.cc:359] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.043982 22941 raft_consensus.cc:740] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.044947 22941 consensus_queue.cc:260] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.047178 22941 ts_tablet_manager.cc:1434] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:49.048004 22941 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:49.053220 22158 consensus_peers.cc:597] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.055371 22306 consensus_peers.cc:597] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.071735 22941 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.073005 22941 tablet_bootstrap.cc:492] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.073778 22941 ts_tablet_manager.cc:1403] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:09:49.075650 22925 consensus_queue.cc:1048] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.076592 22941 raft_consensus.cc:359] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.077488 22941 raft_consensus.cc:740] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.078444 22941 consensus_queue.cc:260] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.080868 22941 ts_tablet_manager.cc:1434] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:49.081766 22941 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.111089 22941 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.112219 22941 tablet_bootstrap.cc:492] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.112952 22941 ts_tablet_manager.cc:1403] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.017s
I20260709 13:09:49.115679 22941 raft_consensus.cc:359] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.116415 22941 raft_consensus.cc:740] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.117317 22941 consensus_queue.cc:260] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.120306 22941 ts_tablet_manager.cc:1434] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:49.121260 22941 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:49.122803 22232 consensus_peers.cc:597] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.152662 22232 consensus_peers.cc:597] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.153401 22232 consensus_peers.cc:597] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.159742 22334 raft_consensus.cc:1275] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.173404 22941 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.174724 22941 tablet_bootstrap.cc:492] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.175491 22941 ts_tablet_manager.cc:1403] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.007s
W20260709 13:09:49.194967 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 45145.4us
I20260709 13:09:49.178520 22941 raft_consensus.cc:359] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.196039 22941 raft_consensus.cc:740] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
W20260709 13:09:49.196839 22158 consensus_peers.cc:597] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.196976 22941 consensus_queue.cc:260] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.203249 22941 ts_tablet_manager.cc:1434] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:49.205976 22941 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:49.213246 22306 consensus_peers.cc:597] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.250001 22158 consensus_peers.cc:597] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.250584 22158 consensus_peers.cc:597] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.253643 22158 consensus_peers.cc:597] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.257826 22158 consensus_peers.cc:597] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.258448 22232 consensus_peers.cc:597] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.258790 22941 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:49.259814 22306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 46047.4us
I20260709 13:09:49.260000 22941 tablet_bootstrap.cc:492] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.262566 22964 consensus_queue.cc:1048] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:49.273191 22232 consensus_peers.cc:597] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.273788 22232 consensus_peers.cc:597] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.262924 22941 ts_tablet_manager.cc:1403] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.012s
I20260709 13:09:49.282612 22941 raft_consensus.cc:359] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.283505 22941 raft_consensus.cc:740] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.284582 22941 consensus_queue.cc:260] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.287132 22941 ts_tablet_manager.cc:1434] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:49.287967 22941 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.337888 22941 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:49.338853 22306 consensus_peers.cc:597] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.339535 22306 consensus_peers.cc:597] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.338868 22941 tablet_bootstrap.cc:492] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.342598 22941 ts_tablet_manager.cc:1403] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.004s
W20260709 13:09:49.357460 22158 consensus_peers.cc:597] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.359103 22232 consensus_peers.cc:597] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.375780 22158 consensus_peers.cc:597] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.393512 22306 consensus_peers.cc:597] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.395370 22306 consensus_peers.cc:597] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.394229 22158 consensus_peers.cc:597] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.370520 22941 raft_consensus.cc:359] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.414168 22941 raft_consensus.cc:740] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.414955 22941 consensus_queue.cc:260] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.417073 22941 ts_tablet_manager.cc:1434] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.000s
I20260709 13:09:49.417888 22941 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:49.439860 22232 consensus_peers.cc:597] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.488938 22941 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.489982 22941 tablet_bootstrap.cc:492] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.490664 22941 ts_tablet_manager.cc:1403] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.000s
I20260709 13:09:49.496274 22941 raft_consensus.cc:359] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.496989 22941 raft_consensus.cc:740] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.505503 22941 consensus_queue.cc:260] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.507974 22941 ts_tablet_manager.cc:1434] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:49.519008 22941 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.528007 22968 raft_consensus.cc:493] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.528785 22968 raft_consensus.cc:515] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.538611 22968 leader_election.cc:290] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
W20260709 13:09:49.570252 22158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.129:33489, user_credentials={real_user=slave}} blocked reactor thread for 65410us
I20260709 13:09:49.687266 22941 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.688292 22941 tablet_bootstrap.cc:492] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.688923 22941 ts_tablet_manager.cc:1403] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.180s	user 0.036s	sys 0.039s
I20260709 13:09:49.695540 22941 raft_consensus.cc:359] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.696211 22941 raft_consensus.cc:740] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.706287 22941 consensus_queue.cc:260] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.708678 22941 ts_tablet_manager.cc:1434] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:09:49.709479 22941 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.720618 22947 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.721515 22947 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.726233 22947 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:49.744261 22941 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.745290 22941 tablet_bootstrap.cc:492] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.745980 22941 ts_tablet_manager.cc:1403] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.000s
I20260709 13:09:49.752645 22941 raft_consensus.cc:359] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.753358 22941 raft_consensus.cc:740] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.758285 22941 consensus_queue.cc:260] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:49.760653 22941 ts_tablet_manager.cc:1434] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:49.761431 22941 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.792277 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:49.793303 22340 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:49.804342 22155 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:49.805048 22925 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.805498 22925 raft_consensus.cc:493] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.807768 22925 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.817476 22968 raft_consensus.cc:493] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.822508 22968 raft_consensus.cc:515] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.825018 22968 leader_election.cc:290] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:49.835192 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:49.842622 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cceaff14ae1a439093a61fc311090c52" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
W20260709 13:09:49.845052 22158 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:49.836985 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:49.872937 22937 leader_election.cc:304] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:49.874110 22968 raft_consensus.cc:2749] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.884886 22925 raft_consensus.cc:515] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.893453 22925 leader_election.cc:290] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
W20260709 13:09:49.908907 22158 leader_election.cc:336] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:09:49.909472 22306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.130:44021, user_credentials={real_user=slave}} blocked reactor thread for 58075.3us
I20260709 13:09:49.918967 22941 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.919998 22941 tablet_bootstrap.cc:492] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.920672 22941 ts_tablet_manager.cc:1403] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.159s	user 0.023s	sys 0.009s
I20260709 13:09:49.931284 22941 raft_consensus.cc:359] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.932055 22941 raft_consensus.cc:740] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.928165 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40bc6bbf64498894a29949620657cc" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:49.934319 22337 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.937253 22941 consensus_queue.cc:260] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:49.939685 22941 ts_tablet_manager.cc:1434] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 13:09:49.940371 22941 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:49.942360 22964 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.942911 22964 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.949637 22337 raft_consensus.cc:2468] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 3.
I20260709 13:09:49.949290 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:49.952247 22935 leader_election.cc:304] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:49.953763 22968 raft_consensus.cc:2749] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.953715 22964 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:49.956517 22155 leader_election.cc:304] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:49.957763 22951 raft_consensus.cc:2804] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.958304 22951 raft_consensus.cc:697] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
W20260709 13:09:49.960343 22158 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:49.959234 22951 consensus_queue.cc:237] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.971236 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:49.972003 22340 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:49.981973 22968 raft_consensus.cc:493] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.988714 22941 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.988485 22968 raft_consensus.cc:515] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:49.977737 22155 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:49.989714 22964 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.989838 22941 tablet_bootstrap.cc:492] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:49.990676 22968 leader_election.cc:290] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:49.991268 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:49.985772 23072 raft_consensus.cc:493] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.009040 23072 raft_consensus.cc:515] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.012580 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:49.991279 22964 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.998921 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:50.020902 23072 leader_election.cc:290] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:50.020453 22964 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.024663 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcdef153e7447d84951d92004c6594" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:50.025833 22015 catalog_manager.cc:5697] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 3, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.030540 22938 leader_election.cc:304] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:50.031601 23072 raft_consensus.cc:2749] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.031073 22964 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.032646 22938 leader_election.cc:304] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:09:50.033552 23072 raft_consensus.cc:2749] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.035331 22964 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:49.990736 22941 ts_tablet_manager.cc:1403] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.000s
W20260709 13:09:50.041447 22158 leader_election.cc:336] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:09:50.044720 22941 raft_consensus.cc:359] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.045393 22941 raft_consensus.cc:740] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.046119 22941 consensus_queue.cc:260] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.047715 22941 ts_tablet_manager.cc:1434] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:50.048413 22941 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.047485 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:50.049177 22337 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.074765 22337 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 3.
I20260709 13:09:50.075893 22155 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d
I20260709 13:09:50.076692 22925 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.077211 22925 raft_consensus.cc:697] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:50.078130 22925 consensus_queue.cc:237] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.101220 22015 catalog_manager.cc:5697] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 3, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.124056 22941 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.125336 22941 tablet_bootstrap.cc:492] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.127293 22941 ts_tablet_manager.cc:1403] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.008s
I20260709 13:09:50.131729 22941 raft_consensus.cc:359] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.132614 22941 raft_consensus.cc:740] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.133577 22941 consensus_queue.cc:260] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.138310 22941 ts_tablet_manager.cc:1434] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:50.139091 22941 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.170586 22941 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.171804 22941 tablet_bootstrap.cc:492] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.172653 22941 ts_tablet_manager.cc:1403] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.007s
I20260709 13:09:50.176819 22941 raft_consensus.cc:359] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.178296 22941 raft_consensus.cc:740] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.180522 22941 consensus_queue.cc:260] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.184665 22964 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.185320 22964 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.188936 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:50.189592 22337 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:50.192602 22155 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:50.193527 22951 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.193990 22951 raft_consensus.cc:493] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.194417 22951 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.202135 22964 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:50.205544 22941 ts_tablet_manager.cc:1434] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:09:50.213591 22941 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.216516 22951 raft_consensus.cc:515] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.232578 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:33489
I20260709 13:09:50.233060 23087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:33489 every 8 connection(s)
I20260709 13:09:50.234956 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:50.235539 22337 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.247871 22337 raft_consensus.cc:2468] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 3.
I20260709 13:09:50.249356 22155 leader_election.cc:304] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:50.242522 22951 leader_election.cc:290] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:50.252660 22925 raft_consensus.cc:2804] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.259415 22925 raft_consensus.cc:697] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Becoming Leader. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:09:50.260308 22925 consensus_queue.cc:237] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.311304 22941 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.330469 22941 tablet_bootstrap.cc:492] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.331808 22941 ts_tablet_manager.cc:1403] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.019s
I20260709 13:09:50.331298 23066 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.356845 22941 raft_consensus.cc:359] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.357486 22941 raft_consensus.cc:740] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.363322 22941 consensus_queue.cc:260] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.367101 22015 catalog_manager.cc:5697] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 reported cstate change: term changed from 1 to 3, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.377229 22941 ts_tablet_manager.cc:1434] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:09:50.378394 22941 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.345171 23066 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.376055 22948 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.373795 22968 raft_consensus.cc:493] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.390157 23072 raft_consensus.cc:493] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.389966 22948 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.390695 23072 raft_consensus.cc:515] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.390735 22968 raft_consensus.cc:515] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.392684 23072 leader_election.cc:290] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:09:50.392895 22968 leader_election.cc:290] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:09:50.395238 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:50.397064 22337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:50.403680 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" is_pre_election: true
I20260709 13:09:50.407913 22337 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 2.
I20260709 13:09:50.418596 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc58c529b54ba2a96c147ab3fb7c29" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:50.419693 22948 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:50.419831 22266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1c2f73661f4fd28f53d294057790cb" is_pre_election: true
I20260709 13:09:50.423532 22155 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:50.431522 23066 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:50.432081 22937 leader_election.cc:304] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:50.434535 22968 raft_consensus.cc:2749] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.434616 23030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:50.435401 23030 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 1.
I20260709 13:09:50.437068 22935 leader_election.cc:304] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17194feb726e4445801d2097dd68067d; no voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:09:50.438325 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" is_pre_election: true
I20260709 13:09:50.438553 22948 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.439181 22191 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:09:50.439713 23072 raft_consensus.cc:2749] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.439950 22948 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.442246 22948 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.444960 22306 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:09:50.446815 23065 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.455122 23065 raft_consensus.cc:493] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.455487 23065 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.459872 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:50.462445 23030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c812af74344306b9c9ab661cdbb582" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:50.462993 23040 raft_consensus.cc:3060] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.467269 23091 heartbeater.cc:344] Connected to a master server at 127.14.34.190:40037
I20260709 13:09:50.467741 23091 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.468653 23091 heartbeater.cc:507] Master 127.14.34.190:40037 requested a full tablet report, sending...
I20260709 13:09:50.469376 22941 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.472582 22941 tablet_bootstrap.cc:492] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.473474 22941 ts_tablet_manager.cc:1403] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.095s	user 0.023s	sys 0.019s
I20260709 13:09:50.480759 23030 raft_consensus.cc:3060] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.515421 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d" is_pre_election: true
I20260709 13:09:50.516188 23037 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in term 1.
I20260709 13:09:50.520769 23065 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.528961 23065 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 election: Requested vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:09:50.528592 22948 raft_consensus.cc:515] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.515440 22941 raft_consensus.cc:359] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:50.529565 23029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:50.529736 22941 raft_consensus.cc:740] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.530351 23029 raft_consensus.cc:3060] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.531248 22948 leader_election.cc:290] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:50.530730 22941 consensus_queue.cc:260] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
W20260709 13:09:50.530138 22158 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.533162 22941 ts_tablet_manager.cc:1434] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
W20260709 13:09:50.533470 22158 leader_election.cc:343] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.534231 22941 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:50.537680 22158 consensus_peers.cc:597] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.538434 23029 raft_consensus.cc:2468] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 3.
I20260709 13:09:50.539644 22306 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:09:50.540378 23065 raft_consensus.cc:2804] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.540967 23065 raft_consensus.cc:697] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:09:50.541234 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:09:50.541878 22338 raft_consensus.cc:1275] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.542364 23065 consensus_queue.cc:237] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.549408 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:09:50.550338 22191 raft_consensus.cc:2393] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0e42f9dab447d5bc309baaacba2ee7 in current term 3: Already voted for candidate c18d8f94c39d497e8d04a2a2fd7efe28 in this term.
I20260709 13:09:50.554817 22948 consensus_queue.cc:1048] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.562709 22015 catalog_manager.cc:5697] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 3, leader changed from 17194feb726e4445801d2097dd68067d (127.14.34.129) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 3 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.570786 22941 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.571817 22941 tablet_bootstrap.cc:492] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.572486 22941 ts_tablet_manager.cc:1403] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 13:09:50.579509 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffcff5675b2484f92ffac7f3db09d88" candidate_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17194feb726e4445801d2097dd68067d"
I20260709 13:09:50.580281 22340 raft_consensus.cc:1275] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.581629 22964 consensus_queue.cc:1048] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.580394 23037 raft_consensus.cc:2393] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c18d8f94c39d497e8d04a2a2fd7efe28 in current term 3: Already voted for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in this term.
I20260709 13:09:50.584578 22941 raft_consensus.cc:359] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.587328 22941 raft_consensus.cc:740] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.590116 22158 leader_election.cc:304] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:09:50.591933 23037 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.592478 23093 raft_consensus.cc:2749] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.593504 22941 consensus_queue.cc:260] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.598582 22941 ts_tablet_manager.cc:1434] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:09:50.599654 22941 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:50.655751 22158 consensus_peers.cc:597] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.660679 23040 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.676666 22015 ts_manager.cc:194] Re-registered known tserver with Master: 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:09:50.668458 22941 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.686913 22941 tablet_bootstrap.cc:492] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.687588 22941 ts_tablet_manager.cc:1403] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.088s	user 0.030s	sys 0.015s
I20260709 13:09:50.701202 22941 raft_consensus.cc:359] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.702175 22941 raft_consensus.cc:740] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.703357 22941 consensus_queue.cc:260] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.708845 22337 raft_consensus.cc:1275] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.711684 22964 consensus_queue.cc:1048] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.718900 22941 ts_tablet_manager.cc:1434] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:09:50.720566 22941 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.721854 23040 raft_consensus.cc:1275] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Refusing update from remote peer c18d8f94c39d497e8d04a2a2fd7efe28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.761541 23094 consensus_queue.cc:1048] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:50.826722 22015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57740
I20260709 13:09:50.832412 23091 heartbeater.cc:499] Master 127.14.34.190:40037 was elected leader, sending a full tablet report...
I20260709 13:09:50.834482 22941 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.835494 22941 tablet_bootstrap.cc:492] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.836112 22941 ts_tablet_manager.cc:1403] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.030s
I20260709 13:09:50.879168 22941 raft_consensus.cc:359] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.885354 22941 raft_consensus.cc:740] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.886237 22941 consensus_queue.cc:260] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:50.889406 22941 ts_tablet_manager.cc:1434] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:09:50.890877 22941 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:50.936669 23029 raft_consensus.cc:3060] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.955981 22941 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.957079 22941 tablet_bootstrap.cc:492] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:50.957806 22941 ts_tablet_manager.cc:1403] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.006s
I20260709 13:09:50.965126 22941 raft_consensus.cc:359] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.966465 22941 raft_consensus.cc:740] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.970489 22941 consensus_queue.cc:260] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:50.978674 22941 ts_tablet_manager.cc:1434] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:50.979734 22941 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:51.008214 22306 consensus_peers.cc:597] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:51.017617 22941 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.018908 22941 tablet_bootstrap.cc:492] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.020665 22941 ts_tablet_manager.cc:1403] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.011s
I20260709 13:09:51.029112 22941 raft_consensus.cc:359] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.030064 22941 raft_consensus.cc:740] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.030905 22941 consensus_queue.cc:260] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.033463 22941 ts_tablet_manager.cc:1434] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:51.034652 22941 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.059924 23029 raft_consensus.cc:1275] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:51.064088 22941 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.065300 22941 tablet_bootstrap.cc:492] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.066104 22941 ts_tablet_manager.cc:1403] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.010s
I20260709 13:09:51.068184 23033 consensus_queue.cc:1048] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.069162 22941 raft_consensus.cc:359] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.070564 22941 raft_consensus.cc:740] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.071396 22941 consensus_queue.cc:260] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.074208 22941 ts_tablet_manager.cc:1434] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:51.075079 22941 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:51.092989 22158 consensus_peers.cc:597] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:51.100517 22191 raft_consensus.cc:1275] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:51.110966 23065 consensus_queue.cc:1048] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.211109 22941 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.212345 22941 tablet_bootstrap.cc:492] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.213152 22941 ts_tablet_manager.cc:1403] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.009s
I20260709 13:09:51.216163 22941 raft_consensus.cc:359] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.217003 22941 raft_consensus.cc:740] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.217826 22941 consensus_queue.cc:260] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.259469 23040 raft_consensus.cc:3060] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.262302 22941 ts_tablet_manager.cc:1434] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:09:51.320525 22941 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.347462 22941 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.348628 22941 tablet_bootstrap.cc:492] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.349416 22941 ts_tablet_manager.cc:1403] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
I20260709 13:09:51.352111 22941 raft_consensus.cc:359] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.352859 22941 raft_consensus.cc:740] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.353688 22941 consensus_queue.cc:260] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.357600 22941 ts_tablet_manager.cc:1434] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:51.358464 22941 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.401515 22941 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.402549 22941 tablet_bootstrap.cc:492] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.404825 22941 ts_tablet_manager.cc:1403] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.010s
I20260709 13:09:51.407511 22941 raft_consensus.cc:359] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.408265 22941 raft_consensus.cc:740] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.409029 22941 consensus_queue.cc:260] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.413785 22941 ts_tablet_manager.cc:1434] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:51.415259 22941 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.452301 23040 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.456681 22941 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.458918 22941 tablet_bootstrap.cc:492] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.459735 22941 ts_tablet_manager.cc:1403] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.005s
I20260709 13:09:51.467691 22941 raft_consensus.cc:359] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.468725 22941 raft_consensus.cc:740] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.469749 22941 consensus_queue.cc:260] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.472793 22941 ts_tablet_manager.cc:1434] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:51.473812 22941 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:51.504142 22158 consensus_peers.cc:597] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:51.516644 22158 consensus_peers.cc:597] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:51.531280 22941 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.532511 22941 tablet_bootstrap.cc:492] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.533311 22941 ts_tablet_manager.cc:1403] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.009s
I20260709 13:09:51.536073 22941 raft_consensus.cc:359] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.536896 22941 raft_consensus.cc:740] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.537717 22941 consensus_queue.cc:260] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.539921 22941 ts_tablet_manager.cc:1434] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:09:51.541338 22941 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:51.573190 22306 consensus_peers.cc:597] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:51.589399 22941 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.590633 22941 tablet_bootstrap.cc:492] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.591413 22941 ts_tablet_manager.cc:1403] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.012s
I20260709 13:09:51.594278 22941 raft_consensus.cc:359] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.595049 22941 raft_consensus.cc:740] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.595834 22941 consensus_queue.cc:260] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.598239 22941 ts_tablet_manager.cc:1434] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:51.599131 22941 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
W20260709 13:09:51.612778 22158 consensus_peers.cc:597] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:51.629549 22158 consensus_peers.cc:597] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:51.665580 22941 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.667129 22941 tablet_bootstrap.cc:492] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.668113 22941 ts_tablet_manager.cc:1403] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.005s
I20260709 13:09:51.671296 22941 raft_consensus.cc:359] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.672075 22941 raft_consensus.cc:740] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.672809 22941 consensus_queue.cc:260] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.684579 22941 ts_tablet_manager.cc:1434] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:51.685612 22941 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.715257 23040 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.736634 22941 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.737849 22941 tablet_bootstrap.cc:492] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.739142 22941 ts_tablet_manager.cc:1403] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.003s
I20260709 13:09:51.741842 22941 raft_consensus.cc:359] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.747571 22941 raft_consensus.cc:740] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.748349 22941 consensus_queue.cc:260] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.751147 22941 ts_tablet_manager.cc:1434] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:51.752157 22941 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.782166 22941 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.785048 22941 tablet_bootstrap.cc:492] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
W20260709 13:09:51.785535 22232 consensus_peers.cc:597] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:51.785846 22941 ts_tablet_manager.cc:1403] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.004s
I20260709 13:09:51.788827 22941 raft_consensus.cc:359] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.789624 22941 raft_consensus.cc:740] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.790527 22941 consensus_queue.cc:260] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:51.792990 22941 ts_tablet_manager.cc:1434] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:51.793938 22941 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.821316 22941 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.822492 22941 tablet_bootstrap.cc:492] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.823576 22941 ts_tablet_manager.cc:1403] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:09:51.826731 22941 raft_consensus.cc:359] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.827535 22941 raft_consensus.cc:740] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.828325 22941 consensus_queue.cc:260] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.830693 22941 ts_tablet_manager.cc:1434] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:51.833267 22941 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.867750 22941 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.868993 22941 tablet_bootstrap.cc:492] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.869794 22941 ts_tablet_manager.cc:1403] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.008s
I20260709 13:09:51.872576 22941 raft_consensus.cc:359] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.873430 22941 raft_consensus.cc:740] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.874284 22941 consensus_queue.cc:260] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:51.876931 22941 ts_tablet_manager.cc:1434] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:09:51.877828 22941 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.899682 22941 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.900769 22941 tablet_bootstrap.cc:492] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.901639 22941 ts_tablet_manager.cc:1403] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:09:51.904471 22941 raft_consensus.cc:359] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.905292 22941 raft_consensus.cc:740] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.906062 22941 consensus_queue.cc:260] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.907634 22941 ts_tablet_manager.cc:1434] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:51.932229 22941 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.971299 22941 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.972345 22941 tablet_bootstrap.cc:492] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:51.973017 22941 ts_tablet_manager.cc:1403] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.000s
I20260709 13:09:51.975505 22941 raft_consensus.cc:359] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.976227 22941 raft_consensus.cc:740] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.976933 22941 consensus_queue.cc:260] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:09:51.979252 22941 ts_tablet_manager.cc:1434] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:51.980218 22941 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:51.998296 23030 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.016528 23029 raft_consensus.cc:3060] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.026459 23030 raft_consensus.cc:3060] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.032028 23040 raft_consensus.cc:3060] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:52.091459 22306 consensus_peers.cc:597] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:52.216835 22941 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.217950 22941 tablet_bootstrap.cc:492] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:52.218747 22941 ts_tablet_manager.cc:1403] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.239s	user 0.061s	sys 0.106s
I20260709 13:09:52.262729 22941 raft_consensus.cc:359] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.263480 22941 raft_consensus.cc:740] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.264994 22941 consensus_queue.cc:260] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.270648 22941 ts_tablet_manager.cc:1434] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:09:52.271564 22941 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:52.316337 22941 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.317390 22941 tablet_bootstrap.cc:492] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:52.318146 22941 ts_tablet_manager.cc:1403] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.014s
I20260709 13:09:52.321026 22941 raft_consensus.cc:359] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.321792 22941 raft_consensus.cc:740] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.323336 22941 consensus_queue.cc:260] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.325791 22941 ts_tablet_manager.cc:1434] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:52.330127 22941 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:52.359490 22941 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.360622 22941 tablet_bootstrap.cc:492] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:52.361286 22941 ts_tablet_manager.cc:1403] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.002s
I20260709 13:09:52.363828 22941 raft_consensus.cc:359] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.364542 22941 raft_consensus.cc:740] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.365286 22941 consensus_queue.cc:260] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:09:52.373504 22941 ts_tablet_manager.cc:1434] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:09:52.390188 22941 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Bootstrap starting.
I20260709 13:09:52.417385 22941 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.418462 22941 tablet_bootstrap.cc:492] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Bootstrap complete.
I20260709 13:09:52.419190 22941 ts_tablet_manager.cc:1403] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.010s
I20260709 13:09:52.421778 22941 raft_consensus.cc:359] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:52.422489 22941 raft_consensus.cc:740] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17194feb726e4445801d2097dd68067d, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.423439 22941 consensus_queue.cc:260] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:09:52.430414 22941 ts_tablet_manager.cc:1434] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:52.563501 23037 raft_consensus.cc:3060] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.948418 23037 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.378859 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.430998 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:00.431924 22188 raft_consensus.cc:606] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:00.447903 22266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832"
dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:58958
I20260709 13:10:00.448565 22266 raft_consensus.cc:606] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:00.451481 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:00.452003 22188 raft_consensus.cc:606] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:00.454497 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:00.455008 22188 raft_consensus.cc:606] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:10:00.457331 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:00.457892 22188 raft_consensus.cc:606] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 3f0e42f9dab447d5bc309baaacba2ee7
I20260709 13:10:00.460116 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92951140ac34be7b033283112113d7c"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:00.460601 22188 raft_consensus.cc:606] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:00.461643 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:00.463124 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:00.527729 23171 raft_consensus.cc:993] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.528348 23171 raft_consensus.cc:1081] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.530164 23029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92951140ac34be7b033283112113d7c"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:00.530805 23029 raft_consensus.cc:493] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.531216 23029 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.537321 23029 raft_consensus.cc:515] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:00.539203 23029 leader_election.cc:290] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:00.540323 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.540378 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92951140ac34be7b033283112113d7c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:00.541090 22188 raft_consensus.cc:3055] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.541188 22332 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.541440 22188 raft_consensus.cc:740] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:00.542423 22188 consensus_queue.cc:260] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:00.543572 22188 raft_consensus.cc:3060] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.548553 22332 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.550271 22935 leader_election.cc:304] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:00.555867 22188 raft_consensus.cc:2468] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.559860 23183 raft_consensus.cc:2804] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.561775 23183 raft_consensus.cc:697] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:00.562894 23183 consensus_queue.cc:237] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:00.582252 22015 catalog_manager.cc:5697] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.594425 23179 raft_consensus.cc:993] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.595144 23179 raft_consensus.cc:1081] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.597263 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46976
I20260709 13:10:00.597793 23037 raft_consensus.cc:493] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.598152 23037 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.605047 23037 raft_consensus.cc:515] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.606972 23037 leader_election.cc:290] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:00.608397 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.608716 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6965ff3bf9a458d94a7ab8928ea1832" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:00.609040 22188 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.609212 22262 raft_consensus.cc:3055] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.609542 22262 raft_consensus.cc:740] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:10:00.610337 22262 consensus_queue.cc:260] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.611560 22262 raft_consensus.cc:3060] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.616201 22188 raft_consensus.cc:2468] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.617681 22938 leader_election.cc:304] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:10:00.618633 23183 raft_consensus.cc:2804] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.618958 22262 raft_consensus.cc:2468] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.619273 23183 raft_consensus.cc:697] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:00.620862 23183 consensus_queue.cc:237] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.631707 22015 catalog_manager.cc:5697] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from ca1c2f73661f4fd28f53d294057790cb (127.14.34.131) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.743825 23167 raft_consensus.cc:993] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 3f0e42f9dab447d5bc309baaacba2ee7 to start an election
I20260709 13:10:00.744508 23166 raft_consensus.cc:1081] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 3f0e42f9dab447d5bc309baaacba2ee7 to start an election
I20260709 13:10:00.746519 22338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95"
dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
 from {username='slave'} at 127.0.0.1:51418
I20260709 13:10:00.747210 22338 raft_consensus.cc:493] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.747611 22338 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.754534 22338 raft_consensus.cc:515] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.756664 22338 leader_election.cc:290] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:00.756999 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.757722 22188 raft_consensus.cc:3055] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.758090 22188 raft_consensus.cc:740] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:00.759055 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5222aa4870d49f19225aa91b8599c95" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:00.758952 22188 consensus_queue.cc:260] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.759676 22262 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.760463 22188 raft_consensus.cc:3060] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.765424 22262 raft_consensus.cc:2468] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:10:00.766875 22305 leader_election.cc:304] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:00.767834 23177 raft_consensus.cc:2804] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.768541 23177 raft_consensus.cc:697] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:10:00.769779 23177 consensus_queue.cc:237] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.773324 22188 raft_consensus.cc:2468] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:10:00.781498 23167 raft_consensus.cc:993] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.782281 23166 raft_consensus.cc:1081] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.783252 22015 catalog_manager.cc:5697] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 2 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.783840 23029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:00.784454 23029 raft_consensus.cc:493] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.784739 23029 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.791113 23029 raft_consensus.cc:515] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.794606 23029 leader_election.cc:290] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:00.795106 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.795825 22188 raft_consensus.cc:3055] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.796166 22188 raft_consensus.cc:740] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:00.795966 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38f1076893d40b9897230548a8b40ed" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:00.797633 22262 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.797760 22188 consensus_queue.cc:260] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.799222 22188 raft_consensus.cc:3060] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.805783 22262 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.807042 22937 leader_election.cc:304] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:00.807835 23183 raft_consensus.cc:2804] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.808312 23183 raft_consensus.cc:697] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:00.808566 22188 raft_consensus.cc:2468] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.809131 23183 consensus_queue.cc:237] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.818789 22015 catalog_manager.cc:5697] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.831751 23166 raft_consensus.cc:993] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.832259 23167 raft_consensus.cc:1081] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:00.835319 23029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:00.835817 23029 raft_consensus.cc:493] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.836105 23029 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.842438 23029 raft_consensus.cc:515] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.844444 23029 leader_election.cc:290] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:00.844907 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.845074 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e47a9b9b2ec4f09be9ef8f885554e02" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:00.845579 22188 raft_consensus.cc:3055] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.845711 22262 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.845990 22188 raft_consensus.cc:740] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:00.847002 22188 consensus_queue.cc:260] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.848203 22188 raft_consensus.cc:3060] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.853251 23166 raft_consensus.cc:993] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 3f0e42f9dab447d5bc309baaacba2ee7 to start an election
I20260709 13:10:00.853363 22262 raft_consensus.cc:2468] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.853935 23171 raft_consensus.cc:1081] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 3f0e42f9dab447d5bc309baaacba2ee7 to start an election
I20260709 13:10:00.854579 22188 raft_consensus.cc:2468] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:00.854756 22937 leader_election.cc:304] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:00.855863 23183 raft_consensus.cc:2804] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.855935 22338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b"
dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
 from {username='slave'} at 127.0.0.1:51418
I20260709 13:10:00.856509 23183 raft_consensus.cc:697] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:00.856614 22338 raft_consensus.cc:493] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.857067 22338 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.857555 23183 consensus_queue.cc:237] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:00.867933 22338 raft_consensus.cc:515] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.870942 22338 leader_election.cc:290] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:00.871879 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:00.871513 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c939561ea4c94526ab504d3c4253671b" candidate_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:00.872536 22262 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.872685 22188 raft_consensus.cc:3055] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.873059 22188 raft_consensus.cc:740] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:00.873790 22188 consensus_queue.cc:260] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.875543 22188 raft_consensus.cc:3060] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.878723 22015 catalog_manager.cc:5697] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.879825 22262 raft_consensus.cc:2468] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:10:00.880626 22188 raft_consensus.cc:2468] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0e42f9dab447d5bc309baaacba2ee7 in term 2.
I20260709 13:10:00.881052 22305 leader_election.cc:304] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:00.881928 23177 raft_consensus.cc:2804] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.882524 23177 raft_consensus.cc:697] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:10:00.883460 23177 consensus_queue.cc:237] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:00.895471 22015 catalog_manager.cc:5697] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132). New cstate: current_term: 2 leader_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.164729 22338 raft_consensus.cc:1275] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.166144 23183 consensus_queue.cc:1048] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.181916 22188 raft_consensus.cc:1275] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.183326 23183 consensus_queue.cc:1048] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.206096 22188 raft_consensus.cc:1275] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.207396 23183 consensus_queue.cc:1048] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.214370 22186 raft_consensus.cc:1275] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.214498 22262 raft_consensus.cc:1275] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.215977 23183 consensus_queue.cc:1048] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.216274 23178 consensus_queue.cc:1048] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.240310 22266 raft_consensus.cc:1275] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.241703 23178 consensus_queue.cc:1048] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.316378 22191 raft_consensus.cc:1275] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.317698 23183 consensus_queue.cc:1048] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.330880 22262 raft_consensus.cc:1275] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.332259 23183 consensus_queue.cc:1048] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.342232 22261 raft_consensus.cc:1275] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.343832 23207 consensus_queue.cc:1048] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.352556 22191 raft_consensus.cc:1275] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.358814 23183 consensus_queue.cc:1048] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.374574 22188 raft_consensus.cc:1275] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 3f0e42f9dab447d5bc309baaacba2ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.376189 23207 consensus_queue.cc:1048] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.377516 22262 raft_consensus.cc:1275] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.379012 23183 consensus_queue.cc:1048] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.464123 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.504302 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.541869 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:01.542456 22188 raft_consensus.cc:606] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:01.545150 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:01.545677 22188 raft_consensus.cc:606] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:01.563686 22338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67"
dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
mode: GRACEFUL
new_leader_uuid: "ca1c2f73661f4fd28f53d294057790cb"
 from {username='slave'} at 127.0.0.1:53322
I20260709 13:10:01.564318 22338 raft_consensus.cc:606] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Received request to transfer leadership to TS ca1c2f73661f4fd28f53d294057790cb
I20260709 13:10:01.567589 22332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6"
dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:53322
I20260709 13:10:01.568202 22332 raft_consensus.cc:606] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:01.570691 22188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:01.571223 22188 raft_consensus.cc:606] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:01.572224 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:01.573486 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:01.594743 23177 raft_consensus.cc:993] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: : Instructing follower ca1c2f73661f4fd28f53d294057790cb to start an election
I20260709 13:10:01.595481 23215 raft_consensus.cc:1081] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Signalling peer ca1c2f73661f4fd28f53d294057790cb to start an election
I20260709 13:10:01.597106 22262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67"
dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
 from {username='slave'} at 127.0.0.1:55724
I20260709 13:10:01.597666 22262 raft_consensus.cc:493] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.598075 22262 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.604132 22262 raft_consensus.cc:515] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:01.606441 22262 leader_election.cc:290] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:10:01.607079 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:01.607072 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b704e57772443559af3ab4ea6f48f67" candidate_uuid: "ca1c2f73661f4fd28f53d294057790cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:01.607966 22332 raft_consensus.cc:3055] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.608022 22191 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.608382 22332 raft_consensus.cc:740] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:10:01.609361 22332 consensus_queue.cc:260] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:01.610759 22332 raft_consensus.cc:3060] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.615731 22191 raft_consensus.cc:2468] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 2.
I20260709 13:10:01.617168 22232 leader_election.cc:304] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c18d8f94c39d497e8d04a2a2fd7efe28, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:01.618263 23186 raft_consensus.cc:2804] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.618609 22332 raft_consensus.cc:2468] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1c2f73661f4fd28f53d294057790cb in term 2.
I20260709 13:10:01.618805 23186 raft_consensus.cc:697] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Becoming Leader. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:10:01.619817 23186 consensus_queue.cc:237] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } }
I20260709 13:10:01.629990 22011 catalog_manager.cc:5697] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb reported cstate change: term changed from 1 to 2, leader changed from 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132) to ca1c2f73661f4fd28f53d294057790cb (127.14.34.131). New cstate: current_term: 2 leader_uuid: "ca1c2f73661f4fd28f53d294057790cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.684845 23166 raft_consensus.cc:993] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.685300 23171 raft_consensus.cc:1081] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.686882 23029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:01.687400 23029 raft_consensus.cc:493] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.687742 23029 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.693504 23029 raft_consensus.cc:515] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.696329 22332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:01.696904 22332 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.697638 23029 leader_election.cc:290] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:01.698158 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ad9fbad184a4753852b26a96e13dc49" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:01.698750 22191 raft_consensus.cc:3055] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.699052 22191 raft_consensus.cc:740] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:01.699784 22191 consensus_queue.cc:260] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.701488 22191 raft_consensus.cc:3060] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.710502 22191 raft_consensus.cc:2468] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:01.711498 22332 raft_consensus.cc:2468] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:01.711640 22938 leader_election.cc:304] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:10:01.712456 23183 raft_consensus.cc:2804] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.712936 23183 raft_consensus.cc:697] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:01.713750 23183 consensus_queue.cc:237] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.724350 22011 catalog_manager.cc:5697] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.827409 23167 raft_consensus.cc:993] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.827950 23166 raft_consensus.cc:1081] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.829463 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:01.829922 23037 raft_consensus.cc:493] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.830257 23037 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.837332 23037 raft_consensus.cc:515] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.838874 23037 leader_election.cc:290] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 4 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:01.839741 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:01.840335 22338 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.840607 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007cad1be85a4b9e8e1a28971ce3cc56" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:01.841115 22191 raft_consensus.cc:3055] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:01.841315 22191 raft_consensus.cc:740] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:01.842139 22191 consensus_queue.cc:260] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.843078 22191 raft_consensus.cc:3060] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.846100 22338 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 4.
I20260709 13:10:01.847497 22935 leader_election.cc:304] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:01.848186 23183 raft_consensus.cc:2804] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.848678 23183 raft_consensus.cc:697] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 4 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:01.848742 22191 raft_consensus.cc:2468] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 4.
I20260709 13:10:01.849615 23183 consensus_queue.cc:237] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:01.859774 22011 catalog_manager.cc:5697] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 3 to 4, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 4 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.895717 23215 raft_consensus.cc:993] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.896310 23178 raft_consensus.cc:1081] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:01.898232 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:10:01.898876 23037 raft_consensus.cc:493] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.899282 23037 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.904742 23037 raft_consensus.cc:515] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:01.906569 23037 leader_election.cc:290] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:10:01.907320 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:01.907651 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7924d439b23d46c090863a9e0eeab8d6" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:01.908083 22262 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.908351 22338 raft_consensus.cc:3055] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.908746 22338 raft_consensus.cc:740] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0e42f9dab447d5bc309baaacba2ee7, State: Running, Role: LEADER
I20260709 13:10:01.909478 22338 consensus_queue.cc:260] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:01.910356 22338 raft_consensus.cc:3060] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.915416 22262 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:01.916767 22937 leader_election.cc:304] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:01.917753 23183 raft_consensus.cc:2804] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.917804 22338 raft_consensus.cc:2468] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:01.918313 23183 raft_consensus.cc:697] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:01.919499 23183 consensus_queue.cc:237] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:01.931254 22011 catalog_manager.cc:5697] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.049469 22338 raft_consensus.cc:1275] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer ca1c2f73661f4fd28f53d294057790cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.049532 23167 raft_consensus.cc:993] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.050201 23166 raft_consensus.cc:1081] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.051347 23186 consensus_queue.cc:1048] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.051841 23029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:02.052531 23029 raft_consensus.cc:493] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.052889 23029 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.058460 23029 raft_consensus.cc:515] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.060992 23029 leader_election.cc:290] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:02.060961 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:02.061187 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69dea929793f41b284b6169e5f48f91c" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:02.061829 22188 raft_consensus.cc:3055] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.061682 22338 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.062259 22188 raft_consensus.cc:740] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:02.063109 22188 consensus_queue.cc:260] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.064266 22188 raft_consensus.cc:3060] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.068552 22338 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:02.069815 22935 leader_election.cc:304] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:02.070709 22188 raft_consensus.cc:2468] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:02.071693 23183 raft_consensus.cc:2804] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.072212 23183 raft_consensus.cc:697] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:02.073098 23183 consensus_queue.cc:237] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.095497 22011 catalog_manager.cc:5697] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 2 to 3, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 3 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.110839 22188 raft_consensus.cc:1275] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer ca1c2f73661f4fd28f53d294057790cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.112205 23186 consensus_queue.cc:1048] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.223845 22340 raft_consensus.cc:1275] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.225117 23201 consensus_queue.cc:1048] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.237663 22340 raft_consensus.cc:1275] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 4 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.239717 23184 consensus_queue.cc:1048] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:02.256413 22188 raft_consensus.cc:1275] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.261286 23183 consensus_queue.cc:1048] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.261986 22188 raft_consensus.cc:1275] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 4 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.266043 23184 consensus_queue.cc:1048] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.464084 22337 raft_consensus.cc:1275] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.465335 23201 consensus_queue.cc:1048] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.478901 22261 raft_consensus.cc:1275] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.480683 23184 consensus_queue.cc:1048] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.529075 22340 raft_consensus.cc:1275] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.530475 23201 consensus_queue.cc:1048] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.541317 22188 raft_consensus.cc:1275] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.542704 23239 consensus_queue.cc:1048] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:02.574458 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.614758 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.660574 22186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:02.661254 22186 raft_consensus.cc:606] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.663902 22186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:02.664439 22186 raft_consensus.cc:606] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.666872 22186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:02.667364 22186 raft_consensus.cc:606] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.669680 22186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:02.670212 22186 raft_consensus.cc:606] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.672713 22262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877"
dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:58958
I20260709 13:10:02.673242 22262 raft_consensus.cc:606] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.675948 23167 raft_consensus.cc:993] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.676484 23171 raft_consensus.cc:1081] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.676245 22186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405"
dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
mode: GRACEFUL
new_leader_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:52622
I20260709 13:10:02.677047 22186 raft_consensus.cc:606] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Received request to transfer leadership to TS 17194feb726e4445801d2097dd68067d
I20260709 13:10:02.678481 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:02.679620 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:02.680153 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.680155 23037 raft_consensus.cc:493] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.680799 23037 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.686774 23037 raft_consensus.cc:515] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.688294 23037 leader_election.cc:290] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:02.689188 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:02.689136 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8695172b484ce5baae1689dc3e9847" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:02.690007 22188 raft_consensus.cc:3055] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.690058 22338 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.690486 22188 raft_consensus.cc:740] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:02.691253 22188 consensus_queue.cc:260] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.692531 22188 raft_consensus.cc:3060] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.696928 22338 raft_consensus.cc:2468] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:02.698107 22935 leader_election.cc:304] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:02.698711 23184 raft_consensus.cc:2804] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.699162 23184 raft_consensus.cc:697] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:02.699963 22188 raft_consensus.cc:2468] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:02.701270 23184 consensus_queue.cc:237] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.713732 22010 catalog_manager.cc:5697] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.802145 23167 raft_consensus.cc:993] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.802654 23167 raft_consensus.cc:1081] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.804080 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:02.804512 23037 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.804791 23037 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.810253 23037 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.811906 23037 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:02.812562 22338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:02.812922 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a9a3f31b644deeae1bdd440987faf4" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:02.813207 22338 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.813669 22186 raft_consensus.cc:3055] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.814226 22186 raft_consensus.cc:740] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:02.815106 22186 consensus_queue.cc:260] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.816171 22186 raft_consensus.cc:3060] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.818701 22338 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:02.819783 22935 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:02.820443 23184 raft_consensus.cc:2804] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.820847 23184 raft_consensus.cc:697] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:02.821676 23184 consensus_queue.cc:237] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.822877 22186 raft_consensus.cc:2468] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:02.830634 22010 catalog_manager.cc:5697] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 2 to 3, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 3 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.967468 23171 raft_consensus.cc:993] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.967934 23167 raft_consensus.cc:1081] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.969452 23040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:02.969960 23040 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.970335 23040 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.974468 23171 raft_consensus.cc:993] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.974995 23167 raft_consensus.cc:1081] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:02.976677 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:02.977203 23037 raft_consensus.cc:493] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.977548 23037 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.980062 23040 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.982472 23040 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Requested vote from peers 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:02.985299 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:02.985960 22340 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.986217 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4e5e86a9404276b44ce60830112a9e" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:02.986848 22188 raft_consensus.cc:3055] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.987146 22188 raft_consensus.cc:740] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:02.987963 22188 consensus_queue.cc:260] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:02.989380 22188 raft_consensus.cc:3060] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.990325 23037 raft_consensus.cc:515] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:02.992885 23037 leader_election.cc:290] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:02.992846 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:02.993142 22261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e4e0ac91fa4d63ae85265155993405" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:02.993494 22186 raft_consensus.cc:3055] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.993798 22261 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.993883 22186 raft_consensus.cc:740] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:02.994776 22186 consensus_queue.cc:260] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:02.995612 22186 raft_consensus.cc:3060] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.997054 22188 raft_consensus.cc:2468] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:02.998296 22938 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:10:02.999171 23184 raft_consensus.cc:2804] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.999653 23184 raft_consensus.cc:697] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:03.000496 23184 consensus_queue.cc:237] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:03.001096 22261 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.002244 22186 raft_consensus.cc:2468] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.003732 22938 leader_election.cc:304] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28; no voters: 
I20260709 13:10:03.007855 23239 raft_consensus.cc:2804] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.008307 23239 raft_consensus.cc:697] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:03.009277 23239 consensus_queue.cc:237] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:03.004329 22340 raft_consensus.cc:2468] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 2.
I20260709 13:10:03.017654 22010 catalog_manager.cc:5697] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 1 to 2, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 2 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.043313 22010 catalog_manager.cc:5697] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 2 to 3, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 3 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.121927 23243 raft_consensus.cc:993] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:03.122627 23186 raft_consensus.cc:1081] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:03.124276 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46976
I20260709 13:10:03.124858 23037 raft_consensus.cc:493] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.125154 23037 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.131186 23037 raft_consensus.cc:515] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:03.132870 23037 leader_election.cc:290] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Requested vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 3f0e42f9dab447d5bc309baaacba2ee7 (127.14.34.132:36873)
I20260709 13:10:03.133639 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:03.134016 22340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ba8098e9a343f5826bcd03b7821877" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f0e42f9dab447d5bc309baaacba2ee7"
I20260709 13:10:03.134191 22262 raft_consensus.cc:3055] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.134588 22262 raft_consensus.cc:740] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1c2f73661f4fd28f53d294057790cb, State: Running, Role: LEADER
I20260709 13:10:03.134605 22340 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.135305 22262 consensus_queue.cc:260] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:03.136371 22262 raft_consensus.cc:3060] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.140772 22340 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.141772 22262 raft_consensus.cc:2468] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.142074 22935 leader_election.cc:304] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 
I20260709 13:10:03.142937 23184 raft_consensus.cc:2804] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.143426 23184 raft_consensus.cc:697] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:03.144232 23184 consensus_queue.cc:237] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:03.158838 22010 catalog_manager.cc:5697] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 2 to 3, leader changed from ca1c2f73661f4fd28f53d294057790cb (127.14.34.131) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 3 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.164904 23167 raft_consensus.cc:993] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: : Instructing follower 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:03.165489 23167 raft_consensus.cc:1081] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Signalling peer 17194feb726e4445801d2097dd68067d to start an election
I20260709 13:10:03.166262 22186 raft_consensus.cc:1275] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.167966 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740"
dest_uuid: "17194feb726e4445801d2097dd68067d"
 from {username='slave'} at 127.0.0.1:46972
I20260709 13:10:03.168072 23184 consensus_queue.cc:1048] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:03.168488 23037 raft_consensus.cc:493] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.168910 23037 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.177505 23037 raft_consensus.cc:515] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:03.179548 23037 leader_election.cc:290] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Requested vote from peers c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021), ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441)
I20260709 13:10:03.180632 22262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1c2f73661f4fd28f53d294057790cb"
I20260709 13:10:03.181310 22262 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.183763 22186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9831dd11f7cb42cea1274a6891904740" candidate_uuid: "17194feb726e4445801d2097dd68067d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28"
I20260709 13:10:03.184494 22186 raft_consensus.cc:3055] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.189507 22262 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.195128 22338 raft_consensus.cc:1275] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.195247 22937 leader_election.cc:304] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb; no voters: 
I20260709 13:10:03.197441 23183 raft_consensus.cc:2804] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.198107 23183 raft_consensus.cc:697] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Becoming Leader. State: Replica: 17194feb726e4445801d2097dd68067d, State: Running, Role: LEADER
I20260709 13:10:03.199452 23183 consensus_queue.cc:237] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:03.186204 22186 raft_consensus.cc:740] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18d8f94c39d497e8d04a2a2fd7efe28, State: Running, Role: LEADER
I20260709 13:10:03.202615 22186 consensus_queue.cc:260] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } }
I20260709 13:10:03.198115 23184 consensus_queue.cc:1048] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:10:03.204069 22186 raft_consensus.cc:3060] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.225363 22186 raft_consensus.cc:2468] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17194feb726e4445801d2097dd68067d in term 3.
I20260709 13:10:03.237531 22015 catalog_manager.cc:5697] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d reported cstate change: term changed from 2 to 3, leader changed from c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130) to 17194feb726e4445801d2097dd68067d (127.14.34.129). New cstate: current_term: 3 leader_uuid: "17194feb726e4445801d2097dd68067d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.338444 22338 raft_consensus.cc:1275] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.340009 23239 consensus_queue.cc:1048] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.352806 22186 raft_consensus.cc:1275] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.356667 23183 consensus_queue.cc:1048] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.394505 22186 raft_consensus.cc:1275] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.395673 23183 consensus_queue.cc:1048] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.404973 22338 raft_consensus.cc:1275] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.407070 23184 consensus_queue.cc:1048] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.427897 22186 raft_consensus.cc:1275] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.429169 23184 consensus_queue.cc:1048] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.441802 22262 raft_consensus.cc:1275] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.443158 23239 consensus_queue.cc:1048] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.611639 22188 raft_consensus.cc:1275] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.613023 23184 consensus_queue.cc:1048] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.621531 22261 raft_consensus.cc:1275] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.623019 23184 consensus_queue.cc:1048] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.652058 22261 raft_consensus.cc:1275] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.653213 23184 consensus_queue.cc:1048] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.667562 22338 raft_consensus.cc:1275] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Refusing update from remote peer 17194feb726e4445801d2097dd68067d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.669162 23239 consensus_queue.cc:1048] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.681135 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.739284 14474 tablet_server.cc:179] TabletServer@127.14.34.129:33489 shutting down...
W20260709 13:10:03.751917 22232 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 317 similar messages]
W20260709 13:10:03.757166 22232 consensus_peers.cc:597] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.764340 22232 consensus_peers.cc:597] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.782537 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:03.783638 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.784631 14474 raft_consensus.cc:2243] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.785090 14474 raft_consensus.cc:2272] T 39ecd61e5f504f318519347d1299751e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.788218 14474 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:03.788308 22158 consensus_peers.cc:597] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.789036 14474 raft_consensus.cc:2243] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.789498 14474 raft_consensus.cc:2272] T 32223739e62f42aeb7edc9209035b260 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.791939 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.792563 14474 raft_consensus.cc:2243] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.793037 14474 raft_consensus.cc:2272] T 15c812af74344306b9c9ab661cdbb582 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.795864 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.796723 14474 raft_consensus.cc:2243] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.797626 14474 raft_consensus.cc:2272] T 69dea929793f41b284b6169e5f48f91c P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.799929 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.800472 14474 raft_consensus.cc:2243] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.800851 14474 raft_consensus.cc:2272] T 28b7fe317f7748d6b79af65dfce6aaa3 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.803021 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.803712 14474 raft_consensus.cc:2243] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.804054 14474 raft_consensus.cc:2272] T 57b0e3fbce6246c6b6701af14d2add23 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.806205 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.806775 14474 raft_consensus.cc:2243] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.807513 14474 raft_consensus.cc:2272] T 95a9a3f31b644deeae1bdd440987faf4 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.810457 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.811118 14474 raft_consensus.cc:2243] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.811677 14474 raft_consensus.cc:2272] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.814268 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.815128 14474 raft_consensus.cc:2243] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.815631 14474 raft_consensus.cc:2272] T 0142c870a43c41b7bcb815fcee196201 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.818683 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.819453 14474 raft_consensus.cc:2243] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.820465 14474 raft_consensus.cc:2272] T 7924d439b23d46c090863a9e0eeab8d6 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.822923 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.823558 14474 raft_consensus.cc:2243] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.824016 14474 raft_consensus.cc:2272] T fc40bc6bbf64498894a29949620657cc P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.826349 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.827011 14474 raft_consensus.cc:2243] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.827540 14474 raft_consensus.cc:2272] T 2635674412cd401c9431a779ae71dcee P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.830521 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.831362 14474 raft_consensus.cc:2243] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.831911 14474 raft_consensus.cc:2272] T 0f66b966ecab4e0292876583bb462dcc P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.834816 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.835497 14474 raft_consensus.cc:2243] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.836480 14474 raft_consensus.cc:2272] T 1a4e5e86a9404276b44ce60830112a9e P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.839047 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.839897 14474 raft_consensus.cc:2243] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.840904 14474 raft_consensus.cc:2272] T 9831dd11f7cb42cea1274a6891904740 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.843739 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.844353 14474 raft_consensus.cc:2243] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.844785 14474 raft_consensus.cc:2272] T 1339f58f4b83447ca1b957607bb81a0e P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.846691 22306 consensus_peers.cc:597] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.847318 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.848047 14474 raft_consensus.cc:2243] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.848459 14474 raft_consensus.cc:2272] T 37090b927d224c0d902fc48f6b211e37 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.850829 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.851540 14474 raft_consensus.cc:2243] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.851965 14474 raft_consensus.cc:2272] T eb552418dae949178152d5fd607910e7 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.854590 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.855195 14474 raft_consensus.cc:2243] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.855644 14474 raft_consensus.cc:2272] T 98aeacddec914f1d8a82fe805dedcf91 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.857834 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.858462 14474 raft_consensus.cc:2243] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.858852 14474 raft_consensus.cc:2272] T f399f589fa4347108c35bf247c543fb6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.860734 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.861245 14474 raft_consensus.cc:2243] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.861954 14474 raft_consensus.cc:2272] T 007cad1be85a4b9e8e1a28971ce3cc56 P 17194feb726e4445801d2097dd68067d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.864112 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.864822 14474 raft_consensus.cc:2243] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.865219 14474 raft_consensus.cc:2272] T 327c2509cc82419a9564c2a7282f0f71 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.867581 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.868424 14474 raft_consensus.cc:2243] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.868901 14474 raft_consensus.cc:2272] T cceaff14ae1a439093a61fc311090c52 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.870973 22232 consensus_peers.cc:597] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.871685 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.872386 14474 raft_consensus.cc:2243] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.872918 14474 raft_consensus.cc:2272] T 11ae63d58cc3409fac6679d9f14f3145 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.873705 22158 consensus_peers.cc:597] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.875463 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.876283 14474 raft_consensus.cc:2243] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.877043 14474 raft_consensus.cc:2272] T 9ad9fbad184a4753852b26a96e13dc49 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.879240 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.879833 14474 raft_consensus.cc:2243] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.880179 14474 raft_consensus.cc:2272] T 3f610a8a53884b579f5db10b1da26e34 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.882016 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.882606 14474 raft_consensus.cc:2243] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.882946 14474 raft_consensus.cc:2272] T 88301f9a41d1408a954402329da2f773 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.884832 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.885334 14474 raft_consensus.cc:2243] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.886070 14474 raft_consensus.cc:2272] T b2e4e0ac91fa4d63ae85265155993405 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.888619 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.889320 14474 raft_consensus.cc:2243] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.889667 14474 raft_consensus.cc:2272] T 6b9fff09c6c3456a80ff8246e5641523 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.892045 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.892589 14474 raft_consensus.cc:2243] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:03.892884 22306 consensus_peers.cc:597] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.893009 14474 raft_consensus.cc:2272] T d2f8819d5105462fadf17a4783b64e02 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.895269 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.895840 14474 raft_consensus.cc:2243] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.896543 14474 raft_consensus.cc:2272] T f92951140ac34be7b033283112113d7c P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.898881 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.899585 14474 raft_consensus.cc:2243] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.900063 14474 raft_consensus.cc:2272] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.902351 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.902872 14474 raft_consensus.cc:2243] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.903277 14474 raft_consensus.cc:2272] T 75599b9dde5f4db2bd81f1872e371761 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.905915 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.906687 14474 raft_consensus.cc:2243] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.907137 14474 raft_consensus.cc:2272] T 79ad3d419e304cec828f5104f51047f6 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.909977 14474 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:03.909868 22158 consensus_peers.cc:597] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.910972 14474 raft_consensus.cc:2243] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:03.911459 22158 consensus_peers.cc:597] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.911506 14474 raft_consensus.cc:2272] T 1ffcff5675b2484f92ffac7f3db09d88 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.914497 22232 consensus_peers.cc:597] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.914654 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.915398 14474 raft_consensus.cc:2243] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.915817 14474 raft_consensus.cc:2272] T 13a6f0c3a1204df3b6e06881227e59a7 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.916913 22232 consensus_peers.cc:597] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.918084 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.918718 14474 raft_consensus.cc:2243] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.919123 14474 raft_consensus.cc:2272] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 17194feb726e4445801d2097dd68067d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.921489 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.922116 14474 raft_consensus.cc:2243] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.922859 14474 raft_consensus.cc:2272] T c38f1076893d40b9897230548a8b40ed P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.925213 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.925724 14474 raft_consensus.cc:2243] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.926189 14474 raft_consensus.cc:2272] T c183a828104c4ec7bb186876a7fcf7d8 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.928050 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.928529 14474 raft_consensus.cc:2243] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.928941 14474 raft_consensus.cc:2272] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.930930 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.931407 14474 raft_consensus.cc:2243] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.932228 14474 raft_consensus.cc:2272] T a6965ff3bf9a458d94a7ab8928ea1832 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.934417 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.935051 14474 raft_consensus.cc:2243] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.935837 14474 raft_consensus.cc:2272] T b1ba8098e9a343f5826bcd03b7821877 P 17194feb726e4445801d2097dd68067d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.938177 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.938642 14474 raft_consensus.cc:2243] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.939298 14474 raft_consensus.cc:2272] T 8e47a9b9b2ec4f09be9ef8f885554e02 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.941138 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.941535 14474 raft_consensus.cc:2243] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.941898 14474 raft_consensus.cc:2272] T 83fcdef153e7447d84951d92004c6594 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.943774 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.944444 14474 raft_consensus.cc:2243] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.945291 14474 raft_consensus.cc:2272] T af8695172b484ce5baae1689dc3e9847 P 17194feb726e4445801d2097dd68067d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.968201 22306 consensus_peers.cc:597] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.974574 22158 consensus_peers.cc:597] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.983305 22232 consensus_peers.cc:597] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.989972 22232 consensus_peers.cc:597] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.023473 14474 tablet_server.cc:196] TabletServer@127.14.34.129:33489 shutdown complete.
W20260709 13:10:04.043066 22232 consensus_peers.cc:597] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.047696 22158 consensus_peers.cc:597] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.050498 22306 consensus_peers.cc:597] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.053822 22306 consensus_peers.cc:597] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.070056 22232 consensus_peers.cc:597] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.083266 22158 consensus_peers.cc:597] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.099562 22306 consensus_peers.cc:597] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.113147 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
W20260709 13:10:04.123286 22158 consensus_peers.cc:597] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.149785 22158 consensus_peers.cc:597] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.157187 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:04.158360 14474 tablet_replica.cc:333] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.159365 14474 raft_consensus.cc:2243] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.160737 14474 raft_consensus.cc:2272] T 85a853eea2e64e4bb361d4720592e9a4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.161986 22306 consensus_peers.cc:597] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.163216 14474 tablet_replica.cc:333] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.163805 14474 raft_consensus.cc:2243] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.164223 14474 raft_consensus.cc:2272] T 95a9a3f31b644deeae1bdd440987faf4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.167316 14474 tablet_replica.cc:333] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.168437 14474 raft_consensus.cc:2243] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.169449 14474 raft_consensus.cc:2272] T 79ad3d419e304cec828f5104f51047f6 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.172446 14474 tablet_replica.cc:333] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
W20260709 13:10:04.172581 22306 consensus_peers.cc:597] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.172871 22232 consensus_peers.cc:597] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.173308 14474 raft_consensus.cc:2243] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.173841 14474 raft_consensus.cc:2272] T ccf3d2ff31fb49d0afde438cabaf1883 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.175992 14474 tablet_replica.cc:333] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.176573 14474 raft_consensus.cc:2243] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.177366 14474 raft_consensus.cc:2272] T d5222aa4870d49f19225aa91b8599c95 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.180055 14474 tablet_replica.cc:333] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.180786 14474 raft_consensus.cc:2243] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.181824 14474 raft_consensus.cc:2272] T 83fcdef153e7447d84951d92004c6594 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.182397 22158 consensus_peers.cc:597] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.183987 14474 tablet_replica.cc:333] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.184587 14474 raft_consensus.cc:2243] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.185283 14474 raft_consensus.cc:2272] T 171e1f8df0714984a5c04e9a4c53c90b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.187106 14474 tablet_replica.cc:333] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.187662 14474 raft_consensus.cc:2243] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.188133 14474 raft_consensus.cc:2272] T 8e47a9b9b2ec4f09be9ef8f885554e02 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.190615 14474 tablet_replica.cc:333] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.191148 14474 raft_consensus.cc:2243] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.191613 14474 raft_consensus.cc:2272] T 88301f9a41d1408a954402329da2f773 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.192487 22158 consensus_peers.cc:597] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.194146 14474 tablet_replica.cc:333] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.194825 14474 raft_consensus.cc:2243] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.195317 14474 raft_consensus.cc:2272] T 11ae63d58cc3409fac6679d9f14f3145 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.197628 14474 tablet_replica.cc:333] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.198320 14474 raft_consensus.cc:2243] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.199268 14474 raft_consensus.cc:2272] T cceaff14ae1a439093a61fc311090c52 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.201429 14474 tablet_replica.cc:333] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.202109 14474 raft_consensus.cc:2243] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.202877 14474 raft_consensus.cc:2272] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.204625 14474 tablet_replica.cc:333] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.205165 14474 raft_consensus.cc:2243] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.205542 14474 raft_consensus.cc:2272] T 1ffcff5675b2484f92ffac7f3db09d88 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.207445 14474 tablet_replica.cc:333] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.207988 14474 raft_consensus.cc:2243] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.208379 14474 raft_consensus.cc:2272] T 37090b927d224c0d902fc48f6b211e37 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.210238 14474 tablet_replica.cc:333] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.210765 14474 raft_consensus.cc:2243] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.211531 14474 raft_consensus.cc:2272] T 1339f58f4b83447ca1b957607bb81a0e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.213248 14474 tablet_replica.cc:333] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.213762 14474 raft_consensus.cc:2243] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.214545 14474 raft_consensus.cc:2272] T 0142c870a43c41b7bcb815fcee196201 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.216342 14474 tablet_replica.cc:333] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.216858 14474 raft_consensus.cc:2243] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.217260 14474 raft_consensus.cc:2272] T 5e0585d90c03430d88a8fee355e3944b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.219277 14474 tablet_replica.cc:333] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.219838 14474 raft_consensus.cc:2243] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.220335 14474 raft_consensus.cc:2272] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.222985 14474 tablet_replica.cc:333] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.223711 14474 raft_consensus.cc:2243] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.224164 14474 raft_consensus.cc:2272] T 6b704e57772443559af3ab4ea6f48f67 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.226295 14474 tablet_replica.cc:333] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.227124 14474 raft_consensus.cc:2243] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.228309 14474 raft_consensus.cc:2272] T fc40bc6bbf64498894a29949620657cc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.230556 22232 consensus_peers.cc:597] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.231238 14474 tablet_replica.cc:333] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.232097 14474 raft_consensus.cc:2243] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.232662 14474 raft_consensus.cc:2272] T d84b3305904946d38911396e3454a49c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.232991 22306 consensus_peers.cc:597] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.233728 22306 consensus_peers.cc:597] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.234999 14474 tablet_replica.cc:333] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.235646 14474 raft_consensus.cc:2243] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.236392 14474 raft_consensus.cc:2272] T c183a828104c4ec7bb186876a7fcf7d8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.238773 14474 tablet_replica.cc:333] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.239339 14474 raft_consensus.cc:2243] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.239764 14474 raft_consensus.cc:2272] T c38f1076893d40b9897230548a8b40ed P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.241611 14474 tablet_replica.cc:333] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.242429 14474 raft_consensus.cc:2243] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.242920 14474 raft_consensus.cc:2272] T f4ead399c25f4fba981e4ae8dc56595d P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.245020 14474 tablet_replica.cc:333] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.245672 14474 raft_consensus.cc:2243] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.246166 14474 raft_consensus.cc:2272] T 543bace83eba44d6ab8955f3c9fdb2f8 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.248860 14474 tablet_replica.cc:333] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.249598 14474 raft_consensus.cc:2243] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.250195 14474 raft_consensus.cc:2272] T 3f610a8a53884b579f5db10b1da26e34 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.253052 14474 tablet_replica.cc:333] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.253834 14474 raft_consensus.cc:2243] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.254336 14474 raft_consensus.cc:2272] T c939561ea4c94526ab504d3c4253671b P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.256999 14474 tablet_replica.cc:333] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.257756 14474 raft_consensus.cc:2243] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.258263 14474 raft_consensus.cc:2272] T 9ad9fbad184a4753852b26a96e13dc49 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.260812 14474 tablet_replica.cc:333] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
W20260709 13:10:04.261474 22306 consensus_peers.cc:597] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.261579 14474 raft_consensus.cc:2243] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.262260 14474 raft_consensus.cc:2272] T 9831dd11f7cb42cea1274a6891904740 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.264779 14474 tablet_replica.cc:333] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.265357 14474 raft_consensus.cc:2243] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.265774 14474 raft_consensus.cc:2272] T 1a4e5e86a9404276b44ce60830112a9e P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.267992 14474 tablet_replica.cc:333] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.268555 14474 raft_consensus.cc:2243] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.269316 14474 raft_consensus.cc:2272] T 0f66b966ecab4e0292876583bb462dcc P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.271288 14474 tablet_replica.cc:333] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.271804 14474 raft_consensus.cc:2243] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.272202 14474 raft_consensus.cc:2272] T 69dea929793f41b284b6169e5f48f91c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.274185 14474 tablet_replica.cc:333] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.274683 14474 raft_consensus.cc:2243] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.275079 14474 raft_consensus.cc:2272] T a90f7e1b06aa47b1a7a3bad9feba4d21 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.277294 14474 tablet_replica.cc:333] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.277964 14474 raft_consensus.cc:2243] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.279031 14474 raft_consensus.cc:2272] T 28b7fe317f7748d6b79af65dfce6aaa3 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.281476 14474 tablet_replica.cc:333] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.282187 14474 raft_consensus.cc:2243] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.282678 14474 raft_consensus.cc:2272] T c96bcd6c5d2745d4af954e66e23b0e4f P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.285231 14474 tablet_replica.cc:333] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.285909 14474 raft_consensus.cc:2243] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.286404 14474 raft_consensus.cc:2272] T 007cad1be85a4b9e8e1a28971ce3cc56 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.286587 22232 consensus_peers.cc:597] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.288800 14474 tablet_replica.cc:333] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.289573 14474 raft_consensus.cc:2243] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.290537 14474 raft_consensus.cc:2272] T 57b0e3fbce6246c6b6701af14d2add23 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.293228 14474 tablet_replica.cc:333] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.293929 14474 raft_consensus.cc:2243] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.294427 14474 raft_consensus.cc:2272] T f92951140ac34be7b033283112113d7c P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.296051 22232 consensus_peers.cc:597] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb -> Peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Couldn't send request to peer 17194feb726e4445801d2097dd68067d. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.296893 14474 tablet_replica.cc:333] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.297672 14474 raft_consensus.cc:2243] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.298185 14474 raft_consensus.cc:2272] T b2e4e0ac91fa4d63ae85265155993405 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.301026 14474 tablet_replica.cc:333] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.301777 14474 raft_consensus.cc:2243] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.302789 14474 raft_consensus.cc:2272] T f372f4163d984cce8f4884fa17505bee P c18d8f94c39d497e8d04a2a2fd7efe28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.305533 14474 tablet_replica.cc:333] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.306210 14474 raft_consensus.cc:2243] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.306699 14474 raft_consensus.cc:2272] T af8695172b484ce5baae1689dc3e9847 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.309170 14474 tablet_replica.cc:333] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.309806 14474 raft_consensus.cc:2243] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.310328 14474 raft_consensus.cc:2272] T 0d6d7c28c00b4ce7ac2826c1959ada78 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.311342 22232 consensus_peers.cc:597] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.312913 14474 tablet_replica.cc:333] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.313664 14474 raft_consensus.cc:2243] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.314164 14474 raft_consensus.cc:2272] T a6965ff3bf9a458d94a7ab8928ea1832 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.316623 14474 tablet_replica.cc:333] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28: stopping tablet replica
I20260709 13:10:04.317216 14474 raft_consensus.cc:2243] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.318213 14474 raft_consensus.cc:2272] T 15c812af74344306b9c9ab661cdbb582 P c18d8f94c39d497e8d04a2a2fd7efe28 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.341078 22232 consensus_peers.cc:597] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.358386 22306 consensus_peers.cc:597] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.364974 22306 consensus_peers.cc:597] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.387116 22232 connection.cc:573] client connection to 127.14.34.130:44021 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:04.387733 22232 consensus_peers.cc:597] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.446990 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
W20260709 13:10:04.456359 22232 consensus_peers.cc:597] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.462364 22232 consensus_peers.cc:597] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.484745 22306 consensus_peers.cc:597] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.519145 22306 consensus_peers.cc:597] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.527660 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
W20260709 13:10:04.537066 22305 consensus_peers.cc:597] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.543228 22306 consensus_peers.cc:597] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.566126 22232 consensus_peers.cc:597] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.576798 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:04.578384 14474 tablet_replica.cc:333] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.579409 14474 raft_consensus.cc:2243] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.580520 14474 raft_consensus.cc:2272] T f399f589fa4347108c35bf247c543fb6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.581292 22306 consensus_peers.cc:597] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Couldn't send request to peer c18d8f94c39d497e8d04a2a2fd7efe28. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.582998 14474 tablet_replica.cc:333] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.583688 14474 raft_consensus.cc:2243] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.584125 14474 raft_consensus.cc:2272] T 85a853eea2e64e4bb361d4720592e9a4 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.586418 14474 tablet_replica.cc:333] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.587054 14474 raft_consensus.cc:2243] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.587857 14474 raft_consensus.cc:2272] T ccf3d2ff31fb49d0afde438cabaf1883 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.589788 14474 tablet_replica.cc:333] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.590533 14474 raft_consensus.cc:2243] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.591125 14474 raft_consensus.cc:2272] T 79ad3d419e304cec828f5104f51047f6 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.594002 14474 tablet_replica.cc:333] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.594826 14474 raft_consensus.cc:2243] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.595383 14474 raft_consensus.cc:2272] T d5222aa4870d49f19225aa91b8599c95 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.597880 14474 tablet_replica.cc:333] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
W20260709 13:10:04.597815 22305 consensus_peers.cc:597] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.599007 14474 raft_consensus.cc:2243] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.600159 14474 raft_consensus.cc:2272] T eb552418dae949178152d5fd607910e7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.602939 14474 tablet_replica.cc:333] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.603837 14474 raft_consensus.cc:2243] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.604441 14474 raft_consensus.cc:2272] T f372f4163d984cce8f4884fa17505bee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.607357 14474 tablet_replica.cc:333] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.607987 14474 raft_consensus.cc:2243] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.608736 14474 raft_consensus.cc:2272] T 88301f9a41d1408a954402329da2f773 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.610791 14474 tablet_replica.cc:333] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.611349 14474 raft_consensus.cc:2243] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.612286 14474 raft_consensus.cc:2272] T 2635674412cd401c9431a779ae71dcee P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.615214 14474 tablet_replica.cc:333] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.615922 14474 raft_consensus.cc:2243] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.616539 14474 raft_consensus.cc:2272] T d84b3305904946d38911396e3454a49c P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.619350 14474 tablet_replica.cc:333] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.620097 14474 raft_consensus.cc:2243] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.620666 14474 raft_consensus.cc:2272] T d2f8819d5105462fadf17a4783b64e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.623517 14474 tablet_replica.cc:333] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.624059 14474 raft_consensus.cc:2243] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.624439 14474 raft_consensus.cc:2272] T 0cdc58c529b54ba2a96c147ab3fb7c29 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.626422 14474 tablet_replica.cc:333] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.626962 14474 raft_consensus.cc:2243] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.627677 14474 raft_consensus.cc:2272] T 75599b9dde5f4db2bd81f1872e371761 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.629678 14474 tablet_replica.cc:333] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.630254 14474 raft_consensus.cc:2243] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.630931 14474 raft_consensus.cc:2272] T 6b9fff09c6c3456a80ff8246e5641523 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.633320 14474 tablet_replica.cc:333] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.634231 14474 raft_consensus.cc:2243] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.634670 14474 raft_consensus.cc:2272] T b2e4e0ac91fa4d63ae85265155993405 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.635663 22305 consensus_peers.cc:597] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.636570 14474 tablet_replica.cc:333] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.637205 14474 raft_consensus.cc:2243] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.637629 14474 raft_consensus.cc:2272] T 32223739e62f42aeb7edc9209035b260 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.639750 14474 tablet_replica.cc:333] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.640329 14474 raft_consensus.cc:2243] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.640770 14474 raft_consensus.cc:2272] T 5e0585d90c03430d88a8fee355e3944b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.641899 22305 consensus_peers.cc:597] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.642876 14474 tablet_replica.cc:333] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.643548 14474 raft_consensus.cc:2243] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.643963 14474 raft_consensus.cc:2272] T c183a828104c4ec7bb186876a7fcf7d8 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.645954 14474 tablet_replica.cc:333] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.646543 14474 raft_consensus.cc:2243] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.646945 14474 raft_consensus.cc:2272] T c38f1076893d40b9897230548a8b40ed P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.648736 14474 tablet_replica.cc:333] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.649274 14474 raft_consensus.cc:2243] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.650012 14474 raft_consensus.cc:2272] T f4ead399c25f4fba981e4ae8dc56595d P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.652082 14474 tablet_replica.cc:333] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.652663 14474 raft_consensus.cc:2243] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.653656 14474 raft_consensus.cc:2272] T 11ae63d58cc3409fac6679d9f14f3145 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.655951 14474 tablet_replica.cc:333] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.656481 14474 raft_consensus.cc:2243] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.656919 14474 raft_consensus.cc:2272] T cceaff14ae1a439093a61fc311090c52 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.658974 14474 tablet_replica.cc:333] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.659585 14474 raft_consensus.cc:2243] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.659991 14474 raft_consensus.cc:2272] T 327c2509cc82419a9564c2a7282f0f71 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.661859 14474 tablet_replica.cc:333] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.662488 14474 raft_consensus.cc:2243] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.662942 14474 raft_consensus.cc:2272] T 9831dd11f7cb42cea1274a6891904740 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.664973 14474 tablet_replica.cc:333] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.665761 14474 raft_consensus.cc:2243] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.666270 14474 raft_consensus.cc:2272] T 0f66b966ecab4e0292876583bb462dcc P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.668994 14474 tablet_replica.cc:333] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.669711 14474 raft_consensus.cc:2243] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.670267 14474 raft_consensus.cc:2272] T 98aeacddec914f1d8a82fe805dedcf91 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.672765 14474 tablet_replica.cc:333] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.673350 14474 raft_consensus.cc:2243] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.673807 14474 raft_consensus.cc:2272] T 543bace83eba44d6ab8955f3c9fdb2f8 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.675849 14474 tablet_replica.cc:333] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.676594 14474 raft_consensus.cc:2243] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.677551 14474 raft_consensus.cc:2272] T 3f610a8a53884b579f5db10b1da26e34 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.679889 14474 tablet_replica.cc:333] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.680398 14474 raft_consensus.cc:2243] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.680820 14474 raft_consensus.cc:2272] T c939561ea4c94526ab504d3c4253671b P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.682832 14474 tablet_replica.cc:333] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.683434 14474 raft_consensus.cc:2243] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.684027 14474 raft_consensus.cc:2272] T 7924d439b23d46c090863a9e0eeab8d6 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.686378 14474 tablet_replica.cc:333] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.687186 14474 raft_consensus.cc:2243] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.687647 14474 raft_consensus.cc:2272] T 0142c870a43c41b7bcb815fcee196201 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.689941 14474 tablet_replica.cc:333] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.690551 14474 raft_consensus.cc:2243] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.690982 14474 raft_consensus.cc:2272] T a6965ff3bf9a458d94a7ab8928ea1832 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.692945 14474 tablet_replica.cc:333] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.693504 14474 raft_consensus.cc:2243] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.694356 14474 raft_consensus.cc:2272] T 37090b927d224c0d902fc48f6b211e37 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.696359 14474 tablet_replica.cc:333] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.696870 14474 raft_consensus.cc:2243] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.697683 14474 raft_consensus.cc:2272] T 13a6f0c3a1204df3b6e06881227e59a7 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.699663 14474 tablet_replica.cc:333] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.700217 14474 raft_consensus.cc:2243] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.701000 14474 raft_consensus.cc:2272] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.703032 14474 tablet_replica.cc:333] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.703555 14474 raft_consensus.cc:2243] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.704330 14474 raft_consensus.cc:2272] T 6b704e57772443559af3ab4ea6f48f67 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.706193 14474 tablet_replica.cc:333] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.706907 14474 raft_consensus.cc:2243] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.707432 14474 raft_consensus.cc:2272] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.710107 14474 tablet_replica.cc:333] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.710899 14474 raft_consensus.cc:2243] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.711722 14474 raft_consensus.cc:2272] T 39ecd61e5f504f318519347d1299751e P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.714509 14474 tablet_replica.cc:333] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.715198 14474 raft_consensus.cc:2243] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.715785 14474 raft_consensus.cc:2272] T a90f7e1b06aa47b1a7a3bad9feba4d21 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.718506 14474 tablet_replica.cc:333] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.719120 14474 raft_consensus.cc:2243] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.719542 14474 raft_consensus.cc:2272] T 28b7fe317f7748d6b79af65dfce6aaa3 P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.721455 14474 tablet_replica.cc:333] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.721906 14474 raft_consensus.cc:2243] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.722363 14474 raft_consensus.cc:2272] T c96bcd6c5d2745d4af954e66e23b0e4f P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.724208 14474 tablet_replica.cc:333] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.724656 14474 raft_consensus.cc:2243] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.725036 14474 raft_consensus.cc:2272] T 171e1f8df0714984a5c04e9a4c53c90b P ca1c2f73661f4fd28f53d294057790cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.727280 14474 tablet_replica.cc:333] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.727918 14474 raft_consensus.cc:2243] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.728439 14474 raft_consensus.cc:2272] T 8e47a9b9b2ec4f09be9ef8f885554e02 P ca1c2f73661f4fd28f53d294057790cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.730525 14474 tablet_replica.cc:333] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb: stopping tablet replica
I20260709 13:10:04.731005 14474 raft_consensus.cc:2243] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.731431 14474 raft_consensus.cc:2272] T b1ba8098e9a343f5826bcd03b7821877 P ca1c2f73661f4fd28f53d294057790cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.741449 22305 consensus_peers.cc:597] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.742890 22305 consensus_peers.cc:597] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.837908 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
W20260709 13:10:04.851047 22305 consensus_peers.cc:597] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.852236 23178 raft_consensus.cc:493] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:10:04.852788 23178 raft_consensus.cc:515] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:04.854952 23178 leader_election.cc:290] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
W20260709 13:10:04.859982 22306 leader_election.cc:336] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
W20260709 13:10:04.860795 22306 leader_election.cc:336] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111)
I20260709 13:10:04.861163 22306 leader_election.cc:304] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:10:04.861837 23178 raft_consensus.cc:2749] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:04.880914 22305 consensus_peers.cc:597] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:04.896592 22305 consensus_peers.cc:597] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.911792 23178 raft_consensus.cc:493] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:10:04.912380 23178 raft_consensus.cc:515] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } } peers { permanent_uuid: "c18d8f94c39d497e8d04a2a2fd7efe28" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44021 } }
I20260709 13:10:04.914459 23178 leader_election.cc:290] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17194feb726e4445801d2097dd68067d (127.14.34.129:33489), c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021)
I20260709 13:10:04.919142 14474 tablet_server.cc:179] TabletServer@127.14.34.132:0 shutting down...
W20260709 13:10:04.921782 22306 leader_election.cc:336] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c18d8f94c39d497e8d04a2a2fd7efe28 (127.14.34.130:44021): Network error: Client connection negotiation failed: client connection to 127.14.34.130:44021: connect: Connection refused (error 111)
W20260709 13:10:04.922646 22306 leader_election.cc:336] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:10:04.922956 22306 leader_election.cc:304] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, c18d8f94c39d497e8d04a2a2fd7efe28
I20260709 13:10:04.923547 23276 raft_consensus.cc:2749] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:04.939916 22305 consensus_peers.cc:597] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.963991 23276 raft_consensus.cc:493] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17194feb726e4445801d2097dd68067d)
I20260709 13:10:04.964648 23276 raft_consensus.cc:515] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1c2f73661f4fd28f53d294057790cb" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 44441 } } peers { permanent_uuid: "3f0e42f9dab447d5bc309baaacba2ee7" member_type: VOTER last_known_addr { host: "127.14.34.132" port: 36873 } } peers { permanent_uuid: "17194feb726e4445801d2097dd68067d" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33489 } }
I20260709 13:10:04.965355 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:04.966347 14474 tablet_replica.cc:333] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.967283 14474 raft_consensus.cc:2243] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.967938 14474 raft_consensus.cc:2272] T 95a9a3f31b644deeae1bdd440987faf4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.968747 23276 leader_election.cc:290] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441), 17194feb726e4445801d2097dd68067d (127.14.34.129:33489)
I20260709 13:10:04.970432 14474 tablet_replica.cc:333] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.971369 14474 raft_consensus.cc:2243] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:04.971423 22306 leader_election.cc:336] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17194feb726e4445801d2097dd68067d (127.14.34.129:33489): Network error: Client connection negotiation failed: client connection to 127.14.34.129:33489: connect: Connection refused (error 111)
I20260709 13:10:04.972009 14474 raft_consensus.cc:2272] T f399f589fa4347108c35bf247c543fb6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.972092 22305 leader_election.cc:336] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111)
I20260709 13:10:04.972618 22305 leader_election.cc:304] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0e42f9dab447d5bc309baaacba2ee7; no voters: 17194feb726e4445801d2097dd68067d, ca1c2f73661f4fd28f53d294057790cb
I20260709 13:10:04.973357 23276 raft_consensus.cc:2749] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:04.974609 14474 tablet_replica.cc:333] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.975210 14474 raft_consensus.cc:2243] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.975647 14474 raft_consensus.cc:2272] T 85a853eea2e64e4bb361d4720592e9a4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.977415 14474 tablet_replica.cc:333] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.977957 14474 raft_consensus.cc:2243] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.978787 14474 raft_consensus.cc:2272] T 0d6d7c28c00b4ce7ac2826c1959ada78 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.980592 14474 tablet_replica.cc:333] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.981142 14474 raft_consensus.cc:2243] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.981532 14474 raft_consensus.cc:2272] T ccf3d2ff31fb49d0afde438cabaf1883 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.983589 14474 tablet_replica.cc:333] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.984100 14474 raft_consensus.cc:2243] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.984513 14474 raft_consensus.cc:2272] T 7924d439b23d46c090863a9e0eeab8d6 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.986457 14474 tablet_replica.cc:333] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.986985 14474 raft_consensus.cc:2243] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.987408 14474 raft_consensus.cc:2272] T 1a4e5e86a9404276b44ce60830112a9e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:04.987337 22305 consensus_peers.cc:597] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:04.989509 14474 tablet_replica.cc:333] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.990317 14474 raft_consensus.cc:2243] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.991117 14474 raft_consensus.cc:2272] T d5222aa4870d49f19225aa91b8599c95 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.993280 14474 tablet_replica.cc:333] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.993852 14474 raft_consensus.cc:2243] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.994292 14474 raft_consensus.cc:2272] T eb552418dae949178152d5fd607910e7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.996428 14474 tablet_replica.cc:333] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:04.996996 14474 raft_consensus.cc:2243] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:04.997812 14474 raft_consensus.cc:2272] T 98aeacddec914f1d8a82fe805dedcf91 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.000100 14474 tablet_replica.cc:333] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.000639 14474 raft_consensus.cc:2243] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.001056 14474 raft_consensus.cc:2272] T 3b3cb8a2bc034a8fbd075e0b21f622e4 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.003381 14474 tablet_replica.cc:333] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.004158 14474 raft_consensus.cc:2243] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:10:05.004370 22305 consensus_peers.cc:597] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 -> Peer ca1c2f73661f4fd28f53d294057790cb (127.14.34.131:44441): Couldn't send request to peer ca1c2f73661f4fd28f53d294057790cb. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.131:44441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:05.005004 14474 raft_consensus.cc:2272] T 1ffcff5675b2484f92ffac7f3db09d88 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.007412 14474 tablet_replica.cc:333] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.007927 14474 raft_consensus.cc:2243] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.008442 14474 raft_consensus.cc:2272] T 1339f58f4b83447ca1b957607bb81a0e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.010871 14474 tablet_replica.cc:333] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.011574 14474 raft_consensus.cc:2243] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.012099 14474 raft_consensus.cc:2272] T 2635674412cd401c9431a779ae71dcee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.014210 14474 tablet_replica.cc:333] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.014770 14474 raft_consensus.cc:2243] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.015609 14474 raft_consensus.cc:2272] T d84b3305904946d38911396e3454a49c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.017620 14474 tablet_replica.cc:333] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.018301 14474 raft_consensus.cc:2243] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.018736 14474 raft_consensus.cc:2272] T af8695172b484ce5baae1689dc3e9847 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.020725 14474 tablet_replica.cc:333] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.021288 14474 raft_consensus.cc:2243] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.021713 14474 raft_consensus.cc:2272] T f372f4163d984cce8f4884fa17505bee P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.023609 14474 tablet_replica.cc:333] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.024180 14474 raft_consensus.cc:2243] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.024694 14474 raft_consensus.cc:2272] T 8b2ad0d0d17848deb4a3f21d5b04a3c7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.026867 14474 tablet_replica.cc:333] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.027462 14474 raft_consensus.cc:2243] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.027889 14474 raft_consensus.cc:2272] T 6b704e57772443559af3ab4ea6f48f67 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.030821 14474 tablet_replica.cc:333] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.031459 14474 raft_consensus.cc:2243] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.031903 14474 raft_consensus.cc:2272] T fc40bc6bbf64498894a29949620657cc P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.059799 14474 tablet_replica.cc:333] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.063441 14474 raft_consensus.cc:2243] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.065775 14474 raft_consensus.cc:2272] T 32223739e62f42aeb7edc9209035b260 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.070426 14474 tablet_replica.cc:333] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.072068 14474 raft_consensus.cc:2243] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.075330 14474 raft_consensus.cc:2272] T 5e0585d90c03430d88a8fee355e3944b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.080811 14474 tablet_replica.cc:333] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.082617 14474 raft_consensus.cc:2243] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.084517 14474 raft_consensus.cc:2272] T d2f8819d5105462fadf17a4783b64e02 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.087662 14474 tablet_replica.cc:333] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.088634 14474 raft_consensus.cc:2243] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.089679 14474 raft_consensus.cc:2272] T f92951140ac34be7b033283112113d7c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.093668 14474 tablet_replica.cc:333] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.094975 14474 raft_consensus.cc:2243] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.096547 14474 raft_consensus.cc:2272] T 0cdc58c529b54ba2a96c147ab3fb7c29 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.099609 14474 tablet_replica.cc:333] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.100658 14474 raft_consensus.cc:2243] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.101361 14474 raft_consensus.cc:2272] T 75599b9dde5f4db2bd81f1872e371761 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.104219 14474 tablet_replica.cc:333] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.104936 14474 raft_consensus.cc:2243] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.105611 14474 raft_consensus.cc:2272] T 6b9fff09c6c3456a80ff8246e5641523 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.108673 14474 tablet_replica.cc:333] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.109344 14474 raft_consensus.cc:2243] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.111191 14474 raft_consensus.cc:2272] T 327c2509cc82419a9564c2a7282f0f71 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.114323 14474 tablet_replica.cc:333] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.115195 14474 raft_consensus.cc:2243] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.115857 14474 raft_consensus.cc:2272] T 57b0e3fbce6246c6b6701af14d2add23 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.118454 14474 tablet_replica.cc:333] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.119061 14474 raft_consensus.cc:2243] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.119714 14474 raft_consensus.cc:2272] T 69dea929793f41b284b6169e5f48f91c P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.122597 14474 tablet_replica.cc:333] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.123461 14474 raft_consensus.cc:2243] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.125262 14474 raft_consensus.cc:2272] T 543bace83eba44d6ab8955f3c9fdb2f8 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.129295 14474 tablet_replica.cc:333] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.130116 14474 raft_consensus.cc:2243] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.130715 14474 raft_consensus.cc:2272] T 9ad9fbad184a4753852b26a96e13dc49 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.133843 14474 tablet_replica.cc:333] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.134653 14474 raft_consensus.cc:2243] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.136195 14474 raft_consensus.cc:2272] T c939561ea4c94526ab504d3c4253671b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.139114 14474 tablet_replica.cc:333] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.139638 14474 raft_consensus.cc:2243] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.140203 14474 raft_consensus.cc:2272] T 13a6f0c3a1204df3b6e06881227e59a7 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.142843 14474 tablet_replica.cc:333] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.143368 14474 raft_consensus.cc:2243] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.144874 14474 raft_consensus.cc:2272] T 8e6bbb4b9f7b416aad8d32612da1e7e1 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.147588 14474 tablet_replica.cc:333] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.148169 14474 raft_consensus.cc:2243] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.148805 14474 raft_consensus.cc:2272] T f4ead399c25f4fba981e4ae8dc56595d P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.151540 14474 tablet_replica.cc:333] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.152096 14474 raft_consensus.cc:2243] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.152688 14474 raft_consensus.cc:2272] T 15c812af74344306b9c9ab661cdbb582 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.155148 14474 tablet_replica.cc:333] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.155835 14474 raft_consensus.cc:2243] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.156474 14474 raft_consensus.cc:2272] T 171e1f8df0714984a5c04e9a4c53c90b P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.159198 14474 tablet_replica.cc:333] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.159734 14474 raft_consensus.cc:2243] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.160387 14474 raft_consensus.cc:2272] T 83fcdef153e7447d84951d92004c6594 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.163015 14474 tablet_replica.cc:333] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.163568 14474 raft_consensus.cc:2243] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.164215 14474 raft_consensus.cc:2272] T b1ba8098e9a343f5826bcd03b7821877 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.166854 14474 tablet_replica.cc:333] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.167399 14474 raft_consensus.cc:2243] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.168084 14474 raft_consensus.cc:2272] T 007cad1be85a4b9e8e1a28971ce3cc56 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.170475 14474 tablet_replica.cc:333] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.170994 14474 raft_consensus.cc:2243] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.172413 14474 raft_consensus.cc:2272] T c96bcd6c5d2745d4af954e66e23b0e4f P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.174825 14474 tablet_replica.cc:333] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.175423 14474 raft_consensus.cc:2243] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.176071 14474 raft_consensus.cc:2272] T 39ecd61e5f504f318519347d1299751e P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.178719 14474 tablet_replica.cc:333] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7: stopping tablet replica
I20260709 13:10:05.179252 14474 raft_consensus.cc:2243] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.180539 14474 raft_consensus.cc:2272] T a90f7e1b06aa47b1a7a3bad9feba4d21 P 3f0e42f9dab447d5bc309baaacba2ee7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.270725 14474 tablet_server.cc:196] TabletServer@127.14.34.132:0 shutdown complete.
I20260709 13:10:05.354584 14474 master.cc:562] Master@127.14.34.190:40037 shutting down...
W20260709 13:10:05.393507 22062 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:10:05.394690 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.395316 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.395612 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2ed4f192b33049bd8840c60f38337165: stopping tablet replica
I20260709 13:10:05.419265 14474 master.cc:584] Master@127.14.34.190:40037 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33759 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:05.517710 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:34571
I20260709 13:10:05.519627 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:05.526170 23279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.526269 23280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.526296 23282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:05.527133 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:05.528169 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:05.528347 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:05.528465 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602605528455 us; error 0 us; skew 500 ppm
I20260709 13:10:05.528925 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:05.531296 14474 webserver.cc:533] Webserver started at http://127.14.34.190:40465/ using document root <none> and password file <none>
I20260709 13:10:05.531782 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:05.531947 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:05.532155 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:05.533409 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "10f83c29b21146b3b3079d88fcc64847"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.537945 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:05.541388 23287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.542230 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:05.542568 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "10f83c29b21146b3b3079d88fcc64847"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.542835 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:05.555182 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:05.556632 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:05.598489 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:34571
I20260709 13:10:05.598606 23338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:34571 every 8 connection(s)
I20260709 13:10:05.602815 23339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:05.614259 23339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847: Bootstrap starting.
I20260709 13:10:05.619108 23339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:05.623525 23339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847: No bootstrap required, opened a new log
I20260709 13:10:05.625733 23339 raft_consensus.cc:359] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER }
I20260709 13:10:05.626274 23339 raft_consensus.cc:385] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:05.626466 23339 raft_consensus.cc:740] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10f83c29b21146b3b3079d88fcc64847, State: Initialized, Role: FOLLOWER
I20260709 13:10:05.626974 23339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER }
I20260709 13:10:05.627383 23339 raft_consensus.cc:399] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:05.627578 23339 raft_consensus.cc:493] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:05.627789 23339 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:05.632560 23339 raft_consensus.cc:515] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER }
I20260709 13:10:05.633023 23339 leader_election.cc:304] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10f83c29b21146b3b3079d88fcc64847; no voters: 
I20260709 13:10:05.634210 23339 leader_election.cc:290] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:05.634599 23342 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:05.635946 23342 raft_consensus.cc:697] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 1 LEADER]: Becoming Leader. State: Replica: 10f83c29b21146b3b3079d88fcc64847, State: Running, Role: LEADER
I20260709 13:10:05.636644 23342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER }
I20260709 13:10:05.637156 23339 sys_catalog.cc:565] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:05.643023 23343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10f83c29b21146b3b3079d88fcc64847" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER } }
I20260709 13:10:05.643136 23344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10f83c29b21146b3b3079d88fcc64847. Latest consensus state: current_term: 1 leader_uuid: "10f83c29b21146b3b3079d88fcc64847" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f83c29b21146b3b3079d88fcc64847" member_type: VOTER } }
I20260709 13:10:05.644150 23343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:05.644207 23344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:05.647200 23349 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:05.652128 23349 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:05.656920 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:05.661840 23349 catalog_manager.cc:1383] Generated new cluster ID: 6cff3bb7dfef445a8b4fe9343d66e07e
I20260709 13:10:05.662213 23349 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:05.678987 23349 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:05.680540 23349 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:05.702711 23349 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847: Generated new TSK 0
I20260709 13:10:05.703424 23349 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:05.723649 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:05.730480 23360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.731864 23361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.732941 23363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:05.733862 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:05.734946 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:05.735172 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:05.735352 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602605735339 us; error 0 us; skew 500 ppm
I20260709 13:10:05.735965 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:05.738427 14474 webserver.cc:533] Webserver started at http://127.14.34.129:36423/ using document root <none> and password file <none>
I20260709 13:10:05.738936 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:05.739117 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:05.739398 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:05.740587 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "9edbc54eb84145c6a1e0a9573739cc08"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.745592 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:10:05.749254 23368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.750334 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:05.750737 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "9edbc54eb84145c6a1e0a9573739cc08"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.751014 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:05.773195 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:05.774595 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:05.776134 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:05.778525 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:05.778712 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.778978 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:05.779157 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.821727 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:46159
I20260709 13:10:05.821859 23430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:46159 every 8 connection(s)
I20260709 13:10:05.827639 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:05.835954 23435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.836768 23436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.841423 23438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:05.841734 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:05.842990 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:05.843232 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:05.843475 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602605843454 us; error 0 us; skew 500 ppm
I20260709 13:10:05.844341 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:05.846887 23431 heartbeater.cc:344] Connected to a master server at 127.14.34.190:34571
I20260709 13:10:05.847327 23431 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:05.847868 14474 webserver.cc:533] Webserver started at http://127.14.34.130:43639/ using document root <none> and password file <none>
I20260709 13:10:05.848273 23431 heartbeater.cc:507] Master 127.14.34.190:34571 requested a full tablet report, sending...
I20260709 13:10:05.848552 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:05.848879 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:05.849169 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:05.850704 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "5cfa267265024839aa61c102070a9225"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.850796 23304 ts_manager.cc:194] Registered new tserver with Master: 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159)
I20260709 13:10:05.852926 23304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52520
I20260709 13:10:05.856225 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:05.860420 23443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.861362 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:05.861702 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "5cfa267265024839aa61c102070a9225"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.862000 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:05.876370 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:05.877609 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:05.879122 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:05.881321 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:05.881546 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.881781 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:05.881945 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.922803 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:44465
I20260709 13:10:05.922909 23505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:44465 every 8 connection(s)
I20260709 13:10:05.927762 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:05.935415 23509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:05.941489 23510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:05.942490 23506 heartbeater.cc:344] Connected to a master server at 127.14.34.190:34571
I20260709 13:10:05.943157 23506 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:05.944729 23506 heartbeater.cc:507] Master 127.14.34.190:34571 requested a full tablet report, sending...
I20260709 13:10:05.946169 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:05.948227 23304 ts_manager.cc:194] Registered new tserver with Master: 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
W20260709 13:10:05.949580 23512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:05.949659 23304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52528
I20260709 13:10:05.951216 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:05.951495 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:05.951702 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602605951685 us; error 0 us; skew 500 ppm
I20260709 13:10:05.952428 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:05.955073 14474 webserver.cc:533] Webserver started at http://127.14.34.131:43631/ using document root <none> and password file <none>
I20260709 13:10:05.955648 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:05.955870 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:05.956164 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:05.957572 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "df50de2bac7d4472bedef8b1eaa2d668"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.962498 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:05.966481 23517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:05.967386 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:10:05.967756 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "df50de2bac7d4472bedef8b1eaa2d668"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:05.968084 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.007172 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.008538 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.010212 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:06.012707 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:06.012955 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.013216 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:06.013406 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.060137 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:38037
I20260709 13:10:06.060256 23579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:38037 every 8 connection(s)
I20260709 13:10:06.075847 23580 heartbeater.cc:344] Connected to a master server at 127.14.34.190:34571
I20260709 13:10:06.076452 23580 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:06.077337 23580 heartbeater.cc:507] Master 127.14.34.190:34571 requested a full tablet report, sending...
I20260709 13:10:06.079632 23304 ts_manager.cc:194] Registered new tserver with Master: df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.079828 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016185045s
I20260709 13:10:06.081274 23304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52536
I20260709 13:10:06.110183 23304 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52542:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:06.113237 23304 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:06.213716 23471 tablet_service.cc:1511] Processing CreateTablet for tablet 0aacc32d26e14da29e12fd1c823718ce (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:06.215420 23471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aacc32d26e14da29e12fd1c823718ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.215548 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 0aacc32d26e14da29e12fd1c823718ce (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:06.216988 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aacc32d26e14da29e12fd1c823718ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.216920 23542 tablet_service.cc:1511] Processing CreateTablet for tablet adde4a5334d0423a9db19659d4d7139c (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:06.218508 23542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adde4a5334d0423a9db19659d4d7139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.219178 23470 tablet_service.cc:1511] Processing CreateTablet for tablet 25668a7d7a054dd0a139c0d36614df0a (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:06.220031 23468 tablet_service.cc:1511] Processing CreateTablet for tablet adde4a5334d0423a9db19659d4d7139c (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:06.220749 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25668a7d7a054dd0a139c0d36614df0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.221577 23468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adde4a5334d0423a9db19659d4d7139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.222563 23392 tablet_service.cc:1511] Processing CreateTablet for tablet e8458f9d27984e858bdd8cc62c723eb6 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:06.223282 23543 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e2977af440f6a760dfd1f51cd943 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:06.224014 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8458f9d27984e858bdd8cc62c723eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.224682 23543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e2977af440f6a760dfd1f51cd943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.225590 23394 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e2977af440f6a760dfd1f51cd943 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:06.227152 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e2977af440f6a760dfd1f51cd943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.227053 23469 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67e2977af440f6a760dfd1f51cd943 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:06.228648 23469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67e2977af440f6a760dfd1f51cd943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.231225 23544 tablet_service.cc:1511] Processing CreateTablet for tablet 25668a7d7a054dd0a139c0d36614df0a (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:06.231340 23393 tablet_service.cc:1511] Processing CreateTablet for tablet adde4a5334d0423a9db19659d4d7139c (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:06.232744 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25668a7d7a054dd0a139c0d36614df0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.232906 23393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adde4a5334d0423a9db19659d4d7139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.222590 23396 tablet_service.cc:1511] Processing CreateTablet for tablet 0aacc32d26e14da29e12fd1c823718ce (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:06.239110 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aacc32d26e14da29e12fd1c823718ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.223945 23395 tablet_service.cc:1511] Processing CreateTablet for tablet 25668a7d7a054dd0a139c0d36614df0a (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:06.245920 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25668a7d7a054dd0a139c0d36614df0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.255038 23467 tablet_service.cc:1511] Processing CreateTablet for tablet e8458f9d27984e858bdd8cc62c723eb6 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:06.256537 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8458f9d27984e858bdd8cc62c723eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.296535 23595 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.305747 23541 tablet_service.cc:1511] Processing CreateTablet for tablet e8458f9d27984e858bdd8cc62c723eb6 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:06.307438 23541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8458f9d27984e858bdd8cc62c723eb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.308738 23466 tablet_service.cc:1511] Processing CreateTablet for tablet b3b45a145ac44ffdaeecabf51efc81ad (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:06.309409 23596 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.310286 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b45a145ac44ffdaeecabf51efc81ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.314433 23394 tablet_service.cc:1511] Processing CreateTablet for tablet b3b45a145ac44ffdaeecabf51efc81ad (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:06.315847 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b45a145ac44ffdaeecabf51efc81ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.318046 23596 tablet_bootstrap.cc:654] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.324357 23597 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.327378 23595 tablet_bootstrap.cc:654] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.336866 23597 tablet_bootstrap.cc:654] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.358597 23392 tablet_service.cc:1511] Processing CreateTablet for tablet 53fa6babac754493b507c3798db9bb02 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:06.360203 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fa6babac754493b507c3798db9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.360517 23467 tablet_service.cc:1511] Processing CreateTablet for tablet 53fa6babac754493b507c3798db9bb02 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:06.364871 23543 tablet_service.cc:1511] Processing CreateTablet for tablet 53fa6babac754493b507c3798db9bb02 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:06.365162 23542 tablet_service.cc:1511] Processing CreateTablet for tablet b3b45a145ac44ffdaeecabf51efc81ad (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:06.366783 23542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b45a145ac44ffdaeecabf51efc81ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.370642 23543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fa6babac754493b507c3798db9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.374718 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fa6babac754493b507c3798db9bb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.381423 23391 tablet_service.cc:1511] Processing CreateTablet for tablet 33ed3e88f3aa4dc19b8b019b83a1c409 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:06.383013 23391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ed3e88f3aa4dc19b8b019b83a1c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.391170 23595 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.391762 23595 ts_tablet_manager.cc:1403] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.006s
I20260709 13:10:06.394763 23595 raft_consensus.cc:359] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.395503 23595 raft_consensus.cc:385] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.395788 23595 raft_consensus.cc:740] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.396687 23595 consensus_queue.cc:260] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.409063 23466 tablet_service.cc:1511] Processing CreateTablet for tablet 33ed3e88f3aa4dc19b8b019b83a1c409 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:06.410542 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ed3e88f3aa4dc19b8b019b83a1c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.412312 23596 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.412876 23596 ts_tablet_manager.cc:1403] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.016s
I20260709 13:10:06.416432 23596 raft_consensus.cc:359] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.417304 23596 raft_consensus.cc:385] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.421046 23596 raft_consensus.cc:740] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.421990 23596 consensus_queue.cc:260] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.427157 23541 tablet_service.cc:1511] Processing CreateTablet for tablet 33ed3e88f3aa4dc19b8b019b83a1c409 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:06.428931 23541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ed3e88f3aa4dc19b8b019b83a1c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.430788 23470 tablet_service.cc:1511] Processing CreateTablet for tablet c62d2483a0e542ca96a06c7bbcf6af70 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:06.432305 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62d2483a0e542ca96a06c7bbcf6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.432204 23394 tablet_service.cc:1511] Processing CreateTablet for tablet c62d2483a0e542ca96a06c7bbcf6af70 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:06.433554 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62d2483a0e542ca96a06c7bbcf6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.437721 23597 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.439445 23597 ts_tablet_manager.cc:1403] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.051s
I20260709 13:10:06.438463 23544 tablet_service.cc:1511] Processing CreateTablet for tablet c62d2483a0e542ca96a06c7bbcf6af70 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:06.442520 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:06.443117 23466 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:06.443846 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.444548 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.445000 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62d2483a0e542ca96a06c7bbcf6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.446442 23597 raft_consensus.cc:359] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.451504 23603 raft_consensus.cc:493] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.451683 23506 heartbeater.cc:499] Master 127.14.34.190:34571 was elected leader, sending a full tablet report...
I20260709 13:10:06.452044 23603 raft_consensus.cc:515] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.450168 23597 raft_consensus.cc:385] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.456981 23597 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.457576 23431 heartbeater.cc:499] Master 127.14.34.190:34571 was elected leader, sending a full tablet report...
I20260709 13:10:06.458257 23597 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.467765 23393 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5 (DEFAULT_TABLE table=test-workload [id=146f3f2887fc44deabb9505e55b990f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:06.469168 23393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3d14c4f354b79a2e4cfc52c20cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.495091 23595 ts_tablet_manager.cc:1434] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.017s
I20260709 13:10:06.496439 23595 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.507290 23580 heartbeater.cc:499] Master 127.14.34.190:34571 was elected leader, sending a full tablet report...
I20260709 13:10:06.507472 23596 ts_tablet_manager.cc:1434] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.094s	user 0.032s	sys 0.028s
I20260709 13:10:06.508773 23596 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.509750 23597 ts_tablet_manager.cc:1434] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.070s	user 0.028s	sys 0.018s
I20260709 13:10:06.510900 23597 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.522866 23595 tablet_bootstrap.cc:654] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.528671 23596 tablet_bootstrap.cc:654] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.531790 23603 leader_election.cc:290] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037), 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159)
I20260709 13:10:06.544811 23604 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.545503 23604 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.553838 23604 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:06.554978 23596 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.555568 23596 ts_tablet_manager.cc:1403] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.009s
W20260709 13:10:06.566213 23581 tablet.cc:2406] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:06.567811 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
W20260709 13:10:06.570346 23445 leader_election.cc:343] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.570632 23596 raft_consensus.cc:359] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.577487 23595 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.577756 23596 raft_consensus.cc:385] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.578190 23596 raft_consensus.cc:740] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.578249 23595 ts_tablet_manager.cc:1403] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.004s
I20260709 13:10:06.579048 23596 consensus_queue.cc:260] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.581282 23596 ts_tablet_manager.cc:1434] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:10:06.582859 23597 tablet_bootstrap.cc:654] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.583118 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.583328 23603 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.583942 23603 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
W20260709 13:10:06.584926 23445 leader_election.cc:343] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.585523 23445 leader_election.cc:304] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cfa267265024839aa61c102070a9225; no voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:06.586413 23603 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.586490 23602 raft_consensus.cc:2749] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:06.589377 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.590276 23406 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:06.592522 23445 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:06.585753 23596 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.594555 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.600229 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.601480 23602 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.602447 23602 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.603134 23602 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:06.604415 23520 leader_election.cc:343] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:06.605630 23445 leader_election.cc:343] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.606379 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.607792 23595 raft_consensus.cc:359] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.608991 23595 raft_consensus.cc:385] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.609306 23595 raft_consensus.cc:740] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
W20260709 13:10:06.609486 23519 leader_election.cc:343] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.609985 23519 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:06.610118 23595 consensus_queue.cc:260] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.611526 23604 raft_consensus.cc:2749] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:06.613188 23595 ts_tablet_manager.cc:1434] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:10:06.614957 23595 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.621188 23596 tablet_bootstrap.cc:654] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.621304 23602 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.623270 23595 tablet_bootstrap.cc:654] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.624491 23597 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.624706 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:06.625083 23597 ts_tablet_manager.cc:1403] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.114s	user 0.021s	sys 0.023s
I20260709 13:10:06.625401 23406 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.628383 23597 raft_consensus.cc:359] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.629309 23597 raft_consensus.cc:385] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.629612 23597 raft_consensus.cc:740] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.631708 23597 consensus_queue.cc:260] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.634718 23597 ts_tablet_manager.cc:1434] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:10:06.636293 23597 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.637866 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
W20260709 13:10:06.639490 23445 leader_election.cc:343] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.640050 23602 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.635701 23406 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:06.641544 23445 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:06.646909 23597 tablet_bootstrap.cc:654] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.648214 23602 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.649691 23602 raft_consensus.cc:697] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:06.650701 23602 consensus_queue.cc:237] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
W20260709 13:10:06.651736 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:06.659109 23596 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.659801 23596 ts_tablet_manager.cc:1403] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.074s	user 0.030s	sys 0.008s
I20260709 13:10:06.661027 23595 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.661576 23595 ts_tablet_manager.cc:1403] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.013s
I20260709 13:10:06.661479 23597 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.662308 23597 ts_tablet_manager.cc:1403] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 13:10:06.663034 23596 raft_consensus.cc:359] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.663831 23596 raft_consensus.cc:385] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.664155 23596 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.664813 23595 raft_consensus.cc:359] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.664947 23596 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.665656 23595 raft_consensus.cc:385] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.666241 23595 raft_consensus.cc:740] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.665582 23597 raft_consensus.cc:359] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.667114 23597 raft_consensus.cc:385] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.665896 23304 catalog_manager.cc:5697] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.667137 23595 consensus_queue.cc:260] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.667795 23597 raft_consensus.cc:740] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.667935 23596 ts_tablet_manager.cc:1434] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:06.669387 23597 consensus_queue.cc:260] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.669947 23595 ts_tablet_manager.cc:1434] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:10:06.672004 23595 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.672508 23597 ts_tablet_manager.cc:1434] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:06.673715 23597 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.679600 23595 tablet_bootstrap.cc:654] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.681195 23597 tablet_bootstrap.cc:654] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.686333 23596 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.687860 23597 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.688501 23597 ts_tablet_manager.cc:1403] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:10:06.691568 23597 raft_consensus.cc:359] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.692368 23597 raft_consensus.cc:385] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.692696 23597 raft_consensus.cc:740] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.693472 23597 consensus_queue.cc:260] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.695832 23597 ts_tablet_manager.cc:1434] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:06.696882 23597 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.700115 23595 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.700819 23595 ts_tablet_manager.cc:1403] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:10:06.702359 23597 tablet_bootstrap.cc:654] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.705392 23596 tablet_bootstrap.cc:654] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.705957 23595 raft_consensus.cc:359] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.706914 23595 raft_consensus.cc:385] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.707288 23595 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.708302 23595 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.710628 23601 raft_consensus.cc:493] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.713043 23601 raft_consensus.cc:515] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.717088 23595 ts_tablet_manager.cc:1434] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.008s
I20260709 13:10:06.722184 23595 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.717605 23601 leader_election.cc:290] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.734253 23595 tablet_bootstrap.cc:654] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.743198 23596 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.743925 23596 ts_tablet_manager.cc:1403] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.008s
I20260709 13:10:06.747347 23596 raft_consensus.cc:359] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.748153 23596 raft_consensus.cc:385] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.748437 23596 raft_consensus.cc:740] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.749727 23597 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.750322 23597 ts_tablet_manager.cc:1403] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.036s
I20260709 13:10:06.752594 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.753371 23555 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 0.
I20260709 13:10:06.753855 23597 raft_consensus.cc:359] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.754683 23597 raft_consensus.cc:385] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.754858 23604 raft_consensus.cc:493] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.754987 23597 raft_consensus.cc:740] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.755535 23604 raft_consensus.cc:515] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.755888 23596 consensus_queue.cc:260] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.758874 23596 ts_tablet_manager.cc:1434] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:06.758512 23597 consensus_queue.cc:260] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.759586 23370 leader_election.cc:304] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:06.760818 23601 raft_consensus.cc:2804] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.761340 23601 raft_consensus.cc:493] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.761672 23601 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.759601 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.764626 23623 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.765374 23623 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.766475 23595 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.767063 23595 ts_tablet_manager.cc:1403] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 13:10:06.768378 23623 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
W20260709 13:10:06.769686 23519 leader_election.cc:343] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.771020 23601 raft_consensus.cc:515] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.773293 23601 leader_election.cc:290] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 election: Requested vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.774601 23595 raft_consensus.cc:359] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.775398 23595 raft_consensus.cc:385] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.775700 23595 raft_consensus.cc:740] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.776480 23595 consensus_queue.cc:260] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.777441 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.778358 23481 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 0.
I20260709 13:10:06.778407 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.778717 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.779848 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
W20260709 13:10:06.780550 23371 leader_election.cc:343] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.780158 23604 leader_election.cc:290] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:06.759967 23596 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.782334 23595 ts_tablet_manager.cc:1434] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:10:06.783464 23595 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.783671 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:06.784425 23554 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.787489 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.788292 23480 raft_consensus.cc:2468] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 0.
I20260709 13:10:06.780643 23479 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.789888 23596 tablet_bootstrap.cc:654] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.789808 23520 leader_election.cc:304] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:06.791250 23604 raft_consensus.cc:2804] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.791630 23604 raft_consensus.cc:493] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.791967 23604 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:06.795815 23370 leader_election.cc:343] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.798756 23370 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08; no voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:06.790221 23595 tablet_bootstrap.cc:654] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.800866 23601 raft_consensus.cc:2749] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:06.802531 23604 raft_consensus.cc:515] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.805346 23596 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.806002 23596 ts_tablet_manager.cc:1403] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 13:10:06.806268 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:06.807260 23406 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.809412 23596 raft_consensus.cc:359] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.810346 23596 raft_consensus.cc:385] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.810812 23596 raft_consensus.cc:740] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.811909 23596 consensus_queue.cc:260] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.812466 23554 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 1.
I20260709 13:10:06.810580 23479 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 1.
I20260709 13:10:06.815448 23597 ts_tablet_manager.cc:1434] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.011s
I20260709 13:10:06.816666 23596 ts_tablet_manager.cc:1434] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:06.813874 23370 leader_election.cc:304] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:06.817889 23601 raft_consensus.cc:2804] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.818450 23601 raft_consensus.cc:697] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 LEADER]: Becoming Leader. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Running, Role: LEADER
I20260709 13:10:06.816562 23602 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.820068 23602 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.820147 23601 consensus_queue.cc:237] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.823884 23597 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.818356 23596 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.827402 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.828218 23555 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:06.829715 23445 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:06.831037 23603 raft_consensus.cc:2804] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.831607 23603 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.832119 23603 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.832819 23597 tablet_bootstrap.cc:654] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.833379 23623 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.833942 23623 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.824661 23405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.835755 23602 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.836326 23623 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.838907 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.839699 23595 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.840298 23595 ts_tablet_manager.cc:1403] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.017s
W20260709 13:10:06.840595 23445 leader_election.cc:343] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:06.841786 23371 leader_election.cc:343] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.842231 23596 tablet_bootstrap.cc:654] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.842875 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.843683 23554 raft_consensus.cc:2468] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 0.
I20260709 13:10:06.843531 23304 catalog_manager.cc:5697] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "9edbc54eb84145c6a1e0a9573739cc08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.845465 23370 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225
I20260709 13:10:06.845958 23595 raft_consensus.cc:359] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.846436 23601 raft_consensus.cc:2804] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.846985 23595 raft_consensus.cc:385] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.847048 23601 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.847527 23595 raft_consensus.cc:740] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.847620 23601 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.851456 23595 consensus_queue.cc:260] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.854423 23595 ts_tablet_manager.cc:1434] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.008s
I20260709 13:10:06.855000 23604 leader_election.cc:290] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:06.855651 23595 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.857784 23406 raft_consensus.cc:2468] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 1.
I20260709 13:10:06.859970 23519 leader_election.cc:304] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:06.864224 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:06.864981 23479 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.869383 23595 tablet_bootstrap.cc:654] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.872305 23603 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.872027 23597 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:06.873731 23597 ts_tablet_manager.cc:1403] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.015s
I20260709 13:10:06.876756 23596 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.877363 23596 ts_tablet_manager.cc:1403] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.009s
I20260709 13:10:06.878079 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:06.878832 23554 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.880441 23597 raft_consensus.cc:359] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.880820 23596 raft_consensus.cc:359] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.874861 23603 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.882081 23597 raft_consensus.cc:385] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.881965 23601 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.883132 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:06.887208 23597 raft_consensus.cc:740] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.883121 23604 raft_consensus.cc:2804] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.888108 23604 raft_consensus.cc:697] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:06.888324 23597 consensus_queue.cc:260] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
W20260709 13:10:06.888936 23445 leader_election.cc:343] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.891824 23597 ts_tablet_manager.cc:1434] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:10:06.893142 23597 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:06.893872 23601 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 election: Requested vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.895013 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
W20260709 13:10:06.896618 23371 leader_election.cc:343] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:06.886468 23479 raft_consensus.cc:2468] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 1.
I20260709 13:10:06.897346 23595 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:06.896509 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:06.898226 23555 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.896509 23604 consensus_queue.cc:237] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:06.886467 23554 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:06.902863 23445 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:06.904209 23603 raft_consensus.cc:2804] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.904769 23603 raft_consensus.cc:697] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:06.905295 23555 raft_consensus.cc:2468] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 1.
I20260709 13:10:06.882081 23596 raft_consensus.cc:385] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.905663 23603 consensus_queue.cc:237] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.906481 23596 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.906664 23370 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225
I20260709 13:10:06.898283 23595 ts_tablet_manager.cc:1403] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.008s
I20260709 13:10:06.907975 23601 raft_consensus.cc:2804] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.905627 23597 tablet_bootstrap.cc:654] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.910243 23601 raft_consensus.cc:697] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 LEADER]: Becoming Leader. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Running, Role: LEADER
I20260709 13:10:06.910238 23595 raft_consensus.cc:359] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.911142 23595 raft_consensus.cc:385] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.911474 23595 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.911573 23601 consensus_queue.cc:237] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.912281 23595 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.912635 23304 catalog_manager.cc:5697] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 0 to 1, leader changed from <none> to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.914710 23595 ts_tablet_manager.cc:1434] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:06.915820 23595 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:06.918447 23596 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.921880 23596 ts_tablet_manager.cc:1434] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.004s
I20260709 13:10:06.923404 23596 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:06.937212 23602 raft_consensus.cc:493] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.940631 23596 tablet_bootstrap.cc:654] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.941431 23595 tablet_bootstrap.cc:654] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.940742 23602 raft_consensus.cc:515] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.947005 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.947767 23406 raft_consensus.cc:2468] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:06.948525 23602 leader_election.cc:290] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.948637 23604 raft_consensus.cc:493] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.948807 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:06.949378 23604 raft_consensus.cc:515] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.953573 23445 leader_election.cc:304] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:06.953692 23555 raft_consensus.cc:2468] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:06.954526 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:06.955304 23406 raft_consensus.cc:2468] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 0.
I20260709 13:10:06.956732 23519 leader_election.cc:304] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:06.957834 23627 raft_consensus.cc:2804] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.958258 23627 raft_consensus.cc:493] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.958631 23627 raft_consensus.cc:3060] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.958841 23602 raft_consensus.cc:2804] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:06.959316 23602 raft_consensus.cc:493] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.959707 23602 raft_consensus.cc:3060] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.963003 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:06.963922 23604 leader_election.cc:290] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:06.968082 23602 raft_consensus.cc:515] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.969463 23479 raft_consensus.cc:2393] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df50de2bac7d4472bedef8b1eaa2d668 in current term 1: Already voted for candidate 5cfa267265024839aa61c102070a9225 in this term.
I20260709 13:10:06.976114 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:06.976750 23406 raft_consensus.cc:3060] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.977172 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:06.978397 23602 leader_election.cc:290] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:06.982389 23627 raft_consensus.cc:515] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.983772 23555 raft_consensus.cc:2393] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cfa267265024839aa61c102070a9225 in current term 1: Already voted for candidate df50de2bac7d4472bedef8b1eaa2d668 in this term.
I20260709 13:10:06.988034 23406 raft_consensus.cc:2468] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:06.989250 23445 leader_election.cc:304] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:06.990931 23596 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:06.988325 23304 catalog_manager.cc:5697] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "9edbc54eb84145c6a1e0a9573739cc08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.991146 23405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:06.991657 23596 ts_tablet_manager.cc:1403] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.023s
I20260709 13:10:06.991994 23405 raft_consensus.cc:2393] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df50de2bac7d4472bedef8b1eaa2d668 in current term 1: Already voted for candidate 5cfa267265024839aa61c102070a9225 in this term.
I20260709 13:10:06.993443 23603 raft_consensus.cc:2804] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.994001 23603 raft_consensus.cc:697] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:06.994982 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b45a145ac44ffdaeecabf51efc81ad" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:06.994831 23603 consensus_queue.cc:237] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:06.996539 23520 leader_election.cc:304] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:06.997412 23604 raft_consensus.cc:2749] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:06.998143 23627 leader_election.cc:290] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:07.000088 23303 catalog_manager.cc:5697] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.001706 23595 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:07.002305 23595 ts_tablet_manager.cc:1403] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.087s	user 0.024s	sys 0.019s
I20260709 13:10:07.004446 23597 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:07.004967 23597 ts_tablet_manager.cc:1403] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.032s
I20260709 13:10:07.005383 23595 raft_consensus.cc:359] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.006176 23595 raft_consensus.cc:385] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.006520 23595 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.007493 23595 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.008126 23597 raft_consensus.cc:359] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.008878 23597 raft_consensus.cc:385] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.009164 23597 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.009549 23596 raft_consensus.cc:359] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.010012 23595 ts_tablet_manager.cc:1434] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:07.010340 23596 raft_consensus.cc:385] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.009999 23597 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.016016 23595 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:07.017345 23597 ts_tablet_manager.cc:1434] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:07.011270 23596 raft_consensus.cc:740] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.020359 23596 consensus_queue.cc:260] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.022256 23601 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.022509 23595 tablet_bootstrap.cc:654] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.022825 23601 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.023308 23596 ts_tablet_manager.cc:1434] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:10:07.024464 23596 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:07.025141 23601 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.026821 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:07.029238 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:07.030197 23555 raft_consensus.cc:2393] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9edbc54eb84145c6a1e0a9573739cc08 in current term 1: Already voted for candidate 5cfa267265024839aa61c102070a9225 in this term.
I20260709 13:10:07.032325 23370 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08; no voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:07.033427 23601 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.041656 23596 tablet_bootstrap.cc:654] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.047745 23601 raft_consensus.cc:2749] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.052364 23303 catalog_manager.cc:5697] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.062809 23597 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:07.067752 23595 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:07.068290 23595 ts_tablet_manager.cc:1403] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.019s
I20260709 13:10:07.070588 23596 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:07.071177 23596 ts_tablet_manager.cc:1403] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.002s
I20260709 13:10:07.074081 23595 raft_consensus.cc:359] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.074901 23595 raft_consensus.cc:385] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.075181 23595 raft_consensus.cc:740] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.075472 23597 tablet_bootstrap.cc:654] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.075871 23595 consensus_queue.cc:260] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.078997 23596 raft_consensus.cc:359] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.079757 23596 raft_consensus.cc:385] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.080044 23596 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.080777 23596 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.084115 23596 ts_tablet_manager.cc:1434] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:07.084983 23595 ts_tablet_manager.cc:1434] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:10:07.086170 23595 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:07.086793 23596 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:07.092386 23595 tablet_bootstrap.cc:654] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.097427 23596 tablet_bootstrap.cc:654] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.098222 23597 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:07.098753 23597 ts_tablet_manager.cc:1403] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.010s
I20260709 13:10:07.101454 23597 raft_consensus.cc:359] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.102154 23597 raft_consensus.cc:385] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.102434 23597 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.103235 23597 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.105501 23597 ts_tablet_manager.cc:1434] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:10:07.106449 23597 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:07.112443 23597 tablet_bootstrap.cc:654] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.116714 23595 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: No bootstrap required, opened a new log
I20260709 13:10:07.117069 23595 ts_tablet_manager.cc:1403] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.009s
I20260709 13:10:07.119513 23597 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:07.119315 23595 raft_consensus.cc:359] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.119968 23595 raft_consensus.cc:385] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.120018 23597 ts_tablet_manager.cc:1403] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:10:07.120307 23595 raft_consensus.cc:740] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.121031 23595 consensus_queue.cc:260] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.121588 23596 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:07.122056 23596 ts_tablet_manager.cc:1403] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.010s
I20260709 13:10:07.122686 23597 raft_consensus.cc:359] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.123411 23597 raft_consensus.cc:385] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.123674 23597 raft_consensus.cc:740] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.124373 23597 consensus_queue.cc:260] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.124578 23596 raft_consensus.cc:359] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.125278 23596 raft_consensus.cc:385] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.125569 23596 raft_consensus.cc:740] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.123081 23595 ts_tablet_manager.cc:1434] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:07.126358 23597 ts_tablet_manager.cc:1434] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:07.126368 23596 consensus_queue.cc:260] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.127379 23597 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: Bootstrap starting.
I20260709 13:10:07.128953 23596 ts_tablet_manager.cc:1434] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:10:07.130676 23596 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: Bootstrap starting.
I20260709 13:10:07.134070 23597 tablet_bootstrap.cc:654] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.136349 23596 tablet_bootstrap.cc:654] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.140493 23597 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: No bootstrap required, opened a new log
I20260709 13:10:07.141037 23597 ts_tablet_manager.cc:1403] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.002s
I20260709 13:10:07.142184 23596 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: No bootstrap required, opened a new log
I20260709 13:10:07.142585 23596 ts_tablet_manager.cc:1403] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:10:07.143967 23597 raft_consensus.cc:359] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.144747 23597 raft_consensus.cc:385] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.144696 23596 raft_consensus.cc:359] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.145321 23596 raft_consensus.cc:385] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.145296 23597 raft_consensus.cc:740] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.145727 23596 raft_consensus.cc:740] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.146339 23596 consensus_queue.cc:260] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.146453 23597 consensus_queue.cc:260] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.148399 23596 ts_tablet_manager.cc:1434] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:07.150202 23597 ts_tablet_manager.cc:1434] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:07.152029 23602 raft_consensus.cc:493] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.152606 23602 raft_consensus.cc:515] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.154683 23602 leader_election.cc:290] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.156263 23555 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.156653 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:07.157346 23406 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.158363 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:07.158618 23445 leader_election.cc:304] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.159122 23554 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.159998 23602 raft_consensus.cc:2804] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.160439 23602 raft_consensus.cc:493] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.160768 23602 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.163623 23627 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.164170 23627 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.165506 23603 consensus_queue.cc:1048] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.167495 23602 raft_consensus.cc:515] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.169137 23627 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:07.169742 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:07.169847 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:07.170418 23406 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 1.
I20260709 13:10:07.172384 23519 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225
I20260709 13:10:07.174144 23602 leader_election.cc:290] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.174906 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:07.175449 23406 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.178588 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:07.179459 23554 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.181191 23406 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.181965 23627 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:07.182380 23445 leader_election.cc:304] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.183209 23602 raft_consensus.cc:2804] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.192698 23554 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.195495 23627 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cfa267265024839aa61c102070a9225)
I20260709 13:10:07.196414 23627 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.195658 23602 raft_consensus.cc:697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:07.197645 23602 consensus_queue.cc:237] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.201653 23602 consensus_queue.cc:1048] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.203608 23627 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.204691 23554 raft_consensus.cc:1240] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Rejecting Update request from peer 5cfa267265024839aa61c102070a9225 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:07.205794 23627 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:07.206995 23405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:07.208036 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:07.210072 23520 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:07.210671 23602 consensus_queue.cc:1059] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.211256 23627 raft_consensus.cc:2749] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:07.210846 23303 catalog_manager.cc:5697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.212330 23650 raft_consensus.cc:3055] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.212880 23650 raft_consensus.cc:740] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:07.214251 23650 consensus_queue.cc:260] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.215564 23650 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.276331 23650 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.276841 23650 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.278599 23650 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.279587 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:07.279963 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:07.280221 23406 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.280592 23554 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.281317 23445 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.282078 23650 raft_consensus.cc:2804] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.282382 23650 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.282657 23650 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.287629 23601 consensus_queue.cc:1048] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.288867 23650 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.290881 23650 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.292193 23627 consensus_queue.cc:1048] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.292439 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:07.293133 23406 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.293306 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:07.293870 23554 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.297350 23650 raft_consensus.cc:493] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.297865 23650 raft_consensus.cc:515] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.300788 23406 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.301390 23650 leader_election.cc:290] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.302284 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:07.302978 23555 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.305371 23445 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.306316 23602 raft_consensus.cc:2804] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.306803 23602 raft_consensus.cc:697] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:07.307101 23445 leader_election.cc:304] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:07.308037 23651 raft_consensus.cc:2804] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.307649 23602 consensus_queue.cc:237] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.308061 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:07.308441 23651 raft_consensus.cc:493] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.308847 23406 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.308868 23651 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.312146 23623 consensus_queue.cc:1048] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.315093 23554 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.319659 23651 raft_consensus.cc:515] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.320529 23302 catalog_manager.cc:5697] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.322064 23651 leader_election.cc:290] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.324368 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:07.324997 23406 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.325788 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:07.326474 23554 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.332662 23406 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.334040 23445 leader_election.cc:304] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.334949 23651 raft_consensus.cc:2804] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.335443 23651 raft_consensus.cc:697] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:07.336295 23651 consensus_queue.cc:237] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.339241 23554 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.347729 23604 consensus_queue.cc:1048] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.353567 23602 raft_consensus.cc:493] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.354259 23602 raft_consensus.cc:515] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.356602 23602 leader_election.cc:290] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.360745 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:07.361477 23554 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.362453 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:07.362676 23445 leader_election.cc:304] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:07.363173 23406 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 0.
I20260709 13:10:07.363745 23602 raft_consensus.cc:2804] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.364852 23602 raft_consensus.cc:493] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.365515 23602 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.364794 23302 catalog_manager.cc:5697] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.371958 23602 raft_consensus.cc:515] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.373960 23602 leader_election.cc:290] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:07.374913 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:07.374927 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:07.375720 23554 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.375939 23406 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.381816 23651 consensus_queue.cc:1048] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.382761 23406 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.382828 23554 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:07.383862 23445 leader_election.cc:304] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:07.384639 23651 raft_consensus.cc:2804] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.385087 23651 raft_consensus.cc:697] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:07.385922 23651 consensus_queue.cc:237] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:07.394505 23650 consensus_queue.cc:1048] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.395098 23303 catalog_manager.cc:5697] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.463740 23670 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.464361 23670 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:08.466714 23670 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:08.469719 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:08.472172 23671 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.477418 23671 consensus_queue.cc:1048] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.494812 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:08.495682 23554 raft_consensus.cc:2393] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cfa267265024839aa61c102070a9225 in current term 1: Already voted for candidate 9edbc54eb84145c6a1e0a9573739cc08 in this term.
I20260709 13:10:08.497911 23671 consensus_queue.cc:1048] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:08.500973 23671 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.502679 23671 consensus_queue.cc:1048] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.527489 23445 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cfa267265024839aa61c102070a9225; no voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:08.528540 23677 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.546432 23677 raft_consensus.cc:2749] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.552224 23669 consensus_queue.cc:1048] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.599503 23671 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.618242 23669 consensus_queue.cc:1048] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:08.627933 23682 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.639087 23303 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52536 (request call id 26) took 1228 ms. Trace:
I20260709 13:10:08.640014 23303 rpcz_store.cc:276] 0709 13:10:07.411169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.411330 (+   161us) service_pool.cc:224] Handling call
0709 13:10:08.638988 (+1227658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24152,"reported_tablets":1}
I20260709 13:10:08.670218 23671 consensus_queue.cc:1048] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.674770 23680 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.658601 23682 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:08.708366 23667 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cfa267265024839aa61c102070a9225)
I20260709 13:10:08.710443 23667 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:08.752224 23684 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.756579 23667 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:08.756495 23684 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:08.758410 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:08.758913 23684 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:08.759927 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08" is_pre_election: true
I20260709 13:10:08.760620 23406 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 1.
I20260709 13:10:08.762060 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:08.762220 23519 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:08.762897 23480 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 2.
I20260709 13:10:08.766470 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:08.766718 23371 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:08.767186 23480 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:08.771144 23667 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:08.771595 23667 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cfa267265024839aa61c102070a9225)
I20260709 13:10:08.773021 23667 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.759310 23552 raft_consensus.cc:2393] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9edbc54eb84145c6a1e0a9573739cc08 in current term 2: Already voted for candidate df50de2bac7d4472bedef8b1eaa2d668 in this term.
I20260709 13:10:08.782205 23679 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:08.784857 23679 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.785418 23679 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:08.788335 23667 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:08.791348 23667 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 2 election: Requested vote from peers 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:08.792400 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:08.794188 14474 ts_manager.cc:295] Set tserver state for 9edbc54eb84145c6a1e0a9573739cc08 to MAINTENANCE_MODE
I20260709 13:10:08.795106 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
I20260709 13:10:08.801857 23553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "9edbc54eb84145c6a1e0a9573739cc08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:08.804091 23679 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:08.805838 23553 raft_consensus.cc:2368] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9edbc54eb84145c6a1e0a9573739cc08 for earlier term 2. Current term is 3.
I20260709 13:10:08.806418 23679 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 3 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:08.808292 23370 leader_election.cc:400] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 2 election: Vote denied by peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037) with higher term. Message: Invalid argument: T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9edbc54eb84145c6a1e0a9573739cc08 for earlier term 2. Current term is 3.
I20260709 13:10:08.808722 23370 leader_election.cc:403] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.809355 23667 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:08.808182 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
W20260709 13:10:08.810976 23519 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 98 similar messages]
I20260709 13:10:08.823158 23480 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9edbc54eb84145c6a1e0a9573739cc08 in term 2.
W20260709 13:10:08.829320 23519 leader_election.cc:336] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:08.831391 23519 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:08.832530 23679 raft_consensus.cc:2749] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:08.834677 23667 raft_consensus.cc:2749] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037) with higher term. Message: Invalid argument: T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9edbc54eb84145c6a1e0a9573739cc08 for earlier term 2. Current term is 3.
I20260709 13:10:08.850072 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:08.850739 14474 tablet_replica.cc:333] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.851353 14474 raft_consensus.cc:2243] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.851938 14474 raft_consensus.cc:2272] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.854524 14474 tablet_replica.cc:333] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.855104 14474 raft_consensus.cc:2243] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.855532 14474 raft_consensus.cc:2272] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.857656 14474 tablet_replica.cc:333] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.858240 14474 raft_consensus.cc:2243] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.858641 14474 raft_consensus.cc:2272] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.860788 14474 tablet_replica.cc:333] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.861315 14474 raft_consensus.cc:2243] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.861717 14474 raft_consensus.cc:2272] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.863981 14474 tablet_replica.cc:333] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.864560 14474 raft_consensus.cc:2243] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.864998 14474 raft_consensus.cc:2272] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.867158 14474 tablet_replica.cc:333] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.867683 14474 raft_consensus.cc:2243] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.868065 14474 raft_consensus.cc:2272] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.869827 14474 tablet_replica.cc:333] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.870394 14474 raft_consensus.cc:2243] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:08.871155 14474 raft_consensus.cc:2272] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.873216 14474 tablet_replica.cc:333] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.873736 14474 raft_consensus.cc:2243] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.874190 14474 raft_consensus.cc:2272] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.875888 14474 tablet_replica.cc:333] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.876376 14474 raft_consensus.cc:2243] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:08.877112 14474 raft_consensus.cc:2272] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.878916 14474 tablet_replica.cc:333] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: stopping tablet replica
I20260709 13:10:08.879372 14474 raft_consensus.cc:2243] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.879753 14474 raft_consensus.cc:2272] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.909754 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
W20260709 13:10:09.037508 23445 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.078147 23445 consensus_peers.cc:597] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.083199 23445 consensus_peers.cc:597] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.107626 23445 consensus_peers.cc:597] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.109619 23519 consensus_peers.cc:597] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.377221 23445 consensus_peers.cc:597] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.395905 23445 consensus_peers.cc:597] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:09.488672 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:09.507819 23576 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4d40 after lost signal to thread 14477
W20260709 13:10:09.508811 23576 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0a60 after lost signal to thread 23338
W20260709 13:10:09.510735 23576 debug-util.cc:398] Leaking SignalData structure 0x7b0800134b20 after lost signal to thread 23505
W20260709 13:10:09.511693 23576 debug-util.cc:398] Leaking SignalData structure 0x7b080004eb60 after lost signal to thread 23579
I20260709 13:10:10.119128 23673 raft_consensus.cc:493] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.119736 23673 raft_consensus.cc:515] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.121600 23673 leader_election.cc:290] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:10.123049 23553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
W20260709 13:10:10.125690 23445 leader_election.cc:336] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.126132 23445 leader_election.cc:304] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cfa267265024839aa61c102070a9225; no voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:10.126760 23673 raft_consensus.cc:2749] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:10.184860 23715 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.185504 23715 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.187433 23715 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:10.188709 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
W20260709 13:10:10.191322 23519 leader_election.cc:336] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.191805 23519 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df50de2bac7d4472bedef8b1eaa2d668; no voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:10.192593 23715 raft_consensus.cc:2749] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:10.252548 23682 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.253046 23682 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.255095 23682 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:10.256757 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:10.257570 23552 raft_consensus.cc:2468] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 1.
I20260709 13:10:10.258859 23445 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:10.259579 23682 raft_consensus.cc:2804] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:10.259647 23445 leader_election.cc:336] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.260006 23682 raft_consensus.cc:493] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.260414 23682 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.266288 23682 raft_consensus.cc:515] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.268061 23682 leader_election.cc:290] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:10.269475 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25668a7d7a054dd0a139c0d36614df0a" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:10.270166 23552 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:10.272200 23445 leader_election.cc:336] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.275672 23552 raft_consensus.cc:2468] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 2.
I20260709 13:10:10.276839 23445 leader_election.cc:304] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:10.277724 23682 raft_consensus.cc:2804] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:10.278173 23682 raft_consensus.cc:697] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 2 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:10.278985 23682 consensus_queue.cc:237] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.288048 23303 catalog_manager.cc:5697] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 1 to 2, leader changed from 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129) to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.352283 23715 raft_consensus.cc:493] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.353029 23715 raft_consensus.cc:515] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.355535 23715 leader_election.cc:290] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:10.357052 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:10.357800 23480 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 1.
I20260709 13:10:10.358984 23520 leader_election.cc:304] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:10.359903 23715 raft_consensus.cc:2804] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:10.360211 23519 leader_election.cc:336] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.360443 23715 raft_consensus.cc:493] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9edbc54eb84145c6a1e0a9573739cc08)
I20260709 13:10:10.360929 23715 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.369750 23715 raft_consensus.cc:515] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.372202 23715 leader_election.cc:290] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:10.373386 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67e2977af440f6a760dfd1f51cd943" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:10.374002 23480 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:10.376736 23519 leader_election.cc:336] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.379874 23480 raft_consensus.cc:2468] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:10.381052 23520 leader_election.cc:304] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:10.381937 23715 raft_consensus.cc:2804] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:10.383165 23715 raft_consensus.cc:697] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:10.383963 23715 consensus_queue.cc:237] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.392037 23303 catalog_manager.cc:5697] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.450567 23682 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.451073 23682 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.453200 23682 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:10.454846 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668" is_pre_election: true
I20260709 13:10:10.455827 23552 raft_consensus.cc:2393] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cfa267265024839aa61c102070a9225 in current term 3: Already voted for candidate df50de2bac7d4472bedef8b1eaa2d668 in this term.
W20260709 13:10:10.457542 23445 leader_election.cc:336] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.457976 23445 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cfa267265024839aa61c102070a9225; no voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:10.458736 23682 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.464416 23682 raft_consensus.cc:2749] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:10.489820 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:10.552151 23715 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.552731 23715 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.554667 23715 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:10.555962 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225" is_pre_election: true
I20260709 13:10:10.556753 23480 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 3.
I20260709 13:10:10.557987 23520 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:10.558738 23715 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:10.558866 23519 leader_election.cc:336] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.559134 23715 raft_consensus.cc:493] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.559505 23715 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.564746 23715 raft_consensus.cc:515] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.566664 23715 leader_election.cc:290] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:10.567776 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8458f9d27984e858bdd8cc62c723eb6" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:10.568341 23480 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:10.571376 23519 leader_election.cc:336] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111)
I20260709 13:10:10.574361 23480 raft_consensus.cc:2468] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 4.
I20260709 13:10:10.575462 23520 leader_election.cc:304] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 9edbc54eb84145c6a1e0a9573739cc08
I20260709 13:10:10.576157 23715 raft_consensus.cc:2804] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:10.576671 23715 raft_consensus.cc:697] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:10.577550 23715 consensus_queue.cc:237] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:10.586750 23303 catalog_manager.cc:5697] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 4, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 4 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.724356 23552 raft_consensus.cc:1275] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.725965 23682 consensus_queue.cc:1048] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:10.742774 23445 consensus_peers.cc:597] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.788100 23480 raft_consensus.cc:1275] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:10.789613 23715 consensus_queue.cc:1048] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:10.807757 23519 consensus_peers.cc:597] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.979722 23480 raft_consensus.cc:1275] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:10.981438 23731 consensus_queue.cc:1048] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:10.999274 23519 consensus_peers.cc:597] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.404475 23445 consensus_peers.cc:597] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.491247 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:11.514221 23445 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.638505 23519 consensus_peers.cc:597] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.644996 23445 consensus_peers.cc:597] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.726713 23445 consensus_peers.cc:597] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.745990 23445 consensus_peers.cc:597] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:11.905933 23445 consensus_peers.cc:597] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.492619 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:13.173678 23445 consensus_peers.cc:597] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.436786 23519 consensus_peers.cc:597] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.493790 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:13.566589 23519 consensus_peers.cc:597] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.867228 23445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111) [suppressed 96 similar messages]
I20260709 13:10:13.928568 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:13.935289 23735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:13.937101 23736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:13.938395 23738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:13.940418 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:13.941826 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:13.942121 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:13.942332 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602613942311 us; error 0 us; skew 500 ppm
I20260709 13:10:13.942890 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:13.945784 14474 webserver.cc:533] Webserver started at http://127.14.34.129:36423/ using document root <none> and password file <none>
I20260709 13:10:13.946359 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:13.946511 14474 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:13.950264 14474 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:13.954635 23743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:13.955571 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:13.955940 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "9edbc54eb84145c6a1e0a9573739cc08"
format_stamp: "Formatted at 2026-07-09 13:10:05 on dist-test-slave-nr1f"
I20260709 13:10:13.956355 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:13.979156 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:13.980589 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:13.981930 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:13.985539 23750 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:10:14.036839 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:14.037114 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:10:14.037352 14474 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:14.041743 23750 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
W20260709 13:10:14.048096 23445 consensus_peers.cc:597] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.059053 23750 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.060451 23750 tablet_bootstrap.cc:492] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.061110 23750 ts_tablet_manager.cc:1403] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:10:14.063761 23750 raft_consensus.cc:359] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.064375 23750 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.065164 23750 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.067502 23750 ts_tablet_manager.cc:1434] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:10:14.068219 23750 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.077375 14474 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:14.077719 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.037s	sys 0.000s
I20260709 13:10:14.082031 23750 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.083113 23750 tablet_bootstrap.cc:492] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.083772 23750 ts_tablet_manager.cc:1403] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
W20260709 13:10:14.084131 23445 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.086892 23750 raft_consensus.cc:359] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.087553 23750 raft_consensus.cc:740] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.088295 23750 consensus_queue.cc:260] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.090221 23750 ts_tablet_manager.cc:1434] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:14.091150 23750 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.105796 23750 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.107101 23750 tablet_bootstrap.cc:492] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.107976 23750 ts_tablet_manager.cc:1403] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:10:14.111187 23750 raft_consensus.cc:359] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.112052 23750 raft_consensus.cc:740] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.112926 23750 consensus_queue.cc:260] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.115338 23750 ts_tablet_manager.cc:1434] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:10:14.116287 23750 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.131110 23750 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.131991 23750 tablet_bootstrap.cc:492] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.132537 23750 ts_tablet_manager.cc:1403] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:10:14.133548 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:46159
I20260709 13:10:14.133623 23811 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:46159 every 8 connection(s)
I20260709 13:10:14.134596 23750 raft_consensus.cc:359] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.135190 23750 raft_consensus.cc:740] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.135818 23750 consensus_queue.cc:260] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.137430 23750 ts_tablet_manager.cc:1434] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:14.138332 23750 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.138916 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.166435 23812 heartbeater.cc:344] Connected to a master server at 127.14.34.190:34571
I20260709 13:10:14.166546 23750 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.166894 23812 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:14.167634 23750 tablet_bootstrap.cc:492] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.167862 23812 heartbeater.cc:507] Master 127.14.34.190:34571 requested a full tablet report, sending...
I20260709 13:10:14.168361 23750 ts_tablet_manager.cc:1403] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
I20260709 13:10:14.170976 23750 raft_consensus.cc:359] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.171674 23750 raft_consensus.cc:740] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.172410 23750 consensus_queue.cc:260] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.174530 23750 ts_tablet_manager.cc:1434] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:14.175348 23750 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.175971 23480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:14.176782 23480 raft_consensus.cc:606] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:14.177866 23301 ts_manager.cc:194] Re-registered known tserver with Master: 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159)
I20260709 13:10:14.179802 23480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:14.180469 23480 raft_consensus.cc:606] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:14.183802 23480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:14.184587 23480 raft_consensus.cc:606] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:14.186592 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:14.187330 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.188067 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.188884 23750 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.189791 23750 tablet_bootstrap.cc:492] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.190420 23750 ts_tablet_manager.cc:1403] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:10:14.190861 23301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54460
I20260709 13:10:14.192866 23750 raft_consensus.cc:359] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.193571 23750 raft_consensus.cc:740] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.194067 23812 heartbeater.cc:499] Master 127.14.34.190:34571 was elected leader, sending a full tablet report...
I20260709 13:10:14.194274 23750 consensus_queue.cc:260] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.196306 23750 ts_tablet_manager.cc:1434] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:14.197183 23750 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.208050 23750 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.208814 23750 tablet_bootstrap.cc:492] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.209362 23750 ts_tablet_manager.cc:1403] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:14.211033 23750 raft_consensus.cc:359] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.211537 23750 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.212076 23750 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.213404 23750 ts_tablet_manager.cc:1434] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:14.214052 23750 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.226197 23750 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.226985 23750 tablet_bootstrap.cc:492] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.227555 23750 ts_tablet_manager.cc:1403] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
W20260709 13:10:14.229790 23519 consensus_peers.cc:597] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:14.229770 23750 raft_consensus.cc:359] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:14.230474 23750 raft_consensus.cc:740] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.231235 23750 consensus_queue.cc:260] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:14.233059 23750 ts_tablet_manager.cc:1434] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:14.234073 23750 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.247095 23750 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.247828 23750 tablet_bootstrap.cc:492] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.248342 23750 ts_tablet_manager.cc:1403] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:14.250327 23750 raft_consensus.cc:359] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.250830 23750 raft_consensus.cc:740] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.251377 23750 consensus_queue.cc:260] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.252969 23750 ts_tablet_manager.cc:1434] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:14.253923 23750 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap starting.
I20260709 13:10:14.267660 23750 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.268476 23750 tablet_bootstrap.cc:492] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Bootstrap complete.
I20260709 13:10:14.269047 23750 ts_tablet_manager.cc:1403] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:10:14.271287 23750 raft_consensus.cc:359] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.271831 23750 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edbc54eb84145c6a1e0a9573739cc08, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.272388 23750 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.274405 23750 ts_tablet_manager.cc:1434] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:10:14.295542 23682 raft_consensus.cc:993] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.296054 23825 raft_consensus.cc:1081] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.297844 23553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:14.298378 23553 raft_consensus.cc:493] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.298697 23553 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.303807 23553 raft_consensus.cc:515] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.305454 23553 leader_election.cc:290] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:14.306447 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:14.306769 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:14.307101 23786 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.307488 23480 raft_consensus.cc:3055] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.307825 23480 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:14.308557 23480 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.309672 23480 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.312450 23786 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.313684 23519 leader_election.cc:304] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:14.314599 23723 raft_consensus.cc:2804] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.315774 23723 raft_consensus.cc:697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:14.315593 23480 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.316630 23723 consensus_queue.cc:237] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.323828 23301 catalog_manager.cc:5697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.376406 23786 raft_consensus.cc:3060] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:14.425868 23682 raft_consensus.cc:993] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.426390 23825 raft_consensus.cc:1081] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.427928 23553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:14.428424 23553 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.428704 23553 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.433710 23553 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.435562 23553 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:14.436439 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:14.436685 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:14.437105 23786 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.437281 23480 raft_consensus.cc:3055] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.437672 23480 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:14.438443 23480 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.439392 23480 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.442304 23786 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.443387 23519 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:14.444135 23723 raft_consensus.cc:2804] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.444635 23723 raft_consensus.cc:697] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:14.444759 23480 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.445519 23723 consensus_queue.cc:237] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.452775 23301 catalog_manager.cc:5697] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:14.494846 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:14.564891 23786 raft_consensus.cc:3060] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.751614 23786 raft_consensus.cc:3060] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.758903 23785 raft_consensus.cc:1275] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.761389 23723 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.772219 23480 raft_consensus.cc:1275] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.773674 23826 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.785573 23836 raft_consensus.cc:993] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.786100 23682 raft_consensus.cc:1081] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:14.787612 23553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:14.788220 23553 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.788631 23553 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.794170 23553 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.795979 23553 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:14.796765 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:14.797050 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:14.797446 23786 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.797621 23480 raft_consensus.cc:3055] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.798018 23480 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:14.798861 23480 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.800102 23480 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.804623 23786 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.805984 23519 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:14.806783 23826 raft_consensus.cc:2804] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.806900 23480 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:14.807260 23826 raft_consensus.cc:697] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:14.808735 23826 consensus_queue.cc:237] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:14.816192 23301 catalog_manager.cc:5697] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.890893 23786 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.892405 23826 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.901239 23480 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.903709 23723 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.199584 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.224586 23553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
mode: GRACEFUL
new_leader_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:10:15.225318 23553 raft_consensus.cc:606] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Received request to transfer leadership to TS 5cfa267265024839aa61c102070a9225
I20260709 13:10:15.228039 23553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
mode: GRACEFUL
new_leader_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:10:15.228610 23553 raft_consensus.cc:606] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Received request to transfer leadership to TS 5cfa267265024839aa61c102070a9225
I20260709 13:10:15.229755 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:15.230314 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.231096 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.312943 23786 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.314597 23840 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:15.328778 23480 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.330854 23826 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:15.338644 23845 raft_consensus.cc:993] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: : Instructing follower 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:15.339229 23826 raft_consensus.cc:1081] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Signalling peer 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:15.341115 23480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:10:15.341814 23480 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.342253 23480 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.347766 23845 raft_consensus.cc:993] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: : Instructing follower 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:15.348330 23826 raft_consensus.cc:1081] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Signalling peer 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:15.350315 23479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:10:15.350898 23479 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.351255 23479 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.353765 23480 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.356410 23480 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:15.357189 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:15.357920 23786 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.359561 23553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:15.360066 23553 raft_consensus.cc:3055] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.360255 23553 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:15.361179 23553 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.362541 23553 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.367419 23786 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:15.368782 23445 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:15.369072 23479 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.371268 23836 raft_consensus.cc:2804] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.371469 23553 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:15.371836 23836 raft_consensus.cc:697] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:15.371389 23479 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:15.373175 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:15.373083 23836 consensus_queue.cc:237] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.373940 23552 raft_consensus.cc:3055] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.374296 23552 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:15.375283 23552 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.377121 23552 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.380533 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:15.381340 23786 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.384176 23552 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:15.383216 23303 catalog_manager.cc:5697] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 2 to 3, leader changed from df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131) to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.386336 23445 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:15.387022 23836 raft_consensus.cc:2804] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.387498 23836 raft_consensus.cc:697] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:15.388589 23836 consensus_queue.cc:237] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:15.390300 23786 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:15.402745 23303 catalog_manager.cc:5697] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 2 to 3, leader changed from df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131) to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:15.495986 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:15.824939 23552 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.826514 23836 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.832477 23786 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.836604 23682 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.836367 23786 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.843382 23682 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.849211 23552 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.851042 23682 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.237703 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.246762 23480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:16.247422 23480 raft_consensus.cc:606] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:16.250445 23480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:16.250993 23480 raft_consensus.cc:606] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:16.252321 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:16.252982 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.253583 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.419834 23857 raft_consensus.cc:993] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:16.420569 23825 raft_consensus.cc:1081] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:16.422488 23552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:16.423606 23552 raft_consensus.cc:493] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.424054 23552 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.430263 23552 raft_consensus.cc:515] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.432812 23552 leader_election.cc:290] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:16.433113 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:16.433807 23785 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.434075 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adde4a5334d0423a9db19659d4d7139c" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:16.434722 23480 raft_consensus.cc:3055] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:16.435084 23480 raft_consensus.cc:740] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:16.436044 23480 consensus_queue.cc:260] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.437052 23480 raft_consensus.cc:3060] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.441037 23785 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 4.
I20260709 13:10:16.441792 23786 raft_consensus.cc:1240] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Rejecting Update request from peer 5cfa267265024839aa61c102070a9225 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:16.442601 23519 leader_election.cc:304] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:16.443382 23480 raft_consensus.cc:2468] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 4.
I20260709 13:10:16.443753 23826 raft_consensus.cc:2804] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:16.445214 23826 raft_consensus.cc:697] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:16.446408 23826 consensus_queue.cc:237] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.452987 23301 catalog_manager.cc:5697] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 3 to 4, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 4 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:16.497002 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:16.652223 23857 raft_consensus.cc:993] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:16.652803 23825 raft_consensus.cc:1081] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:16.654382 23552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:16.654896 23552 raft_consensus.cc:493] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.655187 23552 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.661511 23552 raft_consensus.cc:515] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.663532 23552 leader_election.cc:290] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:16.664314 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:16.664839 23480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3d14c4f354b79a2e4cfc52c20cfd5" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:16.665300 23786 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.665586 23480 raft_consensus.cc:3055] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.666141 23480 raft_consensus.cc:740] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:16.667119 23480 consensus_queue.cc:260] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.668267 23480 raft_consensus.cc:3060] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.671662 23786 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:16.672851 23519 leader_election.cc:304] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:16.673545 23480 raft_consensus.cc:2468] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:16.673657 23826 raft_consensus.cc:2804] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.674310 23826 raft_consensus.cc:697] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:16.675352 23826 consensus_queue.cc:237] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:16.683251 23301 catalog_manager.cc:5697] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.834494 23786 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:16.836202 23826 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:16.845873 23480 raft_consensus.cc:1275] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:16.847630 23860 consensus_queue.cc:1048] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:17.139690 23479 raft_consensus.cc:1275] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.141031 23869 consensus_queue.cc:1048] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.149915 23785 raft_consensus.cc:1275] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.151857 23826 consensus_queue.cc:1048] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.261003 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.269248 23552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
mode: GRACEFUL
new_leader_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:10:17.269869 23552 raft_consensus.cc:606] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 LEADER]: Received request to transfer leadership to TS 5cfa267265024839aa61c102070a9225
I20260709 13:10:17.272680 23552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
mode: GRACEFUL
new_leader_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:10:17.273217 23552 raft_consensus.cc:606] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Received request to transfer leadership to TS 5cfa267265024839aa61c102070a9225
I20260709 13:10:17.274308 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:17.274856 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:17.275444 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.495993 23826 raft_consensus.cc:993] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: : Instructing follower 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:17.496474 23826 raft_consensus.cc:1081] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 LEADER]: Signalling peer 5cfa267265024839aa61c102070a9225 to start an election
W20260709 13:10:17.498018 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:17.498256 23479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce"
dest_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:10:17.498911 23479 raft_consensus.cc:493] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.499218 23479 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.504776 23479 raft_consensus.cc:515] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:17.506568 23479 leader_election.cc:290] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 election: Requested vote from peers df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037), 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159)
I20260709 13:10:17.507550 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:17.507802 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aacc32d26e14da29e12fd1c823718ce" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:17.508157 23552 raft_consensus.cc:3055] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.508407 23785 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.508561 23552 raft_consensus.cc:740] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:17.509485 23552 consensus_queue.cc:260] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:17.510672 23552 raft_consensus.cc:3060] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.514335 23785 raft_consensus.cc:2468] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 2.
I20260709 13:10:17.515625 23445 leader_election.cc:304] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:17.516328 23552 raft_consensus.cc:2468] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 2.
I20260709 13:10:17.516342 23857 raft_consensus.cc:2804] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.517720 23857 raft_consensus.cc:697] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 2 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:17.518689 23857 consensus_queue.cc:237] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } }
I20260709 13:10:17.525919 23303 catalog_manager.cc:5697] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 1 to 2, leader changed from df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131) to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.607941 23869 raft_consensus.cc:993] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: : Instructing follower 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:17.608497 23826 raft_consensus.cc:1081] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Signalling peer 5cfa267265024839aa61c102070a9225 to start an election
I20260709 13:10:17.610112 23479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409"
dest_uuid: "5cfa267265024839aa61c102070a9225"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:10:17.610677 23479 raft_consensus.cc:493] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.611016 23479 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.616820 23479 raft_consensus.cc:515] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:17.618468 23479 leader_election.cc:290] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131:38037)
I20260709 13:10:17.619356 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:17.619536 23552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ed3e88f3aa4dc19b8b019b83a1c409" candidate_uuid: "5cfa267265024839aa61c102070a9225" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
I20260709 13:10:17.620033 23785 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.620105 23552 raft_consensus.cc:3055] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.620514 23552 raft_consensus.cc:740] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:17.621408 23552 consensus_queue.cc:260] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:17.622745 23552 raft_consensus.cc:3060] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.627516 23785 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:17.629019 23445 leader_election.cc:304] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cfa267265024839aa61c102070a9225, 9edbc54eb84145c6a1e0a9573739cc08; no voters: 
I20260709 13:10:17.629839 23857 raft_consensus.cc:2804] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.630183 23552 raft_consensus.cc:2468] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cfa267265024839aa61c102070a9225 in term 3.
I20260709 13:10:17.630415 23857 raft_consensus.cc:697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Becoming Leader. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:17.631585 23857 consensus_queue.cc:237] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:17.638563 23303 catalog_manager.cc:5697] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 reported cstate change: term changed from 2 to 3, leader changed from df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131) to 5cfa267265024839aa61c102070a9225 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "5cfa267265024839aa61c102070a9225" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.935882 23552 raft_consensus.cc:1275] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.937021 23857 consensus_queue.cc:1048] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.949268 23786 raft_consensus.cc:1275] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.951614 23874 consensus_queue.cc:1048] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:18.037122 23552 raft_consensus.cc:1275] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.038638 23884 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.047894 23786 raft_consensus.cc:1275] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Refusing update from remote peer 5cfa267265024839aa61c102070a9225: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:18.049538 23874 consensus_queue.cc:1048] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.283802 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.292271 23479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:18.292826 23479 raft_consensus.cc:606] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:18.295195 23479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70"
dest_uuid: "5cfa267265024839aa61c102070a9225"
mode: GRACEFUL
new_leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:56998
I20260709 13:10:18.295680 23479 raft_consensus.cc:606] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Received request to transfer leadership to TS df50de2bac7d4472bedef8b1eaa2d668
I20260709 13:10:18.296809 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:18.297281 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.297864 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.364094 23884 raft_consensus.cc:993] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:18.364713 23874 raft_consensus.cc:1081] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:18.366230 23552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:18.366757 23552 raft_consensus.cc:493] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.367100 23552 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.373585 23552 raft_consensus.cc:515] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.375243 23552 leader_election.cc:290] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:18.376091 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:18.376374 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62d2483a0e542ca96a06c7bbcf6af70" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:18.376694 23786 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.377142 23479 raft_consensus.cc:3055] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.377475 23479 raft_consensus.cc:740] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:18.378436 23479 consensus_queue.cc:260] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.379616 23479 raft_consensus.cc:3060] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.381511 23786 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:18.382675 23519 leader_election.cc:304] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:18.383682 23860 raft_consensus.cc:2804] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.384689 23860 raft_consensus.cc:697] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:18.385568 23860 consensus_queue.cc:237] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.386915 23479 raft_consensus.cc:2468] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 2.
I20260709 13:10:18.394258 23301 catalog_manager.cc:5697] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 1 to 2, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.429901 23884 raft_consensus.cc:993] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: : Instructing follower df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:18.430472 23874 raft_consensus.cc:1081] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Signalling peer df50de2bac7d4472bedef8b1eaa2d668 to start an election
I20260709 13:10:18.431885 23552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fa6babac754493b507c3798db9bb02"
dest_uuid: "df50de2bac7d4472bedef8b1eaa2d668"
 from {username='slave'} at 127.0.0.1:37938
I20260709 13:10:18.432284 23552 raft_consensus.cc:493] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.432505 23552 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.437109 23552 raft_consensus.cc:515] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.438661 23552 leader_election.cc:290] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Requested vote from peers 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159), 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465)
I20260709 13:10:18.439464 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9edbc54eb84145c6a1e0a9573739cc08"
I20260709 13:10:18.439766 23479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fa6babac754493b507c3798db9bb02" candidate_uuid: "df50de2bac7d4472bedef8b1eaa2d668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5cfa267265024839aa61c102070a9225"
I20260709 13:10:18.440042 23786 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.440444 23479 raft_consensus.cc:3055] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:18.440739 23479 raft_consensus.cc:740] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cfa267265024839aa61c102070a9225, State: Running, Role: LEADER
I20260709 13:10:18.441464 23479 consensus_queue.cc:260] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.442505 23479 raft_consensus.cc:3060] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.444881 23786 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 4.
I20260709 13:10:18.446095 23519 leader_election.cc:304] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edbc54eb84145c6a1e0a9573739cc08, df50de2bac7d4472bedef8b1eaa2d668; no voters: 
I20260709 13:10:18.446884 23860 raft_consensus.cc:2804] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:18.447350 23860 raft_consensus.cc:697] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Becoming Leader. State: Replica: df50de2bac7d4472bedef8b1eaa2d668, State: Running, Role: LEADER
I20260709 13:10:18.448154 23860 consensus_queue.cc:237] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } }
I20260709 13:10:18.451050 23479 raft_consensus.cc:2468] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df50de2bac7d4472bedef8b1eaa2d668 in term 4.
I20260709 13:10:18.455502 23301 catalog_manager.cc:5697] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 reported cstate change: term changed from 3 to 4, leader changed from 5cfa267265024839aa61c102070a9225 (127.14.34.130) to df50de2bac7d4472bedef8b1eaa2d668 (127.14.34.131). New cstate: current_term: 4 leader_uuid: "df50de2bac7d4472bedef8b1eaa2d668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df50de2bac7d4472bedef8b1eaa2d668" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 38037 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:18.499284 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:18.827387 23480 raft_consensus.cc:1275] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.828828 23860 consensus_queue.cc:1048] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.840261 23786 raft_consensus.cc:1275] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.843016 23899 consensus_queue.cc:1048] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.854521 23480 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:18.855958 23860 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cfa267265024839aa61c102070a9225" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:19.387774 23785 raft_consensus.cc:1275] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Refusing update from remote peer df50de2bac7d4472bedef8b1eaa2d668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:19.390787 23860 consensus_queue.cc:1048] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edbc54eb84145c6a1e0a9573739cc08" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:19.500464 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:19.769112 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.799890 14474 tablet_server.cc:179] TabletServer@127.14.34.129:46159 shutting down...
W20260709 13:10:19.816733 23445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:10:19.821734 23445 consensus_peers.cc:597] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.826689 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:19.827639 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.828605 14474 raft_consensus.cc:2243] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.829299 14474 raft_consensus.cc:2272] T 25668a7d7a054dd0a139c0d36614df0a P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.832894 14474 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:19.833824 23519 consensus_peers.cc:597] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.833853 14474 raft_consensus.cc:2243] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.834657 14474 raft_consensus.cc:2272] T 0aacc32d26e14da29e12fd1c823718ce P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.837498 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.838478 14474 raft_consensus.cc:2243] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.839107 14474 raft_consensus.cc:2272] T b3b45a145ac44ffdaeecabf51efc81ad P 9edbc54eb84145c6a1e0a9573739cc08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.841758 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.842537 14474 raft_consensus.cc:2243] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.843086 14474 raft_consensus.cc:2272] T e8458f9d27984e858bdd8cc62c723eb6 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.845532 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.846180 14474 raft_consensus.cc:2243] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.846681 14474 raft_consensus.cc:2272] T adde4a5334d0423a9db19659d4d7139c P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.848891 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.849478 14474 raft_consensus.cc:2243] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.849951 14474 raft_consensus.cc:2272] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.852519 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.853185 14474 raft_consensus.cc:2243] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.853684 14474 raft_consensus.cc:2272] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 9edbc54eb84145c6a1e0a9573739cc08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.856158 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.856781 14474 raft_consensus.cc:2243] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.857254 14474 raft_consensus.cc:2272] T c62d2483a0e542ca96a06c7bbcf6af70 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.859776 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.860419 14474 raft_consensus.cc:2243] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.860993 14474 raft_consensus.cc:2272] T 8f67e2977af440f6a760dfd1f51cd943 P 9edbc54eb84145c6a1e0a9573739cc08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.863813 14474 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:19.864375 14474 raft_consensus.cc:2243] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.864822 14474 raft_consensus.cc:2272] T 53fa6babac754493b507c3798db9bb02 P 9edbc54eb84145c6a1e0a9573739cc08 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:19.888906 23519 connection.cc:573] client connection to 127.14.34.129:46159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:19.889531 23519 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:19.890277 23519 consensus_peers.cc:597] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:19.897270 23519 consensus_peers.cc:597] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:19.916535 23519 consensus_peers.cc:597] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:19.975701 23519 consensus_peers.cc:597] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.243633 23445 consensus_peers.cc:597] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.254648 23445 consensus_peers.cc:597] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.255052 23445 consensus_peers.cc:597] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.353446 23808 debug-util.cc:398] Leaking SignalData structure 0x7b080032dd20 after lost signal to thread 14477
W20260709 13:10:20.354760 23808 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9700 after lost signal to thread 23338
W20260709 13:10:20.355836 23808 debug-util.cc:398] Leaking SignalData structure 0x7b080022bdc0 after lost signal to thread 23505
W20260709 13:10:20.356841 23808 debug-util.cc:398] Leaking SignalData structure 0x7b080036f020 after lost signal to thread 23579
W20260709 13:10:20.357977 23808 debug-util.cc:398] Leaking SignalData structure 0x7b080017b000 after lost signal to thread 23903
W20260709 13:10:20.501626 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:20.893164 14474 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23808)
W20260709 13:10:21.502969 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:21.893750 14474 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23808)
W20260709 13:10:22.130374 23519 consensus_peers.cc:597] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.215708 23519 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.344017 23519 consensus_peers.cc:597] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.411471 23445 consensus_peers.cc:597] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.504158 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:22.508250 23519 consensus_peers.cc:597] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.543360 23445 consensus_peers.cc:597] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.593391 23519 consensus_peers.cc:597] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.636190 23519 consensus_peers.cc:597] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.681950 23445 consensus_peers.cc:597] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:22.894317 14474 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23808)
W20260709 13:10:23.129276 23445 consensus_peers.cc:597] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:23.505219 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:23.894809 14474 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23808)
W20260709 13:10:24.506387 23352 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:24.550230 23519 consensus_peers.cc:597] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:24.750946 23519 consensus_peers.cc:597] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 9edbc54eb84145c6a1e0a9573739cc08 (127.14.34.129:46159): Couldn't send request to peer 9edbc54eb84145c6a1e0a9573739cc08. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:46159: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:24.775843 14474 tablet_server.cc:196] TabletServer@127.14.34.129:46159 shutdown complete.
I20260709 13:10:24.801028 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
W20260709 13:10:24.820369 23520 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 100 similar messages]
W20260709 13:10:24.823498 23520 consensus_peers.cc:597] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Couldn't send request to peer 5cfa267265024839aa61c102070a9225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:24.826687 23520 consensus_peers.cc:597] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 -> Peer 5cfa267265024839aa61c102070a9225 (127.14.34.130:44465): Couldn't send request to peer 5cfa267265024839aa61c102070a9225. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:24.832059 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.832955 14474 tablet_replica.cc:333] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.833981 14474 raft_consensus.cc:2243] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.834704 14474 raft_consensus.cc:2272] T c62d2483a0e542ca96a06c7bbcf6af70 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.837431 14474 tablet_replica.cc:333] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.838222 14474 raft_consensus.cc:2243] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.839005 14474 raft_consensus.cc:2272] T 33ed3e88f3aa4dc19b8b019b83a1c409 P 5cfa267265024839aa61c102070a9225 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.841228 14474 tablet_replica.cc:333] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.841758 14474 raft_consensus.cc:2243] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.842320 14474 raft_consensus.cc:2272] T 53fa6babac754493b507c3798db9bb02 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.844504 14474 tablet_replica.cc:333] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.845043 14474 raft_consensus.cc:2243] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.845876 14474 raft_consensus.cc:2272] T 25668a7d7a054dd0a139c0d36614df0a P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.848299 14474 tablet_replica.cc:333] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.848869 14474 raft_consensus.cc:2243] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.849603 14474 raft_consensus.cc:2272] T 0aacc32d26e14da29e12fd1c823718ce P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.851670 14474 tablet_replica.cc:333] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.852209 14474 raft_consensus.cc:2243] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.853015 14474 raft_consensus.cc:2272] T b3b45a145ac44ffdaeecabf51efc81ad P 5cfa267265024839aa61c102070a9225 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.855276 14474 tablet_replica.cc:333] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.855899 14474 raft_consensus.cc:2243] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.856317 14474 raft_consensus.cc:2272] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.858649 14474 tablet_replica.cc:333] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.859182 14474 raft_consensus.cc:2243] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.859611 14474 raft_consensus.cc:2272] T adde4a5334d0423a9db19659d4d7139c P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.861867 14474 tablet_replica.cc:333] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.862417 14474 raft_consensus.cc:2243] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.862888 14474 raft_consensus.cc:2272] T e8458f9d27984e858bdd8cc62c723eb6 P 5cfa267265024839aa61c102070a9225 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.865087 14474 tablet_replica.cc:333] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225: stopping tablet replica
I20260709 13:10:24.865654 14474 raft_consensus.cc:2243] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.866312 14474 raft_consensus.cc:2272] T 8f67e2977af440f6a760dfd1f51cd943 P 5cfa267265024839aa61c102070a9225 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.900622 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
I20260709 13:10:24.928807 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:10:24.960525 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:24.961243 14474 tablet_replica.cc:333] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.961961 14474 raft_consensus.cc:2243] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.962837 14474 raft_consensus.cc:2272] T c62d2483a0e542ca96a06c7bbcf6af70 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.965171 14474 tablet_replica.cc:333] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.965781 14474 raft_consensus.cc:2243] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.966253 14474 raft_consensus.cc:2272] T 33ed3e88f3aa4dc19b8b019b83a1c409 P df50de2bac7d4472bedef8b1eaa2d668 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.968240 14474 tablet_replica.cc:333] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.968773 14474 raft_consensus.cc:2243] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.969549 14474 raft_consensus.cc:2272] T 53fa6babac754493b507c3798db9bb02 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.971747 14474 tablet_replica.cc:333] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.972298 14474 raft_consensus.cc:2243] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.972790 14474 raft_consensus.cc:2272] T b3b45a145ac44ffdaeecabf51efc81ad P df50de2bac7d4472bedef8b1eaa2d668 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.974888 14474 tablet_replica.cc:333] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.975454 14474 raft_consensus.cc:2243] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.975857 14474 raft_consensus.cc:2272] T 0aacc32d26e14da29e12fd1c823718ce P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.977792 14474 tablet_replica.cc:333] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.978350 14474 raft_consensus.cc:2243] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.978785 14474 raft_consensus.cc:2272] T 25668a7d7a054dd0a139c0d36614df0a P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.980778 14474 tablet_replica.cc:333] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.981292 14474 raft_consensus.cc:2243] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.982172 14474 raft_consensus.cc:2272] T 8f67e2977af440f6a760dfd1f51cd943 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.984277 14474 tablet_replica.cc:333] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.984792 14474 raft_consensus.cc:2243] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.985560 14474 raft_consensus.cc:2272] T e8458f9d27984e858bdd8cc62c723eb6 P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.987601 14474 tablet_replica.cc:333] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.988078 14474 raft_consensus.cc:2243] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.988785 14474 raft_consensus.cc:2272] T 26f3d14c4f354b79a2e4cfc52c20cfd5 P df50de2bac7d4472bedef8b1eaa2d668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.990777 14474 tablet_replica.cc:333] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668: stopping tablet replica
I20260709 13:10:24.991235 14474 raft_consensus.cc:2243] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.991974 14474 raft_consensus.cc:2272] T adde4a5334d0423a9db19659d4d7139c P df50de2bac7d4472bedef8b1eaa2d668 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.044973 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:10:25.070242 14474 master.cc:562] Master@127.14.34.190:34571 shutting down...
I20260709 13:10:25.098232 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.098809 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.099123 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 10f83c29b21146b3b3079d88fcc64847: stopping tablet replica
I20260709 13:10:25.120659 14474 master.cc:584] Master@127.14.34.190:34571 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (19669 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:25.187914 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:43699
I20260709 13:10:25.189079 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.195231 23930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.195246 23929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.196599 23932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.198267 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:25.199230 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.199404 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.199522 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602625199511 us; error 0 us; skew 500 ppm
I20260709 13:10:25.199986 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.202589 14474 webserver.cc:533] Webserver started at http://127.14.34.190:44395/ using document root <none> and password file <none>
I20260709 13:10:25.203061 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.203215 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.203428 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.204651 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "77a12617a6d14ba59e12ca12c2c6b2fa"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.209259 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:10:25.212709 23937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.213510 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:25.213840 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "77a12617a6d14ba59e12ca12c2c6b2fa"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.214208 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.233071 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.234445 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.275128 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:43699
I20260709 13:10:25.275255 23988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:43699 every 8 connection(s)
I20260709 13:10:25.279467 23989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.293628 23989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa: Bootstrap starting.
I20260709 13:10:25.298887 23989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.303313 23989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa: No bootstrap required, opened a new log
I20260709 13:10:25.305569 23989 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER }
I20260709 13:10:25.306114 23989 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.306319 23989 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77a12617a6d14ba59e12ca12c2c6b2fa, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.306923 23989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER }
I20260709 13:10:25.307372 23989 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:25.307703 23989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:25.307943 23989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.313040 23989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER }
I20260709 13:10:25.313512 23989 leader_election.cc:304] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77a12617a6d14ba59e12ca12c2c6b2fa; no voters: 
I20260709 13:10:25.314666 23989 leader_election.cc:290] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:25.315141 23992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.316747 23992 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 1 LEADER]: Becoming Leader. State: Replica: 77a12617a6d14ba59e12ca12c2c6b2fa, State: Running, Role: LEADER
I20260709 13:10:25.317533 23992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER }
I20260709 13:10:25.317740 23989 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:25.325160 23994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77a12617a6d14ba59e12ca12c2c6b2fa. Latest consensus state: current_term: 1 leader_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER } }
I20260709 13:10:25.325281 23993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77a12617a6d14ba59e12ca12c2c6b2fa" member_type: VOTER } }
I20260709 13:10:25.325975 23994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:25.326015 23993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:25.328328 24002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:25.334084 24002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:25.335140 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:25.343700 24002 catalog_manager.cc:1383] Generated new cluster ID: b456b52deec449f4a4131f5e94c08536
I20260709 13:10:25.344009 24002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:25.367483 24002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:25.368856 24002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:25.395792 24002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa: Generated new TSK 0
I20260709 13:10:25.396389 24002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:25.401432 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.408569 24010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.409080 24011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.410413 24013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.411775 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:25.412745 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.412962 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.413146 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602625413126 us; error 0 us; skew 500 ppm
I20260709 13:10:25.413717 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.416182 14474 webserver.cc:533] Webserver started at http://127.14.34.129:33997/ using document root <none> and password file <none>
I20260709 13:10:25.416745 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.416955 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.417230 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.418582 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "748fc3e4ac7043cd855062830ca28670"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.423100 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:25.426530 24018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.427227 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:25.427536 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "748fc3e4ac7043cd855062830ca28670"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.427819 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.454236 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.455555 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.457038 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.459447 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.459668 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.459913 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.460108 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.504082 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:36935
I20260709 13:10:25.504169 24080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:36935 every 8 connection(s)
I20260709 13:10:25.509418 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.518188 24085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.519407 24086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.521898 14474 server_base.cc:1061] running on GCE node
W20260709 13:10:25.521927 24088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.523392 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:25.523752 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.523958 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602625523936 us; error 0 us; skew 500 ppm
I20260709 13:10:25.524696 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.527413 24081 heartbeater.cc:344] Connected to a master server at 127.14.34.190:43699
I20260709 13:10:25.527803 24081 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.527848 14474 webserver.cc:533] Webserver started at http://127.14.34.130:35979/ using document root <none> and password file <none>
I20260709 13:10:25.528525 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.528735 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.528805 24081 heartbeater.cc:507] Master 127.14.34.190:43699 requested a full tablet report, sending...
I20260709 13:10:25.529042 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.530588 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "cf7bd75356b04b4c8339ad15fb922c15"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.531275 23954 ts_manager.cc:194] Registered new tserver with Master: 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935)
I20260709 13:10:25.533216 23954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47344
I20260709 13:10:25.535712 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:10:25.539391 24093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.540217 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:25.540542 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "cf7bd75356b04b4c8339ad15fb922c15"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.540848 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.555688 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.556923 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.558516 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.560894 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.561187 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.561435 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.561607 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.603077 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:33413
I20260709 13:10:25.603183 24155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:33413 every 8 connection(s)
I20260709 13:10:25.608348 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:25.616904 24159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:25.618718 24160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.622462 24156 heartbeater.cc:344] Connected to a master server at 127.14.34.190:43699
I20260709 13:10:25.622535 14474 server_base.cc:1061] running on GCE node
W20260709 13:10:25.622977 24162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:25.623217 24156 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.624392 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:25.624403 24156 heartbeater.cc:507] Master 127.14.34.190:43699 requested a full tablet report, sending...
W20260709 13:10:25.624744 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:25.625031 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602625625012 us; error 0 us; skew 500 ppm
I20260709 13:10:25.625682 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:25.626797 23954 ts_manager.cc:194] Registered new tserver with Master: cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413)
I20260709 13:10:25.628507 14474 webserver.cc:533] Webserver started at http://127.14.34.131:46687/ using document root <none> and password file <none>
I20260709 13:10:25.628628 23954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47360
I20260709 13:10:25.629181 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:25.629460 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:25.629751 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:25.631110 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "15f4171b89b447a980dab4563990f029"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.635551 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:25.638999 24167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.639923 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:25.640241 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "15f4171b89b447a980dab4563990f029"
format_stamp: "Formatted at 2026-07-09 13:10:25 on dist-test-slave-nr1f"
I20260709 13:10:25.640537 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:25.656613 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:25.657833 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:25.659288 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:25.661589 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:25.661815 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.662110 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:25.662299 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:25.703663 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:37013
I20260709 13:10:25.703753 24229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:37013 every 8 connection(s)
I20260709 13:10:25.718195 24230 heartbeater.cc:344] Connected to a master server at 127.14.34.190:43699
I20260709 13:10:25.718605 24230 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:25.719311 24230 heartbeater.cc:507] Master 127.14.34.190:43699 requested a full tablet report, sending...
I20260709 13:10:25.721243 23954 ts_manager.cc:194] Registered new tserver with Master: 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:25.721747 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014637341s
I20260709 13:10:25.722640 23954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47372
I20260709 13:10:25.747913 23954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47388:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:25.750167 23954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:25.801951 24046 tablet_service.cc:1511] Processing CreateTablet for tablet 96104bdf57e340a0823098a338c2b094 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:25.802219 24045 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7945577244f2ab345da38e3be57b7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:25.803570 24046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96104bdf57e340a0823098a338c2b094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.806565 24045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7945577244f2ab345da38e3be57b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.812813 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 96104bdf57e340a0823098a338c2b094 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:25.814441 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96104bdf57e340a0823098a338c2b094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.814141 24120 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7945577244f2ab345da38e3be57b7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:25.815537 24120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7945577244f2ab345da38e3be57b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.819422 24194 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7945577244f2ab345da38e3be57b7 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:25.820849 24194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7945577244f2ab345da38e3be57b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.812879 24121 tablet_service.cc:1511] Processing CreateTablet for tablet 96104bdf57e340a0823098a338c2b094 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ca8c3734caac4636bb0ea8c603d9dace]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:25.822274 24121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96104bdf57e340a0823098a338c2b094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:25.839956 24245 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: Bootstrap starting.
I20260709 13:10:25.849006 24245 tablet_bootstrap.cc:654] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.858114 24246 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: Bootstrap starting.
I20260709 13:10:25.860324 24245 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: No bootstrap required, opened a new log
I20260709 13:10:25.860817 24245 ts_tablet_manager.cc:1403] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 13:10:25.863567 24245 raft_consensus.cc:359] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.864373 24245 raft_consensus.cc:385] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.864416 24246 tablet_bootstrap.cc:654] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.864797 24245 raft_consensus.cc:740] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.865587 24245 consensus_queue.cc:260] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.867734 24248 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: Bootstrap starting.
I20260709 13:10:25.867835 24081 heartbeater.cc:499] Master 127.14.34.190:43699 was elected leader, sending a full tablet report...
I20260709 13:10:25.869071 24245 ts_tablet_manager.cc:1434] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:25.873397 24245 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: Bootstrap starting.
I20260709 13:10:25.876632 24248 tablet_bootstrap.cc:654] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.881255 24249 raft_consensus.cc:493] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.882205 24245 tablet_bootstrap.cc:654] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.881914 24249 raft_consensus.cc:515] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.894652 24248 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: No bootstrap required, opened a new log
I20260709 13:10:25.895285 24248 ts_tablet_manager.cc:1403] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:10:25.898470 24248 raft_consensus.cc:359] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.899335 24248 raft_consensus.cc:385] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.899706 24248 raft_consensus.cc:740] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.899689 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029" is_pre_election: true
W20260709 13:10:25.901484 24020 leader_election.cc:343] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.901719 24248 consensus_queue.cc:260] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.908103 24249 leader_election.cc:290] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013), cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413)
I20260709 13:10:25.917203 24246 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: No bootstrap required, opened a new log
I20260709 13:10:25.918184 24246 ts_tablet_manager.cc:1403] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.044s
I20260709 13:10:25.921368 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15" is_pre_election: true
I20260709 13:10:25.922595 24246 raft_consensus.cc:359] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.923770 24246 raft_consensus.cc:385] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:25.923913 24020 leader_election.cc:343] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.924319 24246 raft_consensus.cc:740] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f4171b89b447a980dab4563990f029, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.924695 24020 leader_election.cc:304] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670; no voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15
I20260709 13:10:25.925864 24246 consensus_queue.cc:260] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.926529 24249 raft_consensus.cc:2749] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.929044 24156 heartbeater.cc:499] Master 127.14.34.190:43699 was elected leader, sending a full tablet report...
I20260709 13:10:25.930892 24248 ts_tablet_manager.cc:1434] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.020s
I20260709 13:10:25.932310 24230 heartbeater.cc:499] Master 127.14.34.190:43699 was elected leader, sending a full tablet report...
I20260709 13:10:25.932641 24246 ts_tablet_manager.cc:1434] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 13:10:25.932744 24248 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: Bootstrap starting.
I20260709 13:10:25.933818 24246 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: Bootstrap starting.
I20260709 13:10:25.936116 24245 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: No bootstrap required, opened a new log
I20260709 13:10:25.936789 24245 ts_tablet_manager.cc:1403] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.026s
I20260709 13:10:25.940276 24248 tablet_bootstrap.cc:654] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.940083 24245 raft_consensus.cc:359] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.940924 24245 raft_consensus.cc:385] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.941309 24245 raft_consensus.cc:740] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.942467 24245 consensus_queue.cc:260] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.948554 24245 ts_tablet_manager.cc:1434] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:10:25.961505 24248 tablet_bootstrap.cc:492] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: No bootstrap required, opened a new log
I20260709 13:10:25.961701 24246 tablet_bootstrap.cc:654] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.962149 24248 ts_tablet_manager.cc:1403] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.017s
I20260709 13:10:25.965525 24248 raft_consensus.cc:359] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.966302 24248 raft_consensus.cc:385] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.966581 24248 raft_consensus.cc:740] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.967365 24246 tablet_bootstrap.cc:492] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: No bootstrap required, opened a new log
I20260709 13:10:25.967463 24248 consensus_queue.cc:260] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.967970 24246 ts_tablet_manager.cc:1403] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:10:25.969285 24248 ts_tablet_manager.cc:1434] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:25.971109 24253 raft_consensus.cc:493] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.971184 24246 raft_consensus.cc:359] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.971626 24253 raft_consensus.cc:515] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.972049 24246 raft_consensus.cc:385] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.972401 24246 raft_consensus.cc:740] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f4171b89b447a980dab4563990f029, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.973206 24246 consensus_queue.cc:260] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.974138 24253 leader_election.cc:290] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:25.975471 24246 ts_tablet_manager.cc:1434] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:10:25.986348 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670" is_pre_election: true
I20260709 13:10:25.987053 24056 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:25.987543 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029" is_pre_election: true
I20260709 13:10:25.988181 24096 leader_election.cc:304] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:25.988231 24205 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:25.989071 24253 raft_consensus.cc:2804] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.989497 24253 raft_consensus.cc:493] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.989888 24253 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.995675 24253 raft_consensus.cc:515] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:25.996845 24258 raft_consensus.cc:493] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.997355 24258 raft_consensus.cc:515] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:25.998536 24253 leader_election.cc:290] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:25.998723 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:25.999423 24056 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.000106 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:26.000334 24258 leader_election.cc:290] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.000782 24205 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.000164 24055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670" is_pre_election: true
I20260709 13:10:26.001117 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029" is_pre_election: true
I20260709 13:10:26.001843 24055 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.001936 24204 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.003604 24095 leader_election.cc:304] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.004592 24258 raft_consensus.cc:2804] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.004954 24258 raft_consensus.cc:493] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.005268 24258 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.009325 24056 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.009884 24205 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.010710 24096 leader_election.cc:304] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.011564 24253 raft_consensus.cc:2804] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.012933 24253 raft_consensus.cc:697] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Leader. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.012892 24258 raft_consensus.cc:515] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:26.014068 24253 consensus_queue.cc:237] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.015189 24258 leader_election.cc:290] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.015827 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:26.016531 24056 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.016568 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:26.017421 24205 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.024192 23954 catalog_manager.cc:5697] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.024839 24205 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.024791 24056 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.026289 24095 leader_election.cc:304] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.027021 24253 raft_consensus.cc:2804] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.027541 24253 raft_consensus.cc:697] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Leader. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.028383 24253 consensus_queue.cc:237] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:26.037539 23954 catalog_manager.cc:5697] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.075227 23954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47396:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:26.077188 23954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:26.101431 24045 tablet_service.cc:1511] Processing CreateTablet for tablet 20c4c4e3cd324cc0a711beeea8838a73 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:26.102814 24045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c4c4e3cd324cc0a711beeea8838a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.102595 24121 tablet_service.cc:1511] Processing CreateTablet for tablet 20c4c4e3cd324cc0a711beeea8838a73 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:26.103891 24121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c4c4e3cd324cc0a711beeea8838a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.105309 24194 tablet_service.cc:1511] Processing CreateTablet for tablet 20c4c4e3cd324cc0a711beeea8838a73 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:26.106299 24046 tablet_service.cc:1511] Processing CreateTablet for tablet 065c98d3ba6b4c538c6f4d64c60065b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:26.106690 24194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c4c4e3cd324cc0a711beeea8838a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.107561 24046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065c98d3ba6b4c538c6f4d64c60065b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.109714 24120 tablet_service.cc:1511] Processing CreateTablet for tablet 065c98d3ba6b4c538c6f4d64c60065b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:26.111070 24120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065c98d3ba6b4c538c6f4d64c60065b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.110801 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 065c98d3ba6b4c538c6f4d64c60065b1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8cd24c67a02e41c59b0b0c75e498810b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:26.112110 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065c98d3ba6b4c538c6f4d64c60065b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.123121 24245 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: Bootstrap starting.
I20260709 13:10:26.130410 24246 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: Bootstrap starting.
I20260709 13:10:26.132625 24245 tablet_bootstrap.cc:654] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.135672 24248 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: Bootstrap starting.
I20260709 13:10:26.141314 24246 tablet_bootstrap.cc:654] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.143211 24248 tablet_bootstrap.cc:654] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.149097 24245 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: No bootstrap required, opened a new log
I20260709 13:10:26.149735 24245 ts_tablet_manager.cc:1403] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.010s
I20260709 13:10:26.150749 24248 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: No bootstrap required, opened a new log
I20260709 13:10:26.150818 24246 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: No bootstrap required, opened a new log
I20260709 13:10:26.151571 24248 ts_tablet_manager.cc:1403] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 13:10:26.151638 24246 ts_tablet_manager.cc:1403] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.005s
I20260709 13:10:26.153674 24245 raft_consensus.cc:359] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.154405 24245 raft_consensus.cc:385] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.154662 24245 raft_consensus.cc:740] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.154673 24248 raft_consensus.cc:359] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.154876 24246 raft_consensus.cc:359] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.155692 24248 raft_consensus.cc:385] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.155763 24246 raft_consensus.cc:385] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.155449 24245 consensus_queue.cc:260] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.156105 24248 raft_consensus.cc:740] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.156220 24246 raft_consensus.cc:740] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f4171b89b447a980dab4563990f029, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.157084 24248 consensus_queue.cc:260] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.157222 24246 consensus_queue.cc:260] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.158268 24245 ts_tablet_manager.cc:1434] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:26.159406 24245 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: Bootstrap starting.
I20260709 13:10:26.159475 24248 ts_tablet_manager.cc:1434] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:26.160727 24248 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Bootstrap starting.
I20260709 13:10:26.167431 24248 tablet_bootstrap.cc:654] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.172322 24246 ts_tablet_manager.cc:1434] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:26.173576 24246 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: Bootstrap starting.
I20260709 13:10:26.180559 24246 tablet_bootstrap.cc:654] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.167445 24245 tablet_bootstrap.cc:654] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.185139 24248 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: No bootstrap required, opened a new log
I20260709 13:10:26.185693 24248 ts_tablet_manager.cc:1403] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:10:26.187419 24246 tablet_bootstrap.cc:492] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: No bootstrap required, opened a new log
I20260709 13:10:26.188437 24245 tablet_bootstrap.cc:492] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: No bootstrap required, opened a new log
I20260709 13:10:26.187958 24246 ts_tablet_manager.cc:1403] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:10:26.189060 24245 ts_tablet_manager.cc:1403] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.006s
I20260709 13:10:26.188786 24248 raft_consensus.cc:359] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.189608 24248 raft_consensus.cc:385] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.189924 24248 raft_consensus.cc:740] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.190891 24248 consensus_queue.cc:260] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.191898 24246 raft_consensus.cc:359] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.192126 24245 raft_consensus.cc:359] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.192683 24246 raft_consensus.cc:385] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.192929 24245 raft_consensus.cc:385] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.193022 24246 raft_consensus.cc:740] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f4171b89b447a980dab4563990f029, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.193217 24248 ts_tablet_manager.cc:1434] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:26.193397 24245 raft_consensus.cc:740] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.194425 24245 consensus_queue.cc:260] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.194482 24246 consensus_queue.cc:260] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.196969 24245 ts_tablet_manager.cc:1434] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:26.199298 24246 ts_tablet_manager.cc:1434] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:10:26.254263 24253 raft_consensus.cc:493] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.254899 24253 raft_consensus.cc:515] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.256871 24253 leader_election.cc:290] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.257685 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670" is_pre_election: true
I20260709 13:10:26.257898 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029" is_pre_election: true
I20260709 13:10:26.258455 24056 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.258514 24205 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.259619 24095 leader_election.cc:304] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.260318 24253 raft_consensus.cc:2804] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.260684 24253 raft_consensus.cc:493] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.261031 24253 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.266280 24253 raft_consensus.cc:515] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.267846 24253 leader_election.cc:290] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.268848 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:26.268848 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:26.269775 24056 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.269809 24205 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.277015 24205 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.277010 24056 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.278338 24096 leader_election.cc:304] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.279058 24253 raft_consensus.cc:2804] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.279551 24253 raft_consensus.cc:697] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Leader. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.280408 24253 consensus_queue.cc:237] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.287326 23952 catalog_manager.cc:5697] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:26.330384 24001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:26.437561 24253 consensus_queue.cc:1048] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.449352 24258 consensus_queue.cc:1048] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.471217 24258 raft_consensus.cc:493] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.471635 24258 raft_consensus.cc:515] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.473428 24258 leader_election.cc:290] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.474231 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670" is_pre_election: true
I20260709 13:10:26.474511 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029" is_pre_election: true
I20260709 13:10:26.474927 24056 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.475148 24205 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 0.
I20260709 13:10:26.475955 24096 leader_election.cc:304] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.476637 24258 raft_consensus.cc:2804] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:26.476998 24258 raft_consensus.cc:493] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.477234 24258 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.482100 24258 raft_consensus.cc:515] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.483675 24258 leader_election.cc:290] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.484601 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:26.484794 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:26.485191 24056 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.485446 24205 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.490805 24205 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.490806 24056 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 1.
I20260709 13:10:26.492041 24095 leader_election.cc:304] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.492741 24258 raft_consensus.cc:2804] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.493130 24258 raft_consensus.cc:697] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Leader. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.493818 24258 consensus_queue.cc:237] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.501448 23952 catalog_manager.cc:5697] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.542645 24131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96104bdf57e340a0823098a338c2b094"
dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
mode: GRACEFUL
new_leader_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:46160
I20260709 13:10:26.543372 24131 raft_consensus.cc:606] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Received request to transfer leadership to TS 748fc3e4ac7043cd855062830ca28670
I20260709 13:10:26.545089 24258 consensus_queue.cc:1048] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.549094 24131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7"
dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
mode: GRACEFUL
new_leader_uuid: "15f4171b89b447a980dab4563990f029"
 from {username='slave'} at 127.0.0.1:46160
I20260709 13:10:26.549715 24131 raft_consensus.cc:606] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Received request to transfer leadership to TS 15f4171b89b447a980dab4563990f029
I20260709 13:10:26.552441 24259 raft_consensus.cc:993] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: : Instructing follower 15f4171b89b447a980dab4563990f029 to start an election
I20260709 13:10:26.552879 24259 raft_consensus.cc:1081] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Signalling peer 15f4171b89b447a980dab4563990f029 to start an election
I20260709 13:10:26.555470 24204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7"
dest_uuid: "15f4171b89b447a980dab4563990f029"
 from {username='slave'} at 127.0.0.1:43944
I20260709 13:10:26.556793 24204 raft_consensus.cc:493] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.557219 24204 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.558403 24131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73"
dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
mode: GRACEFUL
new_leader_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:46160
I20260709 13:10:26.559046 24131 raft_consensus.cc:606] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Received request to transfer leadership to TS 748fc3e4ac7043cd855062830ca28670
I20260709 13:10:26.560155 24259 consensus_queue.cc:1048] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.565346 24131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1"
dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
mode: GRACEFUL
new_leader_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:46160
I20260709 13:10:26.565187 24204 raft_consensus.cc:515] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.566195 24131 raft_consensus.cc:606] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Received request to transfer leadership to TS 748fc3e4ac7043cd855062830ca28670
I20260709 13:10:26.570829 24204 leader_election.cc:290] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [CANDIDATE]: Term 2 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413)
I20260709 13:10:26.590948 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "15f4171b89b447a980dab4563990f029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:26.591531 24056 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.597604 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7945577244f2ab345da38e3be57b7" candidate_uuid: "15f4171b89b447a980dab4563990f029" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
I20260709 13:10:26.598081 24056 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f4171b89b447a980dab4563990f029 in term 2.
I20260709 13:10:26.598326 24131 raft_consensus.cc:3055] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.598718 24131 raft_consensus.cc:740] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.599575 24170 leader_election.cc:304] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, 748fc3e4ac7043cd855062830ca28670; no voters: 
I20260709 13:10:26.599534 24131 consensus_queue.cc:260] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.600567 24254 raft_consensus.cc:2804] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.600925 24131 raft_consensus.cc:3060] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.601959 24254 raft_consensus.cc:697] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 2 LEADER]: Becoming Leader. State: Replica: 15f4171b89b447a980dab4563990f029, State: Running, Role: LEADER
I20260709 13:10:26.602926 24254 consensus_queue.cc:237] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.608819 24131 raft_consensus.cc:2468] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f4171b89b447a980dab4563990f029 in term 2.
I20260709 13:10:26.609516 23952 catalog_manager.cc:5697] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 reported cstate change: term changed from 1 to 2, leader changed from cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130) to 15f4171b89b447a980dab4563990f029 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "15f4171b89b447a980dab4563990f029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.685434 24259 consensus_queue.cc:1048] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.692996 24253 raft_consensus.cc:993] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: : Instructing follower 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:26.693444 24253 raft_consensus.cc:1081] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Signalling peer 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:26.695695 24055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73"
dest_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:10:26.696544 24055 raft_consensus.cc:493] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.696938 24055 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.702610 24259 consensus_queue.cc:1048] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.705165 24055 raft_consensus.cc:515] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.708527 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
I20260709 13:10:26.709211 24131 raft_consensus.cc:3055] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.709512 24131 raft_consensus.cc:740] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:26.710609 24131 consensus_queue.cc:260] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.711349 24131 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.718142 24131 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:26.718685 24055 leader_election.cc:290] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Requested vote from peers cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:26.719867 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:26.720479 24204 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.722643 24020 leader_election.cc:304] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748fc3e4ac7043cd855062830ca28670, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:26.723490 24249 raft_consensus.cc:2804] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.724579 24249 raft_consensus.cc:697] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Becoming Leader. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Running, Role: LEADER
I20260709 13:10:26.725420 24249 consensus_queue.cc:237] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:26.727394 24204 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:26.733803 23951 catalog_manager.cc:5697] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 reported cstate change: term changed from 1 to 2, leader changed from cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130) to 748fc3e4ac7043cd855062830ca28670 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "748fc3e4ac7043cd855062830ca28670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.015676 24258 raft_consensus.cc:993] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: : Instructing follower 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:27.016166 24258 raft_consensus.cc:1081] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Signalling peer 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:27.018230 24055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96104bdf57e340a0823098a338c2b094"
dest_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:10:27.018954 24055 raft_consensus.cc:493] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.019418 24055 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.025370 24055 raft_consensus.cc:515] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:27.027267 24055 leader_election.cc:290] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Requested vote from peers 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013), cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413)
I20260709 13:10:27.027925 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:27.028586 24204 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.032142 24258 consensus_queue.cc:1048] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.039683 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96104bdf57e340a0823098a338c2b094" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
I20260709 13:10:27.040351 24131 raft_consensus.cc:3055] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.040536 24258 raft_consensus.cc:993] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: : Instructing follower 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:27.040680 24131 raft_consensus.cc:740] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:27.041086 24258 raft_consensus.cc:1081] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Signalling peer 748fc3e4ac7043cd855062830ca28670 to start an election
I20260709 13:10:27.040581 24204 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:27.041674 24131 consensus_queue.cc:260] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:27.043488 24131 raft_consensus.cc:3060] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.042785 24020 leader_election.cc:304] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, 748fc3e4ac7043cd855062830ca28670; no voters: 
I20260709 13:10:27.051395 24249 raft_consensus.cc:2804] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.051870 24249 raft_consensus.cc:697] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Becoming Leader. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Running, Role: LEADER
I20260709 13:10:27.052721 24249 consensus_queue.cc:237] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } }
I20260709 13:10:27.053097 24131 raft_consensus.cc:2468] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:27.050731 24258 consensus_queue.cc:1048] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:27.049871 24055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1"
dest_uuid: "748fc3e4ac7043cd855062830ca28670"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:10:27.056663 24055 raft_consensus.cc:493] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.057154 24055 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.062631 23951 catalog_manager.cc:5697] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 reported cstate change: term changed from 1 to 2, leader changed from cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130) to 748fc3e4ac7043cd855062830ca28670 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "748fc3e4ac7043cd855062830ca28670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.065019 24055 raft_consensus.cc:515] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.067294 24055 leader_election.cc:290] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Requested vote from peers cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130:33413), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:27.068706 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
I20260709 13:10:27.069267 24131 raft_consensus.cc:3055] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.069589 24131 raft_consensus.cc:740] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:27.069752 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065c98d3ba6b4c538c6f4d64c60065b1" candidate_uuid: "748fc3e4ac7043cd855062830ca28670" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:27.070454 24204 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.070441 24131 consensus_queue.cc:260] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.071843 24131 raft_consensus.cc:3060] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.077078 24204 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:27.077786 24131 raft_consensus.cc:2468] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748fc3e4ac7043cd855062830ca28670 in term 2.
I20260709 13:10:27.078531 24020 leader_election.cc:304] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, 748fc3e4ac7043cd855062830ca28670; no voters: 
I20260709 13:10:27.079475 24249 raft_consensus.cc:2804] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.079923 24249 raft_consensus.cc:697] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Becoming Leader. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Running, Role: LEADER
I20260709 13:10:27.080744 24249 consensus_queue.cc:237] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.087127 23953 catalog_manager.cc:5697] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 reported cstate change: term changed from 1 to 2, leader changed from cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130) to 748fc3e4ac7043cd855062830ca28670 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "748fc3e4ac7043cd855062830ca28670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.104403 24131 raft_consensus.cc:1275] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.105638 24249 consensus_queue.cc:1048] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.112915 24055 raft_consensus.cc:1275] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Refusing update from remote peer 15f4171b89b447a980dab4563990f029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.114496 24254 consensus_queue.cc:1048] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.109898 24130 raft_consensus.cc:1275] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Refusing update from remote peer 15f4171b89b447a980dab4563990f029: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.120000 24204 raft_consensus.cc:1275] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.122851 24249 consensus_queue.cc:1048] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.122237 24254 consensus_queue.cc:1048] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.303773 14474 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:27.305332 14474 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:27.305729 14474 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:27.316972 24056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73"
dest_uuid: "748fc3e4ac7043cd855062830ca28670"
mode: GRACEFUL
new_leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
 from {username='slave'} at 127.0.0.1:40282
I20260709 13:10:27.317543 24056 raft_consensus.cc:606] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Received request to transfer leadership to TS cf7bd75356b04b4c8339ad15fb922c15
I20260709 13:10:27.318770 14474 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:27.462357 24204 raft_consensus.cc:1275] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.463613 24249 consensus_queue.cc:1048] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.470945 24131 raft_consensus.cc:1275] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.472738 24299 consensus_queue.cc:1048] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.485494 24131 raft_consensus.cc:1275] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.486805 24299 consensus_queue.cc:1048] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.492542 24249 raft_consensus.cc:993] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: : Instructing follower cf7bd75356b04b4c8339ad15fb922c15 to start an election
I20260709 13:10:27.493630 24299 raft_consensus.cc:1081] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Signalling peer cf7bd75356b04b4c8339ad15fb922c15 to start an election
I20260709 13:10:27.497239 24130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73"
dest_uuid: "cf7bd75356b04b4c8339ad15fb922c15"
 from {username='slave'} at 127.0.0.1:46146
I20260709 13:10:27.497406 24204 raft_consensus.cc:1275] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Refusing update from remote peer 748fc3e4ac7043cd855062830ca28670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:27.497844 24130 raft_consensus.cc:493] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.498296 24130 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.499707 24299 consensus_queue.cc:1048] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.513633 24130 raft_consensus.cc:515] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.515878 24130 leader_election.cc:290] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 3 election: Requested vote from peers 748fc3e4ac7043cd855062830ca28670 (127.14.34.129:36935), 15f4171b89b447a980dab4563990f029 (127.14.34.131:37013)
I20260709 13:10:27.516487 24056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "748fc3e4ac7043cd855062830ca28670"
I20260709 13:10:27.517058 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c4c4e3cd324cc0a711beeea8838a73" candidate_uuid: "cf7bd75356b04b4c8339ad15fb922c15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15f4171b89b447a980dab4563990f029"
I20260709 13:10:27.517141 24056 raft_consensus.cc:3055] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:27.517701 24204 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.517704 24056 raft_consensus.cc:740] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 748fc3e4ac7043cd855062830ca28670, State: Running, Role: LEADER
I20260709 13:10:27.518864 24056 consensus_queue.cc:260] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.520157 24056 raft_consensus.cc:3060] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.525420 24204 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 3.
I20260709 13:10:27.526645 24095 leader_election.cc:304] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f4171b89b447a980dab4563990f029, cf7bd75356b04b4c8339ad15fb922c15; no voters: 
I20260709 13:10:27.527530 24258 raft_consensus.cc:2804] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:27.528024 24258 raft_consensus.cc:697] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 LEADER]: Becoming Leader. State: Replica: cf7bd75356b04b4c8339ad15fb922c15, State: Running, Role: LEADER
I20260709 13:10:27.528815 24258 consensus_queue.cc:237] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } }
I20260709 13:10:27.530077 24056 raft_consensus.cc:2468] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7bd75356b04b4c8339ad15fb922c15 in term 3.
I20260709 13:10:27.536540 23951 catalog_manager.cc:5697] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 reported cstate change: term changed from 2 to 3, leader changed from 748fc3e4ac7043cd855062830ca28670 (127.14.34.129) to cf7bd75356b04b4c8339ad15fb922c15 (127.14.34.130). New cstate: current_term: 3 leader_uuid: "cf7bd75356b04b4c8339ad15fb922c15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "748fc3e4ac7043cd855062830ca28670" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf7bd75356b04b4c8339ad15fb922c15" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 33413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15f4171b89b447a980dab4563990f029" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 37013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.670567 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
I20260709 13:10:27.692126 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.692838 14474 tablet_replica.cc:333] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670: stopping tablet replica
I20260709 13:10:27.693406 14474 raft_consensus.cc:2243] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.693888 14474 raft_consensus.cc:2272] T b7e7945577244f2ab345da38e3be57b7 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.696111 14474 tablet_replica.cc:333] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670: stopping tablet replica
I20260709 13:10:27.696641 14474 raft_consensus.cc:2243] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.697424 14474 raft_consensus.cc:2272] T 065c98d3ba6b4c538c6f4d64c60065b1 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.700055 14474 tablet_replica.cc:333] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670: stopping tablet replica
I20260709 13:10:27.700623 14474 raft_consensus.cc:2243] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.701032 14474 raft_consensus.cc:2272] T 20c4c4e3cd324cc0a711beeea8838a73 P 748fc3e4ac7043cd855062830ca28670 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.703255 14474 tablet_replica.cc:333] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670: stopping tablet replica
I20260709 13:10:27.703804 14474 raft_consensus.cc:2243] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.704627 14474 raft_consensus.cc:2272] T 96104bdf57e340a0823098a338c2b094 P 748fc3e4ac7043cd855062830ca28670 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.728426 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
I20260709 13:10:27.740900 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
I20260709 13:10:27.758668 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.759274 14474 tablet_replica.cc:333] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: stopping tablet replica
I20260709 13:10:27.759778 14474 raft_consensus.cc:2243] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.760390 14474 pending_rounds.cc:70] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Trying to abort 1 pending ops.
I20260709 13:10:27.760551 14474 pending_rounds.cc:77] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636362367344640 op_type: NO_OP noop_request { }
I20260709 13:10:27.760808 14474 raft_consensus.cc:2889] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:27.761031 14474 raft_consensus.cc:2272] T 20c4c4e3cd324cc0a711beeea8838a73 P cf7bd75356b04b4c8339ad15fb922c15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.763234 14474 tablet_replica.cc:333] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15: stopping tablet replica
I20260709 13:10:27.763744 14474 raft_consensus.cc:2243] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.764151 14474 raft_consensus.cc:2272] T 065c98d3ba6b4c538c6f4d64c60065b1 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.766634 14474 tablet_replica.cc:333] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15: stopping tablet replica
I20260709 13:10:27.767115 14474 raft_consensus.cc:2243] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.767494 14474 raft_consensus.cc:2272] T 96104bdf57e340a0823098a338c2b094 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.769610 14474 tablet_replica.cc:333] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15: stopping tablet replica
I20260709 13:10:27.770159 14474 raft_consensus.cc:2243] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.770563 14474 raft_consensus.cc:2272] T b7e7945577244f2ab345da38e3be57b7 P cf7bd75356b04b4c8339ad15fb922c15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.783174 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
I20260709 13:10:27.794595 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:10:27.812877 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.813591 14474 tablet_replica.cc:333] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029: stopping tablet replica
I20260709 13:10:27.814267 14474 raft_consensus.cc:2243] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.815073 14474 raft_consensus.cc:2272] T b7e7945577244f2ab345da38e3be57b7 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.817817 14474 tablet_replica.cc:333] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029: stopping tablet replica
I20260709 13:10:27.818423 14474 raft_consensus.cc:2243] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.818893 14474 raft_consensus.cc:2272] T 20c4c4e3cd324cc0a711beeea8838a73 P 15f4171b89b447a980dab4563990f029 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.821267 14474 tablet_replica.cc:333] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029: stopping tablet replica
I20260709 13:10:27.821787 14474 raft_consensus.cc:2243] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.822232 14474 raft_consensus.cc:2272] T 065c98d3ba6b4c538c6f4d64c60065b1 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.824342 14474 tablet_replica.cc:333] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029: stopping tablet replica
I20260709 13:10:27.824841 14474 raft_consensus.cc:2243] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.825266 14474 raft_consensus.cc:2272] T 96104bdf57e340a0823098a338c2b094 P 15f4171b89b447a980dab4563990f029 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.837435 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:10:27.849109 14474 master.cc:562] Master@127.14.34.190:43699 shutting down...
I20260709 13:10:27.867388 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.867954 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.868285 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 77a12617a6d14ba59e12ca12c2c6b2fa: stopping tablet replica
I20260709 13:10:27.886456 14474 master.cc:584] Master@127.14.34.190:43699 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2725 ms)
[----------] 6 tests from LeaderRebalancerTest (301597 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:27.912995 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:38649
I20260709 13:10:27.914108 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:27.919220 24304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:27.919302 24305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:27.920586 24307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:27.921267 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:27.922111 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:27.922297 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:27.922452 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602627922422 us; error 0 us; skew 500 ppm
I20260709 13:10:27.923033 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:27.928896 14474 webserver.cc:533] Webserver started at http://127.14.34.190:36211/ using document root <none> and password file <none>
I20260709 13:10:27.929409 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:27.929606 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:27.929888 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:27.930953 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "157615595d2149cb9ca43e2a34744f7f"
format_stamp: "Formatted at 2026-07-09 13:10:27 on dist-test-slave-nr1f"
I20260709 13:10:27.935382 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:27.938670 24312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:27.939450 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:27.939767 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "157615595d2149cb9ca43e2a34744f7f"
format_stamp: "Formatted at 2026-07-09 13:10:27 on dist-test-slave-nr1f"
I20260709 13:10:27.940078 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:27.953923 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:27.955116 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:27.991137 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:38649
I20260709 13:10:27.991232 24363 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:38649 every 8 connection(s)
I20260709 13:10:27.995064 24364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.006130 24364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: Bootstrap starting.
I20260709 13:10:28.010748 24364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.014983 24364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: No bootstrap required, opened a new log
I20260709 13:10:28.017105 24364 raft_consensus.cc:359] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER }
I20260709 13:10:28.017472 24364 raft_consensus.cc:385] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.017735 24364 raft_consensus.cc:740] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 157615595d2149cb9ca43e2a34744f7f, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.018391 24364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER }
I20260709 13:10:28.018874 24364 raft_consensus.cc:399] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:28.019076 24364 raft_consensus.cc:493] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:28.019383 24364 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.024513 24364 raft_consensus.cc:515] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER }
I20260709 13:10:28.025087 24364 leader_election.cc:304] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 157615595d2149cb9ca43e2a34744f7f; no voters: 
I20260709 13:10:28.026369 24364 leader_election.cc:290] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:28.026717 24367 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.028124 24367 raft_consensus.cc:697] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 1 LEADER]: Becoming Leader. State: Replica: 157615595d2149cb9ca43e2a34744f7f, State: Running, Role: LEADER
I20260709 13:10:28.028788 24367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER }
I20260709 13:10:28.029433 24364 sys_catalog.cc:565] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:28.031845 24368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "157615595d2149cb9ca43e2a34744f7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER } }
I20260709 13:10:28.031908 24369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 157615595d2149cb9ca43e2a34744f7f. Latest consensus state: current_term: 1 leader_uuid: "157615595d2149cb9ca43e2a34744f7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "157615595d2149cb9ca43e2a34744f7f" member_type: VOTER } }
I20260709 13:10:28.032644 24368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:28.032722 24369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:28.040036 24373 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:28.045004 24373 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:28.046129 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:28.053509 24373 catalog_manager.cc:1383] Generated new cluster ID: 344d690b9a9a41d19757e4a9c8fb2a72
I20260709 13:10:28.053804 24373 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:28.089839 24373 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:28.091324 24373 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:28.111894 24373 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: Generated new TSK 0
I20260709 13:10:28.112517 24373 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:28.177219 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.183215 24385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.184356 24386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.186667 14474 server_base.cc:1061] running on GCE node
W20260709 13:10:28.186697 24388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.188056 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.188248 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.188460 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602628188425 us; error 0 us; skew 500 ppm
I20260709 13:10:28.189036 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.191805 14474 webserver.cc:533] Webserver started at http://127.14.34.129:40773/ using document root <none> and password file <none>
I20260709 13:10:28.192373 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.192574 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.192857 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.193971 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "30a7cf262acb434681ec7b74642b6ce3"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.198829 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:28.202381 24393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.203141 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:28.203469 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "30a7cf262acb434681ec7b74642b6ce3"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.203750 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.229204 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.230432 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.231985 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.234275 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.234500 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.234760 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.234938 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.274667 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:37149
I20260709 13:10:28.274757 24455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:37149 every 8 connection(s)
I20260709 13:10:28.279973 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.287292 24460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.288362 24461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.291709 24463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.291996 24456 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38649
I20260709 13:10:28.292026 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:28.292554 24456 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.293303 24456 heartbeater.cc:507] Master 127.14.34.190:38649 requested a full tablet report, sending...
I20260709 13:10:28.293839 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.294159 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.294340 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602628294325 us; error 0 us; skew 500 ppm
I20260709 13:10:28.294950 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.295500 24329 ts_manager.cc:194] Registered new tserver with Master: 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149)
I20260709 13:10:28.297451 24329 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42888
I20260709 13:10:28.297667 14474 webserver.cc:533] Webserver started at http://127.14.34.130:32929/ using document root <none> and password file <none>
I20260709 13:10:28.298321 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.298530 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.298833 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.300293 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "1845252628e74814810cd0efea9c212b"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.304580 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:28.308051 24468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.308794 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:28.309108 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "1845252628e74814810cd0efea9c212b"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.309378 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.323069 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.324191 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.325603 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.327885 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.328114 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.328362 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.328540 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.367071 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:41937
I20260709 13:10:28.367172 24530 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:41937 every 8 connection(s)
I20260709 13:10:28.372040 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.378918 24534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.380159 24535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.382133 24537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.383942 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:28.384634 24531 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38649
I20260709 13:10:28.385047 24531 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.385106 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.385497 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.385673 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602628385639 us; error 0 us; skew 500 ppm
I20260709 13:10:28.385846 24531 heartbeater.cc:507] Master 127.14.34.190:38649 requested a full tablet report, sending...
I20260709 13:10:28.386379 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.388140 24329 ts_manager.cc:194] Registered new tserver with Master: 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:28.389256 14474 webserver.cc:533] Webserver started at http://127.14.34.131:44937/ using document root <none> and password file <none>
I20260709 13:10:28.389922 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.390064 24329 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42902
I20260709 13:10:28.390192 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.390609 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.391887 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.396363 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:28.399547 24542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.400370 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:28.400676 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-nr1f"
I20260709 13:10:28.400964 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.422603 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.423693 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.425112 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.427347 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.427577 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.427819 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.427992 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.466903 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:46487
I20260709 13:10:28.467046 24604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:46487 every 8 connection(s)
I20260709 13:10:28.480501 24605 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38649
I20260709 13:10:28.480967 24605 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.481719 24605 heartbeater.cc:507] Master 127.14.34.190:38649 requested a full tablet report, sending...
I20260709 13:10:28.484079 24329 ts_manager.cc:194] Registered new tserver with Master: 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:28.485076 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014928263s
I20260709 13:10:28.485970 24329 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42912
I20260709 13:10:28.511031 24329 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:28.513566 24329 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:28.585147 24496 tablet_service.cc:1511] Processing CreateTablet for tablet af51e57ee6cf4b04bded4c1b9da501cb (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:28.586779 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af51e57ee6cf4b04bded4c1b9da501cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.595769 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca9fd63bd964a948a1541c9e9fe9568 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:28.596397 24494 tablet_service.cc:1511] Processing CreateTablet for tablet 62130d409989487e9685c4d2cc951be5 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:28.597342 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca9fd63bd964a948a1541c9e9fe9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.599174 24492 tablet_service.cc:1511] Processing CreateTablet for tablet 11dfc45276634f7da647c713a44f89be (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:28.600733 24492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dfc45276634f7da647c713a44f89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.602312 24489 tablet_service.cc:1511] Processing CreateTablet for tablet cf4017f4caa64f31b02b893e8e08b01b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:28.602782 24491 tablet_service.cc:1511] Processing CreateTablet for tablet 12181c3648e746a3997f4fd763845f4d (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:28.603685 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4017f4caa64f31b02b893e8e08b01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.604568 24491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12181c3648e746a3997f4fd763845f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.607029 24493 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd2f7e2eb714196a57d71af89e7c57f (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:28.609052 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd2f7e2eb714196a57d71af89e7c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.610500 24490 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbd9c7e3a3f4648bfac2201b540949c (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:28.614446 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 757b8f341fe3466dbb82b3447d7b213b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:28.616472 24570 tablet_service.cc:1511] Processing CreateTablet for tablet af51e57ee6cf4b04bded4c1b9da501cb (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:28.612536 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbd9c7e3a3f4648bfac2201b540949c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.617856 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af51e57ee6cf4b04bded4c1b9da501cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.622483 24494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130d409989487e9685c4d2cc951be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.632056 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 12181c3648e746a3997f4fd763845f4d (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:28.632972 24413 tablet_service.cc:1511] Processing CreateTablet for tablet 757b8f341fe3466dbb82b3447d7b213b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:28.625425 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca9fd63bd964a948a1541c9e9fe9568 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:28.629627 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd2f7e2eb714196a57d71af89e7c57f (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:28.634508 24413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757b8f341fe3466dbb82b3447d7b213b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.634253 24564 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbd9c7e3a3f4648bfac2201b540949c (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:28.635248 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd2f7e2eb714196a57d71af89e7c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.636140 24563 tablet_service.cc:1511] Processing CreateTablet for tablet cf4017f4caa64f31b02b893e8e08b01b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:28.625903 24420 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca9fd63bd964a948a1541c9e9fe9568 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:28.638967 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca9fd63bd964a948a1541c9e9fe9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.639057 24562 tablet_service.cc:1511] Processing CreateTablet for tablet 757b8f341fe3466dbb82b3447d7b213b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:28.626748 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 12181c3648e746a3997f4fd763845f4d (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:28.642961 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12181c3648e746a3997f4fd763845f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.627090 24568 tablet_service.cc:1511] Processing CreateTablet for tablet 62130d409989487e9685c4d2cc951be5 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:28.627789 24419 tablet_service.cc:1511] Processing CreateTablet for tablet 62130d409989487e9685c4d2cc951be5 (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:28.646142 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130d409989487e9685c4d2cc951be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.628624 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbd9c7e3a3f4648bfac2201b540949c (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:28.648530 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbd9c7e3a3f4648bfac2201b540949c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.628743 24567 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd2f7e2eb714196a57d71af89e7c57f (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:28.630429 24566 tablet_service.cc:1511] Processing CreateTablet for tablet 11dfc45276634f7da647c713a44f89be (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:28.630666 24414 tablet_service.cc:1511] Processing CreateTablet for tablet cf4017f4caa64f31b02b893e8e08b01b (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:28.651582 24414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4017f4caa64f31b02b893e8e08b01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.631214 24417 tablet_service.cc:1511] Processing CreateTablet for tablet 11dfc45276634f7da647c713a44f89be (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:28.659303 24417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dfc45276634f7da647c713a44f89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.633394 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12181c3648e746a3997f4fd763845f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.662066 24567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd2f7e2eb714196a57d71af89e7c57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.662973 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4017f4caa64f31b02b893e8e08b01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.623971 24421 tablet_service.cc:1511] Processing CreateTablet for tablet af51e57ee6cf4b04bded4c1b9da501cb (DEFAULT_TABLE table=test-workload [id=c27d3b61cb984881a81ff977674fb48a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:28.664526 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af51e57ee6cf4b04bded4c1b9da501cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.670531 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757b8f341fe3466dbb82b3447d7b213b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.664561 24562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757b8f341fe3466dbb82b3447d7b213b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.698616 24568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130d409989487e9685c4d2cc951be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.699853 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca9fd63bd964a948a1541c9e9fe9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.700799 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbd9c7e3a3f4648bfac2201b540949c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.720309 24620 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:28.720464 24621 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:28.728618 24620 tablet_bootstrap.cc:654] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.728969 24621 tablet_bootstrap.cc:654] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.758603 24566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dfc45276634f7da647c713a44f89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.864169 24619 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:28.865477 24620 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:28.866053 24620 ts_tablet_manager.cc:1403] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.146s	user 0.047s	sys 0.044s
I20260709 13:10:28.867889 24621 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:28.868414 24621 ts_tablet_manager.cc:1403] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.148s	user 0.024s	sys 0.057s
I20260709 13:10:28.871383 24621 raft_consensus.cc:359] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.872067 24621 raft_consensus.cc:385] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.872351 24621 raft_consensus.cc:740] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.875618 24620 raft_consensus.cc:359] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.876438 24620 raft_consensus.cc:385] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.876720 24620 raft_consensus.cc:740] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.877513 24621 consensus_queue.cc:260] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.885959 24619 tablet_bootstrap.cc:654] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.886212 24620 consensus_queue.cc:260] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.902164 24621 ts_tablet_manager.cc:1434] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.018s
I20260709 13:10:28.904119 24456 heartbeater.cc:499] Master 127.14.34.190:38649 was elected leader, sending a full tablet report...
I20260709 13:10:28.904954 24620 ts_tablet_manager.cc:1434] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.014s
I20260709 13:10:28.905521 24621 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:28.906154 24620 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:28.906309 24605 heartbeater.cc:499] Master 127.14.34.190:38649 was elected leader, sending a full tablet report...
I20260709 13:10:28.914500 24621 tablet_bootstrap.cc:654] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.918496 24625 raft_consensus.cc:493] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.919073 24625 raft_consensus.cc:515] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.921777 24625 leader_election.cc:290] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149)
I20260709 13:10:28.928071 24619 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:28.930365 24619 ts_tablet_manager.cc:1403] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:10:28.933821 24621 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:28.934412 24621 ts_tablet_manager.cc:1403] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.011s
I20260709 13:10:28.934412 24620 tablet_bootstrap.cc:654] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.936749 24619 raft_consensus.cc:359] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.937189 24621 raft_consensus.cc:359] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.937711 24619 raft_consensus.cc:385] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.937920 24621 raft_consensus.cc:385] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.938277 24619 raft_consensus.cc:740] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.938285 24621 raft_consensus.cc:740] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.939376 24621 consensus_queue.cc:260] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.939507 24619 consensus_queue.cc:260] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.941860 24621 ts_tablet_manager.cc:1434] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:28.943164 24621 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:28.949702 24619 ts_tablet_manager.cc:1434] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:10:28.950402 24621 tablet_bootstrap.cc:654] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.950619 24531 heartbeater.cc:499] Master 127.14.34.190:38649 was elected leader, sending a full tablet report...
I20260709 13:10:28.969588 24619 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:28.980023 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:28.980839 24506 raft_consensus.cc:2468] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:28.981379 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:28.980811 24620 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:28.982821 24620 ts_tablet_manager.cc:1403] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.013s
I20260709 13:10:28.983644 24544 leader_election.cc:304] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:28.984561 24625 raft_consensus.cc:2804] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:28.984730 24544 leader_election.cc:343] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.984948 24625 raft_consensus.cc:493] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.985337 24625 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.988148 24619 tablet_bootstrap.cc:654] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.994796 24621 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:28.994520 24625 raft_consensus.cc:515] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.995402 24621 ts_tablet_manager.cc:1403] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.020s
I20260709 13:10:28.998404 24621 raft_consensus.cc:359] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:28.999142 24621 raft_consensus.cc:385] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.998842 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:28.999523 24621 raft_consensus.cc:740] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.999883 24506 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.000461 24621 consensus_queue.cc:260] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.002874 24621 ts_tablet_manager.cc:1434] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:29.003747 24621 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.005502 24619 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.006158 24619 ts_tablet_manager.cc:1403] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.004s
I20260709 13:10:29.008945 24506 raft_consensus.cc:2468] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:29.009889 24621 tablet_bootstrap.cc:654] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.010610 24544 leader_election.cc:304] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:29.011502 24620 raft_consensus.cc:359] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.012367 24620 raft_consensus.cc:385] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.012573 24619 raft_consensus.cc:359] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.013443 24619 raft_consensus.cc:385] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.013903 24619 raft_consensus.cc:740] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.013550 24620 raft_consensus.cc:740] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.014799 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.015472 24620 consensus_queue.cc:260] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
W20260709 13:10:29.017524 24544 leader_election.cc:343] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.017248 24619 consensus_queue.cc:260] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.018292 24625 leader_election.cc:290] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149)
I20260709 13:10:29.013438 24633 raft_consensus.cc:2804] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.019747 24633 raft_consensus.cc:697] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:29.019994 24621 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.020670 24621 ts_tablet_manager.cc:1403] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:10:29.020764 24633 consensus_queue.cc:237] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.022449 24619 ts_tablet_manager.cc:1434] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:10:29.023495 24619 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.023959 24621 raft_consensus.cc:359] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.024830 24621 raft_consensus.cc:385] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.025187 24621 raft_consensus.cc:740] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.023542 24620 ts_tablet_manager.cc:1434] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:10:29.026086 24621 consensus_queue.cc:260] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.026851 24620 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.030457 24619 tablet_bootstrap.cc:654] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.036034 24620 tablet_bootstrap.cc:654] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.040130 24377 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.050063 24327 catalog_manager.cc:5697] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.052481 24621 ts_tablet_manager.cc:1434] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:10:29.053705 24621 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.061571 24630 raft_consensus.cc:493] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.062456 24619 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.062206 24630 raft_consensus.cc:515] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.063128 24619 ts_tablet_manager.cc:1403] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.003s
I20260709 13:10:29.065292 24630 leader_election.cc:290] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.065949 24620 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.066458 24621 tablet_bootstrap.cc:654] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.066548 24620 ts_tablet_manager.cc:1403] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.005s
I20260709 13:10:29.066644 24619 raft_consensus.cc:359] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.067613 24619 raft_consensus.cc:385] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.067930 24619 raft_consensus.cc:740] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.068727 24619 consensus_queue.cc:260] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.069945 24620 raft_consensus.cc:359] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.070777 24620 raft_consensus.cc:385] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.071113 24619 ts_tablet_manager.cc:1434] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:29.071091 24620 raft_consensus.cc:740] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.073668 24619 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.074596 24620 consensus_queue.cc:260] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.078466 24620 ts_tablet_manager.cc:1434] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:10:29.080117 24620 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.083703 24619 tablet_bootstrap.cc:654] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.085836 24624 raft_consensus.cc:493] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.086933 24620 tablet_bootstrap.cc:654] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.086530 24624 raft_consensus.cc:515] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.090484 24624 leader_election.cc:290] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.098861 24621 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.099534 24621 ts_tablet_manager.cc:1403] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:10:29.106297 24630 raft_consensus.cc:493] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.106909 24630 raft_consensus.cc:515] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.107645 24621 raft_consensus.cc:359] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.109148 24630 leader_election.cc:290] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.109413 24621 raft_consensus.cc:385] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.109764 24621 raft_consensus.cc:740] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.109855 24624 raft_consensus.cc:493] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.110431 24624 raft_consensus.cc:515] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.110710 24621 consensus_queue.cc:260] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.115527 24624 leader_election.cc:290] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.116191 24620 tablet_bootstrap.cc:492] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.116532 24619 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.117050 24620 ts_tablet_manager.cc:1403] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.037s	user 0.029s	sys 0.004s
I20260709 13:10:29.117187 24619 ts_tablet_manager.cc:1403] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.011s
I20260709 13:10:29.121882 24620 raft_consensus.cc:359] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.123075 24620 raft_consensus.cc:385] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.123903 24620 raft_consensus.cc:740] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.120774 24619 raft_consensus.cc:359] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.125275 24620 consensus_queue.cc:260] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.126549 24619 raft_consensus.cc:385] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.127070 24619 raft_consensus.cc:740] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.128176 24619 consensus_queue.cc:260] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.130779 24620 ts_tablet_manager.cc:1434] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:10:29.131821 24619 ts_tablet_manager.cc:1434] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:10:29.132042 24620 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.133391 24619 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.139647 24620 tablet_bootstrap.cc:654] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.148249 24619 tablet_bootstrap.cc:654] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.149569 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.149837 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.150374 24431 raft_consensus.cc:2468] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.150501 24430 raft_consensus.cc:2468] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.153178 24621 ts_tablet_manager.cc:1434] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.053s	user 0.019s	sys 0.012s
I20260709 13:10:29.157186 24470 leader_election.cc:304] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.158154 24630 raft_consensus.cc:2804] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.158325 24470 leader_election.cc:304] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.158533 24630 raft_consensus.cc:493] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.158947 24630 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.160306 24621 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.175174 24630 raft_consensus.cc:515] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.178604 24630 leader_election.cc:290] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.179487 24630 raft_consensus.cc:2804] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.179962 24630 raft_consensus.cc:493] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.180438 24630 raft_consensus.cc:3060] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.186201 24620 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.186909 24620 ts_tablet_manager.cc:1403] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.001s
I20260709 13:10:29.189957 24620 raft_consensus.cc:359] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.190721 24620 raft_consensus.cc:385] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.191012 24620 raft_consensus.cc:740] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.191856 24619 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.191776 24620 consensus_queue.cc:260] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.192996 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.192919 24621 tablet_bootstrap.cc:654] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.194197 24633 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.193598 24619 ts_tablet_manager.cc:1403] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.011s
I20260709 13:10:29.194716 24633 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.196872 24633 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:29.196993 24620 ts_tablet_manager.cc:1434] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:29.198115 24620 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.198894 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.199476 24630 raft_consensus.cc:515] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.200802 24506 raft_consensus.cc:2393] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30a7cf262acb434681ec7b74642b6ce3 in current term 1: Already voted for candidate 1845252628e74814810cd0efea9c212b in this term.
I20260709 13:10:29.200918 24619 raft_consensus.cc:359] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
W20260709 13:10:29.201457 24544 leader_election.cc:343] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.201885 24619 raft_consensus.cc:385] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.202440 24619 raft_consensus.cc:740] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.203299 24619 consensus_queue.cc:260] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.203465 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
W20260709 13:10:29.205840 24544 leader_election.cc:343] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.205834 24630 leader_election.cc:290] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.206517 24544 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.207752 24633 raft_consensus.cc:2749] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.207829 24619 ts_tablet_manager.cc:1434] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:10:29.208326 24620 tablet_bootstrap.cc:654] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.209256 24619 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.210103 24621 tablet_bootstrap.cc:492] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.210664 24621 ts_tablet_manager.cc:1403] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.002s
I20260709 13:10:29.214979 24621 raft_consensus.cc:359] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.215773 24621 raft_consensus.cc:385] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.216092 24621 raft_consensus.cc:740] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.217336 24619 tablet_bootstrap.cc:654] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.216884 24621 consensus_queue.cc:260] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.219574 24621 ts_tablet_manager.cc:1434] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:29.220742 24621 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.223452 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.226743 24620 tablet_bootstrap.cc:492] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.227326 24620 ts_tablet_manager.cc:1403] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:10:29.234112 24621 tablet_bootstrap.cc:654] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.235144 24395 leader_election.cc:343] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.237031 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:37149, user_credentials={real_user=slave}} blocked reactor thread for 78704.3us
I20260709 13:10:29.238354 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.237066 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.240731 24580 raft_consensus.cc:2468] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:29.239956 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.241703 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.242092 24431 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.242481 24430 raft_consensus.cc:3060] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.236145 24620 raft_consensus.cc:359] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.247988 24620 raft_consensus.cc:385] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.248275 24620 raft_consensus.cc:740] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.248678 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.248931 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.249091 24620 consensus_queue.cc:260] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
W20260709 13:10:29.247124 24395 leader_election.cc:343] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.250149 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.250484 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4017f4caa64f31b02b893e8e08b01b" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.250221 24395 leader_election.cc:304] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:29.252221 24648 raft_consensus.cc:2749] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.250896 24577 raft_consensus.cc:3060] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.253804 24620 ts_tablet_manager.cc:1434] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:10:29.254931 24620 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.260643 24577 raft_consensus.cc:2468] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.252213 24395 leader_election.cc:304] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:29.263733 24430 raft_consensus.cc:2468] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.264322 24648 raft_consensus.cc:2764] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:10:29.265272 24470 leader_election.cc:343] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.267032 24470 leader_election.cc:343] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.266317 24619 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.269270 24620 tablet_bootstrap.cc:654] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.271226 24619 ts_tablet_manager.cc:1403] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.014s
I20260709 13:10:29.271857 24431 raft_consensus.cc:2468] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.274655 24619 raft_consensus.cc:359] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.275276 24619 raft_consensus.cc:385] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.275556 24619 raft_consensus.cc:740] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.276351 24619 consensus_queue.cc:260] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.277061 24620 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.277575 24620 ts_tablet_manager.cc:1403] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 13:10:29.279290 24470 leader_election.cc:304] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:29.280308 24653 raft_consensus.cc:2804] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.280639 24620 raft_consensus.cc:359] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.280915 24470 leader_election.cc:304] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:29.281045 24653 raft_consensus.cc:697] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.281420 24620 raft_consensus.cc:385] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.281777 24620 raft_consensus.cc:740] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.282939 24619 ts_tablet_manager.cc:1434] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:29.282696 24620 consensus_queue.cc:260] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.282436 24653 consensus_queue.cc:237] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.283993 24619 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.288092 24620 ts_tablet_manager.cc:1434] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:10:29.289186 24620 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.289640 24630 raft_consensus.cc:2804] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.290419 24630 raft_consensus.cc:697] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.291426 24630 consensus_queue.cc:237] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.293570 24621 tablet_bootstrap.cc:492] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.294041 24648 raft_consensus.cc:493] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.294162 24621 ts_tablet_manager.cc:1403] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.074s	user 0.033s	sys 0.030s
I20260709 13:10:29.294574 24648 raft_consensus.cc:515] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.296828 24648 leader_election.cc:290] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.297590 24621 raft_consensus.cc:359] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.298403 24621 raft_consensus.cc:385] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.298362 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.298844 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.298923 24621 raft_consensus.cc:740] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.299486 24505 raft_consensus.cc:2393] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30a7cf262acb434681ec7b74642b6ce3 in current term 1: Already voted for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in this term.
I20260709 13:10:29.300182 24621 consensus_queue.cc:260] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.301900 24619 tablet_bootstrap.cc:654] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.303557 24395 leader_election.cc:304] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:29.304479 24648 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.309099 24621 ts_tablet_manager.cc:1434] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:10:29.310707 24621 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.312208 24620 tablet_bootstrap.cc:654] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.322299 24648 raft_consensus.cc:2749] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.324021 24621 tablet_bootstrap.cc:654] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.329946 24620 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.330480 24620 ts_tablet_manager.cc:1403] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.011s
I20260709 13:10:29.331569 24619 tablet_bootstrap.cc:492] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.331530 24327 catalog_manager.cc:5697] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.332641 24619 ts_tablet_manager.cc:1403] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.001s
I20260709 13:10:29.333115 24620 raft_consensus.cc:359] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.333828 24620 raft_consensus.cc:385] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.334151 24620 raft_consensus.cc:740] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.333453 24327 catalog_manager.cc:5697] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.334831 24620 consensus_queue.cc:260] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.335949 24621 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.336464 24621 ts_tablet_manager.cc:1403] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:10:29.336830 24620 ts_tablet_manager.cc:1434] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:29.336717 24619 raft_consensus.cc:359] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.337683 24619 raft_consensus.cc:385] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.337864 24620 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:29.338106 24619 raft_consensus.cc:740] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.339042 24619 consensus_queue.cc:260] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.339560 24621 raft_consensus.cc:359] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.340265 24621 raft_consensus.cc:385] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.340567 24621 raft_consensus.cc:740] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.341372 24621 consensus_queue.cc:260] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.342211 24619 ts_tablet_manager.cc:1434] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:29.343092 24633 raft_consensus.cc:493] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.343330 24619 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.344412 24620 tablet_bootstrap.cc:654] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.343600 24633 raft_consensus.cc:515] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.346503 24621 ts_tablet_manager.cc:1434] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:29.346745 24633 leader_election.cc:290] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:29.347581 24621 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:29.349665 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.350594 24431 raft_consensus.cc:2468] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:29.351761 24619 tablet_bootstrap.cc:654] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.351944 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.352859 24505 raft_consensus.cc:2468] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:29.354501 24621 tablet_bootstrap.cc:654] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.355444 24544 leader_election.cc:304] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.371850 24633 raft_consensus.cc:2804] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.372277 24633 raft_consensus.cc:493] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.372637 24633 raft_consensus.cc:3060] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.377209 24630 raft_consensus.cc:493] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.378041 24630 raft_consensus.cc:515] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.381021 24630 leader_election.cc:290] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.381611 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbd9c7e3a3f4648bfac2201b540949c" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.382579 24431 raft_consensus.cc:2468] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.384029 24470 leader_election.cc:304] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.385993 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbd9c7e3a3f4648bfac2201b540949c" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.386921 24577 raft_consensus.cc:2468] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.388573 24648 raft_consensus.cc:493] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.389525 24630 raft_consensus.cc:2804] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.389318 24648 raft_consensus.cc:515] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.390110 24630 raft_consensus.cc:493] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.390661 24630 raft_consensus.cc:3060] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.392370 24648 leader_election.cc:290] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.395184 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
W20260709 13:10:29.397166 24395 leader_election.cc:343] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.399304 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.400656 24577 raft_consensus.cc:2468] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:29.402769 24395 leader_election.cc:304] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:29.404490 24648 raft_consensus.cc:2804] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.405009 24648 raft_consensus.cc:493] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.405676 24648 raft_consensus.cc:3060] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.416106 24653 raft_consensus.cc:493] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.416926 24653 raft_consensus.cc:515] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.419875 24653 leader_election.cc:290] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.423132 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.424162 24577 raft_consensus.cc:2468] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.423017 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.425755 24470 leader_election.cc:304] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:29.405571 24630 raft_consensus.cc:515] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
W20260709 13:10:29.429013 24470 leader_election.cc:343] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.430297 24653 raft_consensus.cc:2804] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.430979 24653 raft_consensus.cc:493] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.431497 24653 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.431648 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbd9c7e3a3f4648bfac2201b540949c" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.433844 24431 raft_consensus.cc:3060] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.442809 24648 raft_consensus.cc:515] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.452145 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbd9c7e3a3f4648bfac2201b540949c" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.453104 24577 raft_consensus.cc:3060] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.453873 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
W20260709 13:10:29.455580 24395 leader_election.cc:343] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.456351 24648 leader_election.cc:290] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.456359 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.457647 24579 raft_consensus.cc:3060] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.462169 24630 leader_election.cc:290] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.445637 24633 raft_consensus.cc:515] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.469267 24620 tablet_bootstrap.cc:492] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:29.469424 24630 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.469924 24620 ts_tablet_manager.cc:1403] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.132s	user 0.058s	sys 0.062s
I20260709 13:10:29.470374 24621 tablet_bootstrap.cc:492] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:29.470715 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.471587 24621 ts_tablet_manager.cc:1403] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.124s	user 0.037s	sys 0.049s
I20260709 13:10:29.471764 24430 raft_consensus.cc:3060] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.473084 24620 raft_consensus.cc:359] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.473832 24620 raft_consensus.cc:385] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.474068 24431 raft_consensus.cc:2468] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.474156 24620 raft_consensus.cc:740] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.474514 24621 raft_consensus.cc:359] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.475158 24621 raft_consensus.cc:385] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.475482 24621 raft_consensus.cc:740] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.475215 24470 leader_election.cc:304] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.479947 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757b8f341fe3466dbb82b3447d7b213b" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:29.469993 24630 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.480603 24505 raft_consensus.cc:3060] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.481107 24659 raft_consensus.cc:2804] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.480786 24621 consensus_queue.cc:260] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.475221 24620 consensus_queue.cc:260] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.483669 24620 ts_tablet_manager.cc:1434] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:29.471452 24577 raft_consensus.cc:2468] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.476712 24648 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.469295 24619 tablet_bootstrap.cc:492] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.485608 24619 ts_tablet_manager.cc:1403] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.142s	user 0.029s	sys 0.055s
I20260709 13:10:29.485311 24648 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.486284 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.486444 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.486924 24429 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.487097 24580 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.487560 24648 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.488415 24470 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:29.488333 24619 raft_consensus.cc:359] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.489148 24619 raft_consensus.cc:385] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.489421 24619 raft_consensus.cc:740] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.489500 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.490142 24619 consensus_queue.cc:260] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.490393 24506 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:29.494901 24621 ts_tablet_manager.cc:1434] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:10:29.493798 24395 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.496140 24648 raft_consensus.cc:2804] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.496611 24648 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.497165 24648 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.470875 24579 raft_consensus.cc:2468] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:29.484786 24630 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.498008 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.503773 24630 raft_consensus.cc:2804] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.504179 24630 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.504312 24577 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:29.504679 24630 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.512300 24395 leader_election.cc:304] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:29.513616 24624 raft_consensus.cc:2804] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.518733 24648 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.519729 24625 consensus_queue.cc:1048] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.479956 24430 raft_consensus.cc:2468] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:29.522907 24624 raft_consensus.cc:697] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:29.523838 24624 consensus_queue.cc:237] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.524724 24544 leader_election.cc:304] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.525915 24625 raft_consensus.cc:2804] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.522104 24659 raft_consensus.cc:697] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.479908 24633 leader_election.cc:290] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:29.527006 24659 consensus_queue.cc:237] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.477329 24653 raft_consensus.cc:515] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.501732 24505 raft_consensus.cc:2468] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:29.522483 24630 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.531456 24653 leader_election.cc:290] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.534698 24630 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
W20260709 13:10:29.535086 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:46487, user_credentials={real_user=slave}} blocked reactor thread for 46753.4us
I20260709 13:10:29.537197 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.537663 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.537860 24430 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.538371 24579 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.538214 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.539522 24429 raft_consensus.cc:2393] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1845252628e74814810cd0efea9c212b in current term 1: Already voted for candidate 30a7cf262acb434681ec7b74642b6ce3 in this term.
I20260709 13:10:29.542095 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.542815 24577 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.525282 24668 raft_consensus.cc:493] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.545043 24668 raft_consensus.cc:515] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.549335 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.550160 24648 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.547459 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:29.546072 24579 raft_consensus.cc:2468] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.553987 24505 raft_consensus.cc:2393] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 30a7cf262acb434681ec7b74642b6ce3 in current term 1: Already voted for candidate 1845252628e74814810cd0efea9c212b in this term.
I20260709 13:10:29.555063 24395 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:29.556340 24648 raft_consensus.cc:2749] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.557302 24577 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.558205 24625 raft_consensus.cc:697] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:29.556455 24668 leader_election.cc:290] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.551365 24327 catalog_manager.cc:5697] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.563171 24619 ts_tablet_manager.cc:1434] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.077s	user 0.022s	sys 0.050s
I20260709 13:10:29.564502 24619 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:29.564599 24625 consensus_queue.cc:237] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.568176 24430 raft_consensus.cc:2468] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.570873 24619 tablet_bootstrap.cc:654] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.571906 24470 leader_election.cc:304] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.585002 24670 raft_consensus.cc:2804] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.588500 24670 raft_consensus.cc:697] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.588528 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12181c3648e746a3997f4fd763845f4d" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.592685 24577 raft_consensus.cc:2468] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.590389 24470 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.595252 24329 catalog_manager.cc:5697] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.597244 24678 consensus_queue.cc:1048] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.591565 24670 consensus_queue.cc:237] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.593371 24327 catalog_manager.cc:5697] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.603945 24668 raft_consensus.cc:2804] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.604560 24668 raft_consensus.cc:697] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.605440 24668 consensus_queue.cc:237] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.606977 24619 tablet_bootstrap.cc:492] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:29.607618 24619 ts_tablet_manager.cc:1403] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.012s
I20260709 13:10:29.611394 24619 raft_consensus.cc:359] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.612238 24619 raft_consensus.cc:385] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.612552 24619 raft_consensus.cc:740] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.613317 24619 consensus_queue.cc:260] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.614804 24470 leader_election.cc:304] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:29.616518 24669 raft_consensus.cc:2804] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.616931 24669 raft_consensus.cc:493] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.617311 24669 raft_consensus.cc:3060] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.615804 24619 ts_tablet_manager.cc:1434] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:29.616940 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12181c3648e746a3997f4fd763845f4d" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.622838 24430 raft_consensus.cc:2468] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:29.625792 24669 raft_consensus.cc:515] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.633057 24669 leader_election.cc:290] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.634223 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12181c3648e746a3997f4fd763845f4d" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.634829 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12181c3648e746a3997f4fd763845f4d" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:29.634966 24577 raft_consensus.cc:3060] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.635589 24431 raft_consensus.cc:3060] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.638502 24326 catalog_manager.cc:5697] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.640552 24326 catalog_manager.cc:5697] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.642654 24577 raft_consensus.cc:2468] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.642899 24431 raft_consensus.cc:2468] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:29.643982 24678 raft_consensus.cc:493] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.644222 24470 leader_election.cc:304] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.644541 24678 raft_consensus.cc:515] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.645092 24669 raft_consensus.cc:2804] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.645627 24669 raft_consensus.cc:697] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.646445 24669 consensus_queue.cc:237] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.646816 24678 leader_election.cc:290] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:29.648082 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:29.648314 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.649122 24431 raft_consensus.cc:2393] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in current term 1: Already voted for candidate 1845252628e74814810cd0efea9c212b in this term.
I20260709 13:10:29.651108 24544 leader_election.cc:304] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.651950 24678 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.657027 24678 raft_consensus.cc:2749] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.665247 24329 catalog_manager.cc:5697] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.716806 24577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
mode: GRACEFUL
new_leader_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:59942
I20260709 13:10:29.717341 24577 raft_consensus.cc:606] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Received request to transfer leadership to TS 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.731513 24505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568"
dest_uuid: "1845252628e74814810cd0efea9c212b"
mode: GRACEFUL
new_leader_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:10:29.732161 24505 raft_consensus.cc:606] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Received request to transfer leadership to TS 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.737738 24505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62130d409989487e9685c4d2cc951be5"
dest_uuid: "1845252628e74814810cd0efea9c212b"
mode: GRACEFUL
new_leader_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:10:29.738262 24505 raft_consensus.cc:606] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Received request to transfer leadership to TS 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.742128 24669 consensus_queue.cc:1048] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.753237 24669 consensus_queue.cc:1048] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.765580 24659 raft_consensus.cc:993] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: : Instructing follower 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:29.766111 24659 raft_consensus.cc:1081] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Signalling peer 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:29.768229 24430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:54032
I20260709 13:10:29.769073 24430 raft_consensus.cc:493] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.769517 24430 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.770293 24670 consensus_queue.cc:1048] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.778235 24430 raft_consensus.cc:515] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.781317 24430 leader_election.cc:290] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.781625 24630 consensus_queue.cc:1048] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.783147 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:29.783802 24505 raft_consensus.cc:3055] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.784142 24505 raft_consensus.cc:740] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:29.784479 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca9fd63bd964a948a1541c9e9fe9568" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:29.785071 24577 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.784916 24505 consensus_queue.cc:260] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.786207 24505 raft_consensus.cc:3060] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.793475 24577 raft_consensus.cc:2468] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:29.793763 24505 raft_consensus.cc:2468] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:29.795670 24395 leader_election.cc:304] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:29.797267 24648 raft_consensus.cc:2804] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.797837 24648 raft_consensus.cc:697] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:29.798684 24648 consensus_queue.cc:237] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.802958 24630 raft_consensus.cc:493] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.803617 24630 raft_consensus.cc:515] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:29.805969 24630 leader_election.cc:290] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:29.806902 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:29.807776 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd2f7e2eb714196a57d71af89e7c57f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:29.808535 24577 raft_consensus.cc:2393] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1845252628e74814810cd0efea9c212b in current term 1: Already voted for candidate 30a7cf262acb434681ec7b74642b6ce3 in this term.
I20260709 13:10:29.809866 24470 leader_election.cc:304] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1845252628e74814810cd0efea9c212b; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:29.810738 24630 raft_consensus.cc:3060] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.815651 24326 catalog_manager.cc:5697] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 1 to 2, leader changed from 1845252628e74814810cd0efea9c212b (127.14.34.130) to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.818712 24630 raft_consensus.cc:2749] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.917094 24630 consensus_queue.cc:1048] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.928720 24659 consensus_queue.cc:1048] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.997412 24678 consensus_queue.cc:1048] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.008581 24633 consensus_queue.cc:1048] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.017516 24624 consensus_queue.cc:1048] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.019120 24633 raft_consensus.cc:993] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: : Instructing follower 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:30.019690 24633 raft_consensus.cc:1081] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Signalling peer 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:30.021374 24430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:10:30.022135 24430 raft_consensus.cc:493] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.022670 24430 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.029675 24671 consensus_queue.cc:1048] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.030185 24430 raft_consensus.cc:515] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.034178 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:30.034385 24430 leader_election.cc:290] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:30.034816 24579 raft_consensus.cc:3055] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.035175 24579 raft_consensus.cc:740] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:30.036067 24579 consensus_queue.cc:260] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.039158 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af51e57ee6cf4b04bded4c1b9da501cb" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:30.039862 24505 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.039052 24579 raft_consensus.cc:3060] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.046979 24505 raft_consensus.cc:2468] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:30.048333 24395 leader_election.cc:304] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:30.049167 24648 raft_consensus.cc:2804] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.049656 24648 raft_consensus.cc:697] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:30.049803 24579 raft_consensus.cc:2468] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:30.050536 24648 consensus_queue.cc:237] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.058251 24327 catalog_manager.cc:5697] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 1 to 2, leader changed from 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131) to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.112407 24659 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.123533 24659 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.131273 24630 raft_consensus.cc:993] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: : Instructing follower 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:30.131778 24659 raft_consensus.cc:1081] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Signalling peer 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:30.133531 24430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62130d409989487e9685c4d2cc951be5"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:54032
I20260709 13:10:30.134130 24430 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.134517 24430 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.139914 24430 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.141575 24430 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:30.142362 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:30.142840 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:30.143024 24505 raft_consensus.cc:3055] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.143476 24505 raft_consensus.cc:740] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:30.143488 24579 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.144268 24505 consensus_queue.cc:260] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.145351 24505 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.149761 24659 consensus_queue.cc:1048] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.150265 24579 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:30.151408 24395 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:30.152251 24671 raft_consensus.cc:2804] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.152336 24505 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:30.153043 24671 raft_consensus.cc:697] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:30.153937 24671 consensus_queue.cc:237] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:30.154520 24659 consensus_queue.cc:1048] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.163508 24328 catalog_manager.cc:5697] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 1 to 2, leader changed from 1845252628e74814810cd0efea9c212b (127.14.34.130) to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.179056 24659 consensus_queue.cc:1048] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.187052 24630 consensus_queue.cc:1048] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.208735 24505 raft_consensus.cc:1275] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.209977 24671 consensus_queue.cc:1048] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.218739 24579 raft_consensus.cc:1275] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.220515 24648 consensus_queue.cc:1048] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.432178 24505 raft_consensus.cc:1275] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.433318 24648 consensus_queue.cc:1048] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.441905 24579 raft_consensus.cc:1275] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.443602 24671 consensus_queue.cc:1048] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.641348 24505 raft_consensus.cc:1275] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.642973 24624 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.650362 24579 raft_consensus.cc:1275] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.652436 24671 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:32.794826 24327 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53242:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:32.797340 24327 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:32.844394 24417 tablet_service.cc:1511] Processing CreateTablet for tablet 3c80a7a0be1f4011b647d69300a1c0f2 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:32.845582 24493 tablet_service.cc:1511] Processing CreateTablet for tablet 3c80a7a0be1f4011b647d69300a1c0f2 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:32.845682 24417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c80a7a0be1f4011b647d69300a1c0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.846915 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c80a7a0be1f4011b647d69300a1c0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.847843 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 3a26789d5ded43b58874fafb8796400e (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:32.849093 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a26789d5ded43b58874fafb8796400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.847863 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 3c80a7a0be1f4011b647d69300a1c0f2 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:32.852317 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c80a7a0be1f4011b647d69300a1c0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.862885 24567 tablet_service.cc:1511] Processing CreateTablet for tablet 0309f2f93edb4794b8d5ba4584530529 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:32.864271 24567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0309f2f93edb4794b8d5ba4584530529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.865588 24494 tablet_service.cc:1511] Processing CreateTablet for tablet ad38aee9012a4b218c1fcdfe70f0f861 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:32.862911 24491 tablet_service.cc:1511] Processing CreateTablet for tablet 3a26789d5ded43b58874fafb8796400e (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:32.864162 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 0309f2f93edb4794b8d5ba4584530529 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:32.867403 24494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad38aee9012a4b218c1fcdfe70f0f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.868096 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0309f2f93edb4794b8d5ba4584530529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.870337 24491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a26789d5ded43b58874fafb8796400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.871372 24562 tablet_service.cc:1511] Processing CreateTablet for tablet 3a26789d5ded43b58874fafb8796400e (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:32.873092 24562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a26789d5ded43b58874fafb8796400e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.875643 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 0309f2f93edb4794b8d5ba4584530529 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:32.876920 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0309f2f93edb4794b8d5ba4584530529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.879606 24419 tablet_service.cc:1511] Processing CreateTablet for tablet ad38aee9012a4b218c1fcdfe70f0f861 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:32.879894 24492 tablet_service.cc:1511] Processing CreateTablet for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:32.880908 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad38aee9012a4b218c1fcdfe70f0f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.881117 24492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.882450 24496 tablet_service.cc:1511] Processing CreateTablet for tablet ab7e3a40f5564a14b3afcab3d9143fc9 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:32.882970 24566 tablet_service.cc:1511] Processing CreateTablet for tablet ad38aee9012a4b218c1fcdfe70f0f861 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:32.884285 24566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad38aee9012a4b218c1fcdfe70f0f861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.884104 24563 tablet_service.cc:1511] Processing CreateTablet for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:32.885334 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.885100 24420 tablet_service.cc:1511] Processing CreateTablet for tablet ab7e3a40f5564a14b3afcab3d9143fc9 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:32.886386 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7e3a40f5564a14b3afcab3d9143fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.887001 24421 tablet_service.cc:1511] Processing CreateTablet for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:32.888216 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4a00fdd7984efbbf93d5d3bf0d86bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.889541 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7e3a40f5564a14b3afcab3d9143fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.892663 24564 tablet_service.cc:1511] Processing CreateTablet for tablet ab7e3a40f5564a14b3afcab3d9143fc9 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:32.893939 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7e3a40f5564a14b3afcab3d9143fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.895582 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 412ba0c7bfe347ca856981923c589daa (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:32.896817 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412ba0c7bfe347ca856981923c589daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.936496 24490 tablet_service.cc:1511] Processing CreateTablet for tablet 412ba0c7bfe347ca856981923c589daa (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:32.938059 24718 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:32.938803 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412ba0c7bfe347ca856981923c589daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.953665 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 412ba0c7bfe347ca856981923c589daa (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:32.955408 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412ba0c7bfe347ca856981923c589daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.955267 24568 tablet_service.cc:1511] Processing CreateTablet for tablet f27fcf0c76a149eabb21ffcd56b82f03 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:32.956707 24568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27fcf0c76a149eabb21ffcd56b82f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.957008 24570 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6d03d784a45439ad047bd1ea64a3f (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:32.957922 24492 tablet_service.cc:1511] Processing CreateTablet for tablet f27fcf0c76a149eabb21ffcd56b82f03 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:32.957963 24493 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6d03d784a45439ad047bd1ea64a3f (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:32.958527 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6d03d784a45439ad047bd1ea64a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.959991 24419 tablet_service.cc:1511] Processing CreateTablet for tablet f27fcf0c76a149eabb21ffcd56b82f03 (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:32.965830 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27fcf0c76a149eabb21ffcd56b82f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.966645 24492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27fcf0c76a149eabb21ffcd56b82f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.967023 24416 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6d03d784a45439ad047bd1ea64a3f (DEFAULT_TABLE table=soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:32.968259 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6d03d784a45439ad047bd1ea64a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.969182 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6d03d784a45439ad047bd1ea64a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.985906 24718 tablet_bootstrap.cc:654] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.009459 24718 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.009967 24718 ts_tablet_manager.cc:1403] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.003s
I20260709 13:10:33.012995 24718 raft_consensus.cc:359] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.013723 24718 raft_consensus.cc:385] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.014014 24718 raft_consensus.cc:740] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.024616 24718 consensus_queue.cc:260] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.026916 24718 ts_tablet_manager.cc:1434] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:10:33.064539 24716 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.066916 24718 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.072381 24717 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.073711 24718 tablet_bootstrap.cc:654] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.074745 24716 tablet_bootstrap.cc:654] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.079556 24718 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.079996 24718 ts_tablet_manager.cc:1403] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 13:10:33.080206 24717 tablet_bootstrap.cc:654] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.081058 24716 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.081621 24716 ts_tablet_manager.cc:1403] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
W20260709 13:10:33.082893 24377 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:33.082618 24718 raft_consensus.cc:359] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.083393 24718 raft_consensus.cc:385] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.083662 24718 raft_consensus.cc:740] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.084352 24718 consensus_queue.cc:260] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.085306 24716 raft_consensus.cc:359] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.086215 24716 raft_consensus.cc:385] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.086503 24716 raft_consensus.cc:740] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.086759 24718 ts_tablet_manager.cc:1434] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:10:33.087239 24716 consensus_queue.cc:260] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.089023 24718 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.090246 24716 ts_tablet_manager.cc:1434] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.008s
I20260709 13:10:33.091605 24716 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.094386 24717 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.094909 24717 ts_tablet_manager.cc:1403] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:10:33.096474 24718 tablet_bootstrap.cc:654] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.097836 24717 raft_consensus.cc:359] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.099205 24717 raft_consensus.cc:385] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.099505 24717 raft_consensus.cc:740] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.100376 24717 consensus_queue.cc:260] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.102010 24716 tablet_bootstrap.cc:654] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.102933 24717 ts_tablet_manager.cc:1434] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:33.104075 24717 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.112468 24717 tablet_bootstrap.cc:654] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.116771 24716 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.117446 24716 ts_tablet_manager.cc:1403] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.011s
I20260709 13:10:33.121534 24716 raft_consensus.cc:359] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.122526 24716 raft_consensus.cc:385] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.122896 24716 raft_consensus.cc:740] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.123667 24716 consensus_queue.cc:260] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.125555 24717 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.126094 24716 ts_tablet_manager.cc:1434] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:10:33.126152 24717 ts_tablet_manager.cc:1403] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:10:33.127193 24716 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.129384 24717 raft_consensus.cc:359] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.130142 24717 raft_consensus.cc:385] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.130450 24717 raft_consensus.cc:740] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.131454 24717 consensus_queue.cc:260] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.133706 24717 ts_tablet_manager.cc:1434] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:33.134666 24717 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.134699 24716 tablet_bootstrap.cc:654] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.143611 24717 tablet_bootstrap.cc:654] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.150472 24716 tablet_bootstrap.cc:492] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.151116 24716 ts_tablet_manager.cc:1403] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:10:33.153558 24717 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.154137 24717 ts_tablet_manager.cc:1403] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:10:33.154259 24716 raft_consensus.cc:359] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.155059 24716 raft_consensus.cc:385] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.155371 24716 raft_consensus.cc:740] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.156095 24716 consensus_queue.cc:260] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.157214 24717 raft_consensus.cc:359] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.157975 24717 raft_consensus.cc:385] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.158397 24717 raft_consensus.cc:740] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.158417 24716 ts_tablet_manager.cc:1434] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:33.159596 24716 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.159313 24717 consensus_queue.cc:260] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.161715 24717 ts_tablet_manager.cc:1434] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:33.162698 24717 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.167403 24716 tablet_bootstrap.cc:654] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.169613 24717 tablet_bootstrap.cc:654] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.183167 24716 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.183167 24718 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.183279 24717 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.183763 24716 ts_tablet_manager.cc:1403] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:10:33.183859 24718 ts_tablet_manager.cc:1403] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.095s	user 0.045s	sys 0.046s
I20260709 13:10:33.184029 24717 ts_tablet_manager.cc:1403] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:10:33.187274 24718 raft_consensus.cc:359] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.187484 24716 raft_consensus.cc:359] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.188118 24718 raft_consensus.cc:385] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.188230 24716 raft_consensus.cc:385] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.187819 24717 raft_consensus.cc:359] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.188547 24718 raft_consensus.cc:740] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.188640 24716 raft_consensus.cc:740] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.188769 24717 raft_consensus.cc:385] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.189254 24717 raft_consensus.cc:740] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.189580 24718 consensus_queue.cc:260] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.189606 24716 consensus_queue.cc:260] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.192579 24718 ts_tablet_manager.cc:1434] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:33.193194 24705 raft_consensus.cc:493] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.193584 24718 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.193746 24705 raft_consensus.cc:515] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.190171 24717 consensus_queue.cc:260] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.196190 24705 leader_election.cc:290] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.198232 24717 ts_tablet_manager.cc:1434] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:10:33.199417 24717 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.200081 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4a00fdd7984efbbf93d5d3bf0d86bf" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.200824 24430 raft_consensus.cc:2468] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.201114 24718 tablet_bootstrap.cc:654] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.199256 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4a00fdd7984efbbf93d5d3bf0d86bf" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.202214 24579 raft_consensus.cc:2468] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.203742 24470 leader_election.cc:304] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.205761 24671 raft_consensus.cc:493] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.206321 24671 raft_consensus.cc:515] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.207104 24717 tablet_bootstrap.cc:654] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.208632 24671 leader_election.cc:290] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.211426 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.212347 24505 raft_consensus.cc:2468] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.214550 24716 ts_tablet_manager.cc:1434] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:10:33.214412 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.219355 24716 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
W20260709 13:10:33.219920 24395 leader_election.cc:343] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.228825 24716 tablet_bootstrap.cc:654] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.231599 24705 raft_consensus.cc:2804] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.232223 24705 raft_consensus.cc:493] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.232674 24705 raft_consensus.cc:3060] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.221000 24395 leader_election.cc:304] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:33.238142 24671 raft_consensus.cc:493] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.238824 24671 raft_consensus.cc:515] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.253420 24671 leader_election.cc:290] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.254170 24716 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.255074 24716 ts_tablet_manager.cc:1403] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.020s
I20260709 13:10:33.259586 24716 raft_consensus.cc:359] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.260756 24716 raft_consensus.cc:385] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.261193 24716 raft_consensus.cc:740] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.262460 24716 consensus_queue.cc:260] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.265820 24716 ts_tablet_manager.cc:1434] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:10:33.267246 24716 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.276731 24716 tablet_bootstrap.cc:654] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.289796 24734 raft_consensus.cc:493] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.290556 24734 raft_consensus.cc:515] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.293397 24734 leader_election.cc:290] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.295828 24705 raft_consensus.cc:515] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.298743 24705 leader_election.cc:290] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
W20260709 13:10:33.299960 24395 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:41937, user_credentials={real_user=slave}} blocked reactor thread for 79068.7us
I20260709 13:10:33.301693 24716 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.302474 24716 ts_tablet_manager.cc:1403] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.010s
I20260709 13:10:33.302714 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad38aee9012a4b218c1fcdfe70f0f861" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.303977 24579 raft_consensus.cc:2468] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.306737 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad38aee9012a4b218c1fcdfe70f0f861" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.306962 24716 raft_consensus.cc:359] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.308161 24625 raft_consensus.cc:493] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.308403 24716 raft_consensus.cc:385] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.308890 24716 raft_consensus.cc:740] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.308892 24625 raft_consensus.cc:515] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.310141 24716 consensus_queue.cc:260] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.312071 24625 leader_election.cc:290] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:33.314801 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.315402 24716 ts_tablet_manager.cc:1434] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
W20260709 13:10:33.316664 24544 leader_election.cc:343] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.317771 24671 raft_consensus.cc:2804] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.318370 24671 raft_consensus.cc:493] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.318801 24671 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.325922 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
W20260709 13:10:33.328743 24544 leader_election.cc:343] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.329344 24544 leader_election.cc:304] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:33.330561 24625 raft_consensus.cc:2749] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.336182 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.344281 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
W20260709 13:10:33.369930 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:37149, user_credentials={real_user=slave}} blocked reactor thread for 166277us
I20260709 13:10:33.376830 24716 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.386390 24716 tablet_bootstrap.cc:654] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.393350 24395 leader_election.cc:343] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:33.394419 24395 leader_election.cc:343] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.395272 24395 leader_election.cc:304] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
W20260709 13:10:33.396754 24395 leader_election.cc:343] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.397274 24395 leader_election.cc:304] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:33.399830 24739 raft_consensus.cc:2804] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.400346 24734 raft_consensus.cc:2749] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.401453 24739 raft_consensus.cc:493] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.402673 24739 raft_consensus.cc:3060] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.402666 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4a00fdd7984efbbf93d5d3bf0d86bf" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:33.403527 24430 raft_consensus.cc:3060] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.408077 24671 raft_consensus.cc:515] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.410300 24718 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.410917 24718 ts_tablet_manager.cc:1403] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.218s	user 0.054s	sys 0.128s
I20260709 13:10:33.411672 24717 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.412263 24717 ts_tablet_manager.cc:1403] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.213s	user 0.075s	sys 0.113s
I20260709 13:10:33.412367 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4a00fdd7984efbbf93d5d3bf0d86bf" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.413035 24579 raft_consensus.cc:3060] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.413419 24430 raft_consensus.cc:2468] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.415617 24717 raft_consensus.cc:359] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.416419 24717 raft_consensus.cc:385] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.421344 24718 raft_consensus.cc:359] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.422145 24718 raft_consensus.cc:385] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.422427 24718 raft_consensus.cc:740] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.423156 24717 raft_consensus.cc:740] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.423113 24718 consensus_queue.cc:260] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.424206 24717 consensus_queue.cc:260] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.427882 24717 ts_tablet_manager.cc:1434] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:10:33.428186 24671 leader_election.cc:290] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.430147 24716 tablet_bootstrap.cc:492] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.435277 24716 ts_tablet_manager.cc:1403] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.011s
I20260709 13:10:33.430549 24739 raft_consensus.cc:515] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.431701 24470 leader_election.cc:304] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.433616 24718 ts_tablet_manager.cc:1434] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 13:10:33.434262 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:33.438517 24505 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.436340 24717 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.438884 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad38aee9012a4b218c1fcdfe70f0f861" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
W20260709 13:10:33.440395 24395 leader_election.cc:343] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.433754 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.441182 24718 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.441468 24736 raft_consensus.cc:493] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.441924 24395 leader_election.cc:343] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.442011 24736 raft_consensus.cc:515] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.444315 24736 leader_election.cc:290] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.447278 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.448239 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad38aee9012a4b218c1fcdfe70f0f861" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.448359 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.448928 24577 raft_consensus.cc:3060] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.449146 24579 raft_consensus.cc:2468] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.449568 24705 raft_consensus.cc:2804] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.445863 24505 raft_consensus.cc:2468] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.450138 24705 raft_consensus.cc:697] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:33.451037 24716 raft_consensus.cc:359] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.451116 24705 consensus_queue.cc:237] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.451902 24716 raft_consensus.cc:385] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.452246 24716 raft_consensus.cc:740] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.452983 24717 tablet_bootstrap.cc:654] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.456132 24470 leader_election.cc:343] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:33.456920 24470 leader_election.cc:343] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.457276 24577 raft_consensus.cc:2468] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.457319 24470 leader_election.cc:304] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1845252628e74814810cd0efea9c212b; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:33.442065 24739 leader_election.cc:290] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.458650 24395 leader_election.cc:304] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:33.454903 24718 tablet_bootstrap.cc:654] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.453091 24716 consensus_queue.cc:260] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.459784 24671 raft_consensus.cc:2804] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.459870 24395 leader_election.cc:304] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:33.460572 24671 raft_consensus.cc:697] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:33.461387 24716 ts_tablet_manager.cc:1434] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:10:33.461438 24671 consensus_queue.cc:237] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.462893 24716 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.464483 24734 raft_consensus.cc:2804] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.465013 24734 raft_consensus.cc:697] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:33.465796 24734 consensus_queue.cc:237] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.471161 24736 raft_consensus.cc:2749] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.477662 24716 tablet_bootstrap.cc:654] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.484422 24717 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.485023 24717 ts_tablet_manager.cc:1403] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.006s
I20260709 13:10:33.485960 24327 catalog_manager.cc:5697] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.488669 24625 raft_consensus.cc:493] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.489784 24718 tablet_bootstrap.cc:492] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.490429 24718 ts_tablet_manager.cc:1403] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.009s
I20260709 13:10:33.489356 24625 raft_consensus.cc:515] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.493645 24625 leader_election.cc:290] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:33.488247 24717 raft_consensus.cc:359] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.495791 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.496652 24717 raft_consensus.cc:385] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.493754 24718 raft_consensus.cc:359] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.488222 24327 catalog_manager.cc:5697] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.496212 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.497272 24718 raft_consensus.cc:385] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.497434 24430 raft_consensus.cc:2468] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:33.498631 24716 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
W20260709 13:10:33.497661 24544 leader_election.cc:343] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.499010 24734 raft_consensus.cc:493] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.499202 24716 ts_tablet_manager.cc:1403] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.000s
I20260709 13:10:33.499728 24544 leader_election.cc:304] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:33.499570 24734 raft_consensus.cc:515] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.496980 24717 raft_consensus.cc:740] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.501185 24718 raft_consensus.cc:740] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.502588 24716 raft_consensus.cc:359] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.501986 24718 consensus_queue.cc:260] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.503638 24716 raft_consensus.cc:385] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.503762 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.504050 24716 raft_consensus.cc:740] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.504999 24716 consensus_queue.cc:260] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
W20260709 13:10:33.505280 24395 leader_election.cc:343] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.505451 24718 ts_tablet_manager.cc:1434] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:33.501724 24734 leader_election.cc:290] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.506639 24718 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.506685 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
W20260709 13:10:33.508035 24395 leader_election.cc:343] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.508157 24625 raft_consensus.cc:2804] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.502525 24717 consensus_queue.cc:260] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.508613 24625 raft_consensus.cc:493] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.508553 24395 leader_election.cc:304] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:33.509100 24625 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.509869 24734 raft_consensus.cc:2749] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.511127 24716 ts_tablet_manager.cc:1434] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:33.512231 24716 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: Bootstrap starting.
I20260709 13:10:33.516180 24718 tablet_bootstrap.cc:654] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.518967 24716 tablet_bootstrap.cc:654] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.528237 24625 raft_consensus.cc:515] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.533582 24717 ts_tablet_manager.cc:1434] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.006s
I20260709 13:10:33.543512 24717 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.551331 24625 leader_election.cc:290] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:33.551994 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:33.552667 24430 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.553272 24717 tablet_bootstrap.cc:654] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.554864 24718 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.555238 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:33.555456 24718 ts_tablet_manager.cc:1403] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.014s
W20260709 13:10:33.557065 24544 leader_election.cc:343] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.559458 24718 raft_consensus.cc:359] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.560333 24718 raft_consensus.cc:385] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.560734 24718 raft_consensus.cc:740] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.561611 24718 consensus_queue.cc:260] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.564684 24718 ts_tablet_manager.cc:1434] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:33.566144 24718 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.567502 24717 tablet_bootstrap.cc:492] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.568071 24717 ts_tablet_manager.cc:1403] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:10:33.571322 24717 raft_consensus.cc:359] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.572029 24717 raft_consensus.cc:385] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.572310 24717 raft_consensus.cc:740] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.573096 24717 consensus_queue.cc:260] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.574735 24718 tablet_bootstrap.cc:654] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.575574 24717 ts_tablet_manager.cc:1434] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:33.576629 24717 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.582295 24430 raft_consensus.cc:2468] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:33.584569 24544 leader_election.cc:304] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 1845252628e74814810cd0efea9c212b
I20260709 13:10:33.585685 24625 raft_consensus.cc:2804] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.586719 24625 raft_consensus.cc:697] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:33.587646 24625 consensus_queue.cc:237] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.592864 24716 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: No bootstrap required, opened a new log
I20260709 13:10:33.593611 24716 ts_tablet_manager.cc:1403] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.013s
I20260709 13:10:33.597419 24716 raft_consensus.cc:359] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.598739 24716 raft_consensus.cc:385] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.599105 24716 raft_consensus.cc:740] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.604406 24716 consensus_queue.cc:260] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.607578 24716 ts_tablet_manager.cc:1434] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:10:33.617729 24717 tablet_bootstrap.cc:654] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.621126 24718 tablet_bootstrap.cc:492] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.621670 24718 ts_tablet_manager.cc:1403] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.014s
I20260709 13:10:33.625319 24718 raft_consensus.cc:359] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.626048 24718 raft_consensus.cc:385] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.626346 24718 raft_consensus.cc:740] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.627099 24718 consensus_queue.cc:260] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.631671 24734 raft_consensus.cc:493] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.632193 24734 raft_consensus.cc:515] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.634963 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.634523 24326 catalog_manager.cc:5697] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.635605 24506 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.636780 24395 leader_election.cc:304] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.637290 24734 leader_election.cc:290] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.637849 24734 raft_consensus.cc:2804] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.638211 24734 raft_consensus.cc:493] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.638593 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.639272 24577 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.629786 24329 catalog_manager.cc:5697] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.638535 24734 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.647619 24718 ts_tablet_manager.cc:1434] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 13:10:33.648820 24718 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.660531 24718 tablet_bootstrap.cc:654] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.661254 24705 raft_consensus.cc:493] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.661809 24705 raft_consensus.cc:515] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.662268 24734 raft_consensus.cc:515] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.664078 24705 leader_election.cc:290] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.665503 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:33.667219 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.668045 24430 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.669011 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.669677 24577 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.671828 24470 leader_election.cc:304] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.673804 24734 leader_election.cc:290] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.677151 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.677867 24577 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.680229 24705 raft_consensus.cc:2804] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.680814 24705 raft_consensus.cc:493] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.681181 24705 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.675940 24506 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.690821 24577 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.692261 24506 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.695363 24395 leader_election.cc:304] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.696293 24734 raft_consensus.cc:2804] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.696792 24734 raft_consensus.cc:697] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:33.697639 24734 consensus_queue.cc:237] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.700292 24705 raft_consensus.cc:515] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.703831 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:33.704622 24430 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.714619 24430 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.715799 24470 leader_election.cc:304] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.716650 24736 raft_consensus.cc:2804] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.717187 24736 raft_consensus.cc:697] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:33.718089 24736 consensus_queue.cc:237] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.720861 24717 tablet_bootstrap.cc:492] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.721412 24717 ts_tablet_manager.cc:1403] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.035s
I20260709 13:10:33.723049 24326 catalog_manager.cc:5697] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.724471 24717 raft_consensus.cc:359] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.725322 24717 raft_consensus.cc:385] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.725579 24717 raft_consensus.cc:740] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.726636 24717 consensus_queue.cc:260] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.728857 24717 ts_tablet_manager.cc:1434] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:33.733166 24717 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Bootstrap starting.
I20260709 13:10:33.735222 24705 leader_election.cc:290] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.736644 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.737386 24577 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.746920 24717 tablet_bootstrap.cc:654] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.751502 24718 tablet_bootstrap.cc:492] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.752023 24718 ts_tablet_manager.cc:1403] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.007s
I20260709 13:10:33.753773 24328 catalog_manager.cc:5697] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.754813 24718 raft_consensus.cc:359] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.755462 24718 raft_consensus.cc:385] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.755704 24718 raft_consensus.cc:740] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.756795 24718 consensus_queue.cc:260] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.760317 24718 ts_tablet_manager.cc:1434] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:33.760779 24717 tablet_bootstrap.cc:492] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: No bootstrap required, opened a new log
I20260709 13:10:33.761288 24718 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: Bootstrap starting.
I20260709 13:10:33.761338 24717 ts_tablet_manager.cc:1403] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:10:33.765009 24717 raft_consensus.cc:359] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.765719 24717 raft_consensus.cc:385] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.765995 24717 raft_consensus.cc:740] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.766844 24717 consensus_queue.cc:260] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.768198 24718 tablet_bootstrap.cc:654] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.769085 24717 ts_tablet_manager.cc:1434] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:33.773229 24718 tablet_bootstrap.cc:492] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: No bootstrap required, opened a new log
I20260709 13:10:33.773749 24718 ts_tablet_manager.cc:1403] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 13:10:33.776484 24718 raft_consensus.cc:359] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.777149 24718 raft_consensus.cc:385] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.777421 24718 raft_consensus.cc:740] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.778105 24718 consensus_queue.cc:260] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.780406 24718 ts_tablet_manager.cc:1434] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:33.780352 24577 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.816867 24734 raft_consensus.cc:493] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.817469 24734 raft_consensus.cc:515] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.819877 24734 leader_election.cc:290] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.820664 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.821043 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.821303 24506 raft_consensus.cc:2468] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.821758 24577 raft_consensus.cc:2468] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 0.
I20260709 13:10:33.822439 24395 leader_election.cc:304] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.823261 24734 raft_consensus.cc:2804] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.823634 24734 raft_consensus.cc:493] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.823975 24734 raft_consensus.cc:3060] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.832053 24734 raft_consensus.cc:515] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.834383 24734 leader_election.cc:290] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.835089 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:33.835668 24506 raft_consensus.cc:3060] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.835464 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a26789d5ded43b58874fafb8796400e" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.836254 24577 raft_consensus.cc:3060] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.840911 24506 raft_consensus.cc:2468] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.842099 24395 leader_election.cc:304] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.842782 24734 raft_consensus.cc:2804] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.843216 24734 raft_consensus.cc:697] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:33.844161 24577 raft_consensus.cc:2468] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 1.
I20260709 13:10:33.844061 24734 consensus_queue.cc:237] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.852095 24326 catalog_manager.cc:5697] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.857234 24731 raft_consensus.cc:493] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.857812 24731 raft_consensus.cc:515] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.859989 24731 leader_election.cc:290] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.861230 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:33.861230 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.862082 24577 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.862563 24430 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 0.
I20260709 13:10:33.863307 24470 leader_election.cc:304] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:33.864185 24731 raft_consensus.cc:2804] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.864526 24731 raft_consensus.cc:493] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.864859 24731 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.865250 24734 consensus_queue.cc:1048] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.873971 24731 raft_consensus.cc:515] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.877813 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:33.878481 24430 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.877826 24671 consensus_queue.cc:1048] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:33.886992 24625 raft_consensus.cc:493] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.887615 24625 raft_consensus.cc:515] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.891458 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:33.891741 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b" is_pre_election: true
I20260709 13:10:33.892232 24431 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:33.892551 24505 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 0.
I20260709 13:10:33.893729 24544 leader_election.cc:304] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.894194 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:33.894690 24747 raft_consensus.cc:2804] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.895049 24579 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.895135 24747 raft_consensus.cc:493] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.895648 24747 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.889863 24625 leader_election.cc:290] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:33.906648 24430 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.907841 24747 raft_consensus.cc:515] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.911859 24470 leader_election.cc:304] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.912784 24705 raft_consensus.cc:2804] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.889817 24731 leader_election.cc:290] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:33.913241 24705 raft_consensus.cc:697] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:33.914122 24705 consensus_queue.cc:237] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.914528 24579 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 1.
I20260709 13:10:33.913266 24747 leader_election.cc:290] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:33.924579 24506 raft_consensus.cc:3060] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.925074 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:33.925729 24430 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.932804 24580 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.934321 24430 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:33.935173 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:33.935616 24544 leader_election.cc:304] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:33.935889 24505 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.936568 24747 raft_consensus.cc:2804] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.937237 24747 raft_consensus.cc:697] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:33.933527 24328 catalog_manager.cc:5697] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 1 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.938630 24747 consensus_queue.cc:237] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:33.959089 24734 consensus_queue.cc:1048] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.962383 24770 consensus_queue.cc:1048] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.969645 24505 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 1.
I20260709 13:10:33.973909 24328 catalog_manager.cc:5697] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 1 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.028278 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
mode: GRACEFUL
new_leader_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:59942
I20260709 13:10:34.028766 24580 raft_consensus.cc:606] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Received request to transfer leadership to TS 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:34.048358 24430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
mode: GRACEFUL
new_leader_uuid: "1845252628e74814810cd0efea9c212b"
 from {username='slave'} at 127.0.0.1:36704
I20260709 13:10:34.048890 24430 raft_consensus.cc:606] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Received request to transfer leadership to TS 1845252628e74814810cd0efea9c212b
I20260709 13:10:34.050061 24705 consensus_queue.cc:1048] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.054107 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
mode: GRACEFUL
new_leader_uuid: "1845252628e74814810cd0efea9c212b"
 from {username='slave'} at 127.0.0.1:59942
I20260709 13:10:34.054643 24580 raft_consensus.cc:606] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Received request to transfer leadership to TS 1845252628e74814810cd0efea9c212b
I20260709 13:10:34.061925 24731 consensus_queue.cc:1048] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.067519 24504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f"
dest_uuid: "1845252628e74814810cd0efea9c212b"
mode: GRACEFUL
new_leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:10:34.068285 24504 raft_consensus.cc:606] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Received request to transfer leadership to TS 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:34.105491 24778 raft_consensus.cc:493] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.105908 24778 raft_consensus.cc:515] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.107760 24778 leader_election.cc:290] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:34.108423 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a7cf262acb434681ec7b74642b6ce3" is_pre_election: true
I20260709 13:10:34.108840 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" is_pre_election: true
I20260709 13:10:34.109303 24430 raft_consensus.cc:2393] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1845252628e74814810cd0efea9c212b in current term 1: Already voted for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in this term.
I20260709 13:10:34.110551 24470 leader_election.cc:304] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1845252628e74814810cd0efea9c212b; no voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3
I20260709 13:10:34.111239 24778 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.111855 24736 consensus_queue.cc:1048] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.117646 24778 raft_consensus.cc:2749] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.120132 24747 consensus_queue.cc:1048] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.123478 24731 consensus_queue.cc:1048] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.140098 24747 raft_consensus.cc:993] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: : Instructing follower 1845252628e74814810cd0efea9c212b to start an election
I20260709 13:10:34.140689 24747 raft_consensus.cc:1081] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Signalling peer 1845252628e74814810cd0efea9c212b to start an election
I20260709 13:10:34.145170 24505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa"
dest_uuid: "1845252628e74814810cd0efea9c212b"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:10:34.145881 24505 raft_consensus.cc:493] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.146375 24505 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.147372 24783 consensus_queue.cc:1048] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.156883 24505 raft_consensus.cc:515] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.159169 24505 leader_election.cc:290] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:34.159684 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:34.160128 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412ba0c7bfe347ca856981923c589daa" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:34.160262 24430 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.160712 24580 raft_consensus.cc:3055] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.161026 24580 raft_consensus.cc:740] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:34.161768 24580 consensus_queue.cc:260] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.162947 24580 raft_consensus.cc:3060] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.165585 24430 raft_consensus.cc:2468] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 2.
I20260709 13:10:34.166631 24470 leader_election.cc:304] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:34.167258 24778 raft_consensus.cc:2804] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.167788 24778 raft_consensus.cc:697] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 2 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:34.168512 24778 consensus_queue.cc:237] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.169631 24580 raft_consensus.cc:2468] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 2.
I20260709 13:10:34.175197 24326 catalog_manager.cc:5697] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 1 to 2, leader changed from 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131) to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 2 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.249392 24770 consensus_queue.cc:1048] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.259852 24671 consensus_queue.cc:1048] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.298317 24671 consensus_queue.cc:1048] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.310257 24671 consensus_queue.cc:1048] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.318156 24770 raft_consensus.cc:993] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: : Instructing follower 1845252628e74814810cd0efea9c212b to start an election
I20260709 13:10:34.318656 24671 raft_consensus.cc:1081] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Signalling peer 1845252628e74814810cd0efea9c212b to start an election
I20260709 13:10:34.320302 24505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9"
dest_uuid: "1845252628e74814810cd0efea9c212b"
 from {username='slave'} at 127.0.0.1:46590
I20260709 13:10:34.320861 24505 raft_consensus.cc:493] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.321147 24505 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.325505 24505 raft_consensus.cc:515] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.327054 24505 leader_election.cc:290] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:34.327848 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:34.328182 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7e3a40f5564a14b3afcab3d9143fc9" candidate_uuid: "1845252628e74814810cd0efea9c212b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:34.328495 24430 raft_consensus.cc:3055] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.328824 24430 raft_consensus.cc:740] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:34.328830 24580 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.329617 24430 consensus_queue.cc:260] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.330619 24430 raft_consensus.cc:3060] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.334988 24580 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 2.
I20260709 13:10:34.335284 24430 raft_consensus.cc:2468] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1845252628e74814810cd0efea9c212b in term 2.
I20260709 13:10:34.336143 24470 leader_election.cc:304] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:34.336831 24778 raft_consensus.cc:2804] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.337306 24778 raft_consensus.cc:697] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 2 LEADER]: Becoming Leader. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:34.338101 24778 consensus_queue.cc:237] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.344575 24328 catalog_manager.cc:5697] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b reported cstate change: term changed from 1 to 2, leader changed from 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129) to 1845252628e74814810cd0efea9c212b (127.14.34.130). New cstate: current_term: 2 leader_uuid: "1845252628e74814810cd0efea9c212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.415450 24783 consensus_queue.cc:1048] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.427079 24747 consensus_queue.cc:1048] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.434515 24625 raft_consensus.cc:993] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: : Instructing follower 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:34.435034 24747 raft_consensus.cc:1081] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Signalling peer 30a7cf262acb434681ec7b74642b6ce3 to start an election
I20260709 13:10:34.436820 24430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:10:34.437744 24430 raft_consensus.cc:493] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.438565 24430 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.443791 24430 raft_consensus.cc:515] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.445241 24430 leader_election.cc:290] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 1845252628e74814810cd0efea9c212b (127.14.34.130:41937), 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131:46487)
I20260709 13:10:34.446084 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:34.446367 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0309f2f93edb4794b8d5ba4584530529" candidate_uuid: "30a7cf262acb434681ec7b74642b6ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
I20260709 13:10:34.446684 24505 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.447017 24579 raft_consensus.cc:3055] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.447340 24579 raft_consensus.cc:740] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:34.448067 24579 consensus_queue.cc:260] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.449015 24579 raft_consensus.cc:3060] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.450999 24505 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:34.451982 24395 leader_election.cc:304] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:34.452564 24671 raft_consensus.cc:2804] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.453210 24671 raft_consensus.cc:697] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:34.454058 24671 consensus_queue.cc:237] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.455127 24579 raft_consensus.cc:2468] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a7cf262acb434681ec7b74642b6ce3 in term 2.
I20260709 13:10:34.456377 24778 consensus_queue.cc:1048] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.463749 24736 raft_consensus.cc:993] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: : Instructing follower 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:34.464205 24736 raft_consensus.cc:1081] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Signalling peer 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:34.464001 24326 catalog_manager.cc:5697] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 reported cstate change: term changed from 1 to 2, leader changed from 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131) to 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "30a7cf262acb434681ec7b74642b6ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.466595 24580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:59930
I20260709 13:10:34.467134 24580 raft_consensus.cc:493] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.467494 24580 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.474045 24705 consensus_queue.cc:1048] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.479839 24580 raft_consensus.cc:515] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.481514 24579 raft_consensus.cc:1240] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Rejecting Update request from peer 1845252628e74814810cd0efea9c212b for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.484748 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:34.485251 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3d6d03d784a45439ad047bd1ea64a3f" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:34.484222 24580 leader_election.cc:290] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:34.485409 24430 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.485827 24505 raft_consensus.cc:3055] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.486138 24505 raft_consensus.cc:740] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:34.486831 24505 consensus_queue.cc:260] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.487850 24505 raft_consensus.cc:3060] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.492110 24430 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:34.493227 24544 leader_election.cc:304] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:34.493999 24747 raft_consensus.cc:2804] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.494501 24747 raft_consensus.cc:697] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:34.495281 24747 consensus_queue.cc:237] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:34.495992 24505 raft_consensus.cc:2468] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:34.502907 24326 catalog_manager.cc:5697] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 1 to 2, leader changed from 1845252628e74814810cd0efea9c212b (127.14.34.130) to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.777232 24430 raft_consensus.cc:1275] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1845252628e74814810cd0efea9c212b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.778486 24705 consensus_queue.cc:1048] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.786723 24579 raft_consensus.cc:1275] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 1845252628e74814810cd0efea9c212b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.788133 24736 consensus_queue.cc:1048] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.891127 24430 raft_consensus.cc:1275] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1845252628e74814810cd0efea9c212b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.892423 24736 consensus_queue.cc:1048] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.900571 24580 raft_consensus.cc:1275] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 1845252628e74814810cd0efea9c212b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.902172 24731 consensus_queue.cc:1048] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.988862 24580 raft_consensus.cc:1275] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.989990 24770 consensus_queue.cc:1048] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.999436 24505 raft_consensus.cc:1275] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 30a7cf262acb434681ec7b74642b6ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.001996 24793 consensus_queue.cc:1048] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:35.056052 24430 raft_consensus.cc:1275] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.057462 24747 consensus_queue.cc:1048] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.070159 24505 raft_consensus.cc:1275] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.073778 24795 consensus_queue.cc:1048] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:37.074736 24329 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53242:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:37.099076 24329 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53242:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:37.123749 14474 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:10:37.243013 24815 log.cc:927] Time spent T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:10:37.302752 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:46487, user_credentials={real_user=slave}} blocked reactor thread for 59632.5us
W20260709 13:10:37.311714 24830 log.cc:927] Time spent T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:10:37.319916 24431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
mode: GRACEFUL
new_leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:37.321573 24431 raft_consensus.cc:606] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Received request to transfer leadership to TS 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:37.421378 24846 tablet.cc:1724] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:37.483075 24840 log.cc:927] Time spent T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:10:37.485450 24849 tablet.cc:1724] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.490736 24797 raft_consensus.cc:993] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: : Instructing follower 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.492596 24838 raft_consensus.cc:1081] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Signalling peer 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.496016 24848 tablet.cc:1724] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.497354 24579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:59940
I20260709 13:10:37.497037 24850 tablet.cc:1724] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.498155 24579 raft_consensus.cc:493] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.503306 24579 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.529134 24839 log.cc:927] Time spent T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Append to log took a long time: real 0.149s	user 0.008s	sys 0.011s
W20260709 13:10:37.534879 24843 log.cc:927] Time spent T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Append to log took a long time: real 0.161s	user 0.002s	sys 0.017s
W20260709 13:10:37.546890 24532 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:412ba0c7bfe347ca856981923c589daa)
W20260709 13:10:37.555307 24532 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:412ba0c7bfe347ca856981923c589daa)
W20260709 13:10:37.571115 24532 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:412ba0c7bfe347ca856981923c589daa)
I20260709 13:10:37.583184 24852 tablet.cc:1724] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.577565 24856 tablet.cc:1724] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.596858 24579 raft_consensus.cc:515] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.604920 24859 tablet.cc:1724] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.623538 24863 tablet.cc:1724] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.551623 24854 tablet.cc:1724] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.629860 24856 tablet.cc:1724] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.639756 24500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03"
dest_uuid: "1845252628e74814810cd0efea9c212b"
mode: GRACEFUL
new_leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:38702
I20260709 13:10:37.640515 24500 raft_consensus.cc:606] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Received request to transfer leadership to TS 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:37.642155 14474 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:37.644069 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.654835 24500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dfc45276634f7da647c713a44f89be"
dest_uuid: "1845252628e74814810cd0efea9c212b"
mode: GRACEFUL
new_leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:38702
I20260709 13:10:37.655668 24500 raft_consensus.cc:606] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Received request to transfer leadership to TS 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:37.658562 24856 tablet.cc:1724] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.659310 24427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62130d409989487e9685c4d2cc951be5"
dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
mode: GRACEFUL
new_leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:36720
I20260709 13:10:37.662145 24427 raft_consensus.cc:606] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Received request to transfer leadership to TS 1e8dd4f5e94d4bae9d1046029ef8ca36
I20260709 13:10:37.660828 24855 tablet.cc:1724] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.672130 24848 tablet.cc:1724] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.681663 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:37.682569 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:37.687629 24579 leader_election.cc:290] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:37.688687 24861 tablet.cc:1724] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.690351 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:37.691425 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c80a7a0be1f4011b647d69300a1c0f2" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:37.691676 24427 raft_consensus.cc:3055] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.692080 24506 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.692131 24427 raft_consensus.cc:740] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:37.693336 24427 consensus_queue.cc:260] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.690207 24865 tablet.cc:1724] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.689131 24849 tablet.cc:1724] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.706836 24854 tablet.cc:1724] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.708801 24427 raft_consensus.cc:3060] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.710850 24863 tablet.cc:1724] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.710567 24855 tablet.cc:1724] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.704162 24850 tablet.cc:1724] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.723709 24846 tablet.cc:1724] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.740360 24852 tablet.cc:1724] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.728866 24427 raft_consensus.cc:2468] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:37.730194 24859 tablet.cc:1724] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.742081 24506 raft_consensus.cc:2468] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:37.758987 24544 leader_election.cc:304] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:37.761543 24835 raft_consensus.cc:2804] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.762059 24835 raft_consensus.cc:697] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:37.763073 24835 consensus_queue.cc:237] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.779592 24326 catalog_manager.cc:5697] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 1 to 2, leader changed from 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129) to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.779345 24863 tablet.cc:1724] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.783038 24837 raft_consensus.cc:993] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: : Instructing follower 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.783716 24827 raft_consensus.cc:1081] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Signalling peer 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.765708 24848 tablet.cc:1724] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.788091 24574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11dfc45276634f7da647c713a44f89be"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:59930
I20260709 13:10:37.788757 24574 raft_consensus.cc:493] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.789162 24574 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.810654 24852 tablet.cc:1724] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.823908 24861 tablet.cc:1724] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.829125 24574 raft_consensus.cc:515] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.843710 24574 leader_election.cc:290] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:37.844462 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:37.846328 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dfc45276634f7da647c713a44f89be" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:37.850521 24427 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.850528 24506 raft_consensus.cc:3055] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.851172 24506 raft_consensus.cc:740] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:37.852140 24506 consensus_queue.cc:260] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.853739 24506 raft_consensus.cc:3060] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.859830 24427 raft_consensus.cc:2468] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:37.861260 24544 leader_election.cc:304] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:37.861728 24506 raft_consensus.cc:2468] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:37.863122 24823 raft_consensus.cc:2804] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.863698 24823 raft_consensus.cc:697] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:37.864710 24823 consensus_queue.cc:237] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.862011 24328 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: soft_deleted_table [id=93d25003461d4ee1a60896f4c1760a1b] alter complete (version 1)
I20260709 13:10:37.885442 24329 catalog_manager.cc:5697] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 1 to 2, leader changed from 1845252628e74814810cd0efea9c212b (127.14.34.130) to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.928009 24838 raft_consensus.cc:993] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: : Instructing follower 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.928666 24797 raft_consensus.cc:1081] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Signalling peer 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:37.930493 24574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62130d409989487e9685c4d2cc951be5"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:59940
I20260709 13:10:37.931141 24574 raft_consensus.cc:493] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.931566 24574 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.937114 24574 raft_consensus.cc:515] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.939070 24574 leader_election.cc:290] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 3 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:37.939993 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:37.940403 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130d409989487e9685c4d2cc951be5" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:37.940783 24427 raft_consensus.cc:3055] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:37.941118 24506 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.941180 24427 raft_consensus.cc:740] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 30a7cf262acb434681ec7b74642b6ce3, State: Running, Role: LEADER
I20260709 13:10:37.942330 24427 consensus_queue.cc:260] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.943946 24427 raft_consensus.cc:3060] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.949644 24506 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 3.
I20260709 13:10:37.951110 24544 leader_election.cc:304] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1845252628e74814810cd0efea9c212b, 1e8dd4f5e94d4bae9d1046029ef8ca36; no voters: 
I20260709 13:10:37.951927 24823 raft_consensus.cc:2804] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:37.952003 24427 raft_consensus.cc:2468] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 3.
I20260709 13:10:37.952564 24823 raft_consensus.cc:697] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 3 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:37.953613 24823 consensus_queue.cc:237] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:37.965400 24329 catalog_manager.cc:5697] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 2 to 3, leader changed from 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129) to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 3 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.012383 24731 raft_consensus.cc:993] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: : Instructing follower 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:38.012949 24731 raft_consensus.cc:1081] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Signalling peer 1e8dd4f5e94d4bae9d1046029ef8ca36 to start an election
I20260709 13:10:38.014734 24574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03"
dest_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36"
 from {username='slave'} at 127.0.0.1:59930
I20260709 13:10:38.015341 24574 raft_consensus.cc:493] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.015755 24574 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.024024 24574 raft_consensus.cc:515] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:38.026425 24574 leader_election.cc:290] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Requested vote from peers 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149), 1845252628e74814810cd0efea9c212b (127.14.34.130:41937)
I20260709 13:10:38.027539 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "30a7cf262acb434681ec7b74642b6ce3"
I20260709 13:10:38.027477 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27fcf0c76a149eabb21ffcd56b82f03" candidate_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1845252628e74814810cd0efea9c212b"
I20260709 13:10:38.028373 24427 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.028447 24506 raft_consensus.cc:3055] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.028870 24506 raft_consensus.cc:740] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1845252628e74814810cd0efea9c212b, State: Running, Role: LEADER
I20260709 13:10:38.029700 24506 consensus_queue.cc:260] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:38.031016 24506 raft_consensus.cc:3060] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.035769 24427 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:38.037230 24544 leader_election.cc:304] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8dd4f5e94d4bae9d1046029ef8ca36, 30a7cf262acb434681ec7b74642b6ce3; no voters: 
I20260709 13:10:38.038089 24823 raft_consensus.cc:2804] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.038148 24506 raft_consensus.cc:2468] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8dd4f5e94d4bae9d1046029ef8ca36 in term 2.
I20260709 13:10:38.038700 24823 raft_consensus.cc:697] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Becoming Leader. State: Replica: 1e8dd4f5e94d4bae9d1046029ef8ca36, State: Running, Role: LEADER
I20260709 13:10:38.039921 24823 consensus_queue.cc:237] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } }
I20260709 13:10:38.048225 24329 catalog_manager.cc:5697] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 reported cstate change: term changed from 1 to 2, leader changed from 1845252628e74814810cd0efea9c212b (127.14.34.130) to 1e8dd4f5e94d4bae9d1046029ef8ca36 (127.14.34.131). New cstate: current_term: 2 leader_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8dd4f5e94d4bae9d1046029ef8ca36" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.201980 24427 raft_consensus.cc:1275] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:38.203586 24823 consensus_queue.cc:1048] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:38.216444 24505 raft_consensus.cc:1275] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:38.217932 24823 consensus_queue.cc:1048] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:38.258702 24505 raft_consensus.cc:1275] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.259867 24823 consensus_queue.cc:1048] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.270218 24427 raft_consensus.cc:1275] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.271819 24874 consensus_queue.cc:1048] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.447747 24505 raft_consensus.cc:1275] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 3 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.448949 24874 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.457744 24427 raft_consensus.cc:1275] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 3 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.460080 24823 consensus_queue.cc:1048] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.469064 24427 raft_consensus.cc:1275] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:38.470377 24823 consensus_queue.cc:1048] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a7cf262acb434681ec7b74642b6ce3" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.480628 24505 raft_consensus.cc:1275] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Refusing update from remote peer 1e8dd4f5e94d4bae9d1046029ef8ca36: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:38.482219 24823 consensus_queue.cc:1048] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1845252628e74814810cd0efea9c212b" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.740598 14474 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:38.747041 14474 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:38.747466 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:38.753293 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:38.753839 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:39.782799 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
W20260709 13:10:39.798820 24544 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:10:39.804117 24544 consensus_peers.cc:597] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.805794 24544 consensus_peers.cc:597] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.819075 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:39.819984 14474 tablet_replica.cc:333] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.820752 14474 raft_consensus.cc:2243] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.821280 14474 raft_consensus.cc:2272] T ab7e3a40f5564a14b3afcab3d9143fc9 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.823549 14474 tablet_replica.cc:333] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.824199 14474 raft_consensus.cc:2243] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.824625 14474 raft_consensus.cc:2272] T f27fcf0c76a149eabb21ffcd56b82f03 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.826632 14474 tablet_replica.cc:333] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.827185 14474 raft_consensus.cc:2243] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.827648 14474 raft_consensus.cc:2272] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.829592 14474 tablet_replica.cc:333] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.830277 14474 raft_consensus.cc:2243] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.830719 14474 raft_consensus.cc:2272] T 4dbd9c7e3a3f4648bfac2201b540949c P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.832960 14474 tablet_replica.cc:333] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.833542 14474 raft_consensus.cc:2243] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.834439 14474 raft_consensus.cc:2272] T ad38aee9012a4b218c1fcdfe70f0f861 P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.836556 14474 tablet_replica.cc:333] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.837214 14474 raft_consensus.cc:2243] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.837713 14474 raft_consensus.cc:2272] T 757b8f341fe3466dbb82b3447d7b213b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.839990 14474 tablet_replica.cc:333] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.840788 14474 raft_consensus.cc:2243] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.841249 14474 raft_consensus.cc:2272] T 3c80a7a0be1f4011b647d69300a1c0f2 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.844813 14474 tablet_replica.cc:333] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.845609 14474 raft_consensus.cc:2243] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.846650 14474 raft_consensus.cc:2272] T 0309f2f93edb4794b8d5ba4584530529 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.849020 14474 tablet_replica.cc:333] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.849706 14474 raft_consensus.cc:2243] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.850319 14474 raft_consensus.cc:2272] T 12181c3648e746a3997f4fd763845f4d P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.852871 14474 tablet_replica.cc:333] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.853533 14474 raft_consensus.cc:2243] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.854751 14474 raft_consensus.cc:2272] T af51e57ee6cf4b04bded4c1b9da501cb P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.858183 14474 tablet_replica.cc:333] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.858876 14474 raft_consensus.cc:2243] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.859411 14474 raft_consensus.cc:2272] T 11dfc45276634f7da647c713a44f89be P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.861871 14474 tablet_replica.cc:333] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.862573 14474 raft_consensus.cc:2243] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.863055 14474 raft_consensus.cc:2272] T 62130d409989487e9685c4d2cc951be5 P 30a7cf262acb434681ec7b74642b6ce3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.865447 14474 tablet_replica.cc:333] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.866096 14474 raft_consensus.cc:2243] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.866991 14474 raft_consensus.cc:2272] T 3a26789d5ded43b58874fafb8796400e P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.869501 14474 tablet_replica.cc:333] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.870136 14474 raft_consensus.cc:2243] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.870638 14474 raft_consensus.cc:2272] T 412ba0c7bfe347ca856981923c589daa P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.873185 14474 tablet_replica.cc:333] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.873849 14474 raft_consensus.cc:2243] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.874387 14474 raft_consensus.cc:2272] T c3d6d03d784a45439ad047bd1ea64a3f P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.876626 14474 tablet_replica.cc:333] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.877218 14474 raft_consensus.cc:2243] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.878136 14474 raft_consensus.cc:2272] T 0ca9fd63bd964a948a1541c9e9fe9568 P 30a7cf262acb434681ec7b74642b6ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.880446 14474 tablet_replica.cc:333] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.880975 14474 raft_consensus.cc:2243] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.881896 14474 raft_consensus.cc:2272] T 0fd2f7e2eb714196a57d71af89e7c57f P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.884903 14474 tablet_replica.cc:333] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3: stopping tablet replica
I20260709 13:10:39.885630 14474 raft_consensus.cc:2243] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.886269 14474 raft_consensus.cc:2272] T cf4017f4caa64f31b02b893e8e08b01b P 30a7cf262acb434681ec7b74642b6ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.887183 24544 consensus_peers.cc:597] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.932122 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
I20260709 13:10:39.968006 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
W20260709 13:10:40.000443 24470 consensus_peers.cc:597] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:40.004210 24470 consensus_peers.cc:597] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.008565 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:40.009388 14474 tablet_replica.cc:333] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.010180 14474 raft_consensus.cc:2243] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.011140 14474 raft_consensus.cc:2272] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.013253 14474 tablet_replica.cc:333] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.013819 14474 raft_consensus.cc:2243] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.014287 14474 raft_consensus.cc:2272] T f27fcf0c76a149eabb21ffcd56b82f03 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.016233 14474 tablet_replica.cc:333] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.016827 14474 raft_consensus.cc:2243] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.017295 14474 raft_consensus.cc:2272] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.019348 14474 tablet_replica.cc:333] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.020052 14474 raft_consensus.cc:2243] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.020524 14474 raft_consensus.cc:2272] T 757b8f341fe3466dbb82b3447d7b213b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.022622 14474 tablet_replica.cc:333] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.023165 14474 raft_consensus.cc:2243] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.023617 14474 raft_consensus.cc:2272] T 0309f2f93edb4794b8d5ba4584530529 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.025558 14474 tablet_replica.cc:333] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.026158 14474 raft_consensus.cc:2243] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.027006 14474 raft_consensus.cc:2272] T 12181c3648e746a3997f4fd763845f4d P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.029192 14474 tablet_replica.cc:333] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.029745 14474 raft_consensus.cc:2243] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.030212 14474 raft_consensus.cc:2272] T 11dfc45276634f7da647c713a44f89be P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.032232 14474 tablet_replica.cc:333] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.032773 14474 raft_consensus.cc:2243] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.033241 14474 raft_consensus.cc:2272] T af51e57ee6cf4b04bded4c1b9da501cb P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.035306 14474 tablet_replica.cc:333] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.035861 14474 raft_consensus.cc:2243] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.036293 14474 raft_consensus.cc:2272] T ad38aee9012a4b218c1fcdfe70f0f861 P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.038728 14474 tablet_replica.cc:333] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.039355 14474 raft_consensus.cc:2243] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.040208 14474 raft_consensus.cc:2272] T 4dbd9c7e3a3f4648bfac2201b540949c P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.042387 14474 tablet_replica.cc:333] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.042948 14474 raft_consensus.cc:2243] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.043851 14474 raft_consensus.cc:2272] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.046561 14474 tablet_replica.cc:333] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.047338 14474 raft_consensus.cc:2243] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.048272 14474 raft_consensus.cc:2272] T 412ba0c7bfe347ca856981923c589daa P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.050172 14474 tablet_replica.cc:333] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.050678 14474 raft_consensus.cc:2243] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.051131 14474 raft_consensus.cc:2272] T c3d6d03d784a45439ad047bd1ea64a3f P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.053004 14474 tablet_replica.cc:333] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.053550 14474 raft_consensus.cc:2243] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.053965 14474 raft_consensus.cc:2272] T 3a26789d5ded43b58874fafb8796400e P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.055797 14474 tablet_replica.cc:333] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.056295 14474 raft_consensus.cc:2243] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.056797 14474 raft_consensus.cc:2272] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1845252628e74814810cd0efea9c212b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.058797 14474 tablet_replica.cc:333] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.059283 14474 raft_consensus.cc:2243] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.059705 14474 raft_consensus.cc:2272] T 0fd2f7e2eb714196a57d71af89e7c57f P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.061689 14474 tablet_replica.cc:333] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.062270 14474 raft_consensus.cc:2243] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.062979 14474 raft_consensus.cc:2272] T 62130d409989487e9685c4d2cc951be5 P 1845252628e74814810cd0efea9c212b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.065891 14474 tablet_replica.cc:333] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b: stopping tablet replica
I20260709 13:10:40.066586 14474 raft_consensus.cc:2243] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:40.066854 24544 consensus_peers.cc:597] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Couldn't send request to peer 1845252628e74814810cd0efea9c212b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.067588 14474 raft_consensus.cc:2272] T cf4017f4caa64f31b02b893e8e08b01b P 1845252628e74814810cd0efea9c212b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.109091 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
W20260709 13:10:40.112989 24544 consensus_peers.cc:597] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:40.129647 24544 consensus_peers.cc:597] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Couldn't send request to peer 1845252628e74814810cd0efea9c212b. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:41937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:40.136719 24544 consensus_peers.cc:597] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:40.146957 24544 consensus_peers.cc:597] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 30a7cf262acb434681ec7b74642b6ce3 (127.14.34.129:37149): Couldn't send request to peer 30a7cf262acb434681ec7b74642b6ce3. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.148674 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
I20260709 13:10:40.176656 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:40.177361 14474 tablet_replica.cc:333] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.177973 14474 raft_consensus.cc:2243] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.178499 14474 raft_consensus.cc:2272] T ab7e3a40f5564a14b3afcab3d9143fc9 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.180472 14474 tablet_replica.cc:333] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.181121 14474 raft_consensus.cc:2243] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.181911 14474 raft_consensus.cc:2272] T f27fcf0c76a149eabb21ffcd56b82f03 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.184312 14474 tablet_replica.cc:333] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.185079 14474 raft_consensus.cc:2243] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.185629 14474 raft_consensus.cc:2272] T eb4a00fdd7984efbbf93d5d3bf0d86bf P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:40.185707 24544 consensus_peers.cc:597] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 -> Peer 1845252628e74814810cd0efea9c212b (127.14.34.130:41937): Couldn't send request to peer 1845252628e74814810cd0efea9c212b. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:41937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.187695 14474 tablet_replica.cc:333] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.188366 14474 raft_consensus.cc:2243] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.188822 14474 raft_consensus.cc:2272] T 3a26789d5ded43b58874fafb8796400e P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.190927 14474 tablet_replica.cc:333] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.191493 14474 raft_consensus.cc:2243] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.192225 14474 raft_consensus.cc:2272] T c3d6d03d784a45439ad047bd1ea64a3f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.194221 14474 tablet_replica.cc:333] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.194788 14474 raft_consensus.cc:2243] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.195237 14474 raft_consensus.cc:2272] T 412ba0c7bfe347ca856981923c589daa P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.197191 14474 tablet_replica.cc:333] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.197741 14474 raft_consensus.cc:2243] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.198189 14474 raft_consensus.cc:2272] T 0fd2f7e2eb714196a57d71af89e7c57f P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.200165 14474 tablet_replica.cc:333] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.200739 14474 raft_consensus.cc:2243] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.201176 14474 raft_consensus.cc:2272] T 0ca9fd63bd964a948a1541c9e9fe9568 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.203274 14474 tablet_replica.cc:333] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.203810 14474 raft_consensus.cc:2243] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.204583 14474 raft_consensus.cc:2272] T 3c80a7a0be1f4011b647d69300a1c0f2 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.206597 14474 tablet_replica.cc:333] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.207125 14474 raft_consensus.cc:2243] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.207952 14474 raft_consensus.cc:2272] T 757b8f341fe3466dbb82b3447d7b213b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.210150 14474 tablet_replica.cc:333] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.210671 14474 raft_consensus.cc:2243] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.211088 14474 raft_consensus.cc:2272] T ad38aee9012a4b218c1fcdfe70f0f861 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.213006 14474 tablet_replica.cc:333] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.213546 14474 raft_consensus.cc:2243] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.213979 14474 raft_consensus.cc:2272] T 4dbd9c7e3a3f4648bfac2201b540949c P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.215900 14474 tablet_replica.cc:333] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.216403 14474 raft_consensus.cc:2243] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.217144 14474 raft_consensus.cc:2272] T 11dfc45276634f7da647c713a44f89be P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.219095 14474 tablet_replica.cc:333] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.219650 14474 raft_consensus.cc:2243] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.220106 14474 raft_consensus.cc:2272] T af51e57ee6cf4b04bded4c1b9da501cb P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.222247 14474 tablet_replica.cc:333] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.222755 14474 raft_consensus.cc:2243] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.223204 14474 raft_consensus.cc:2272] T 0309f2f93edb4794b8d5ba4584530529 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.225097 14474 tablet_replica.cc:333] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.225603 14474 raft_consensus.cc:2243] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.226045 14474 raft_consensus.cc:2272] T 12181c3648e746a3997f4fd763845f4d P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.227901 14474 tablet_replica.cc:333] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.228382 14474 raft_consensus.cc:2243] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.228777 14474 raft_consensus.cc:2272] T cf4017f4caa64f31b02b893e8e08b01b P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.230782 14474 tablet_replica.cc:333] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36: stopping tablet replica
I20260709 13:10:40.231343 14474 raft_consensus.cc:2243] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.232088 14474 raft_consensus.cc:2272] T 62130d409989487e9685c4d2cc951be5 P 1e8dd4f5e94d4bae9d1046029ef8ca36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.270275 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:10:40.304682 14474 master.cc:562] Master@127.14.34.190:38649 shutting down...
I20260709 13:10:40.333308 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:40.333881 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.334234 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 157615595d2149cb9ca43e2a34744f7f: stopping tablet replica
I20260709 13:10:40.354925 14474 master.cc:584] Master@127.14.34.190:38649 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12492 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:40.405586 14474 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.34.190:38091
I20260709 13:10:40.406865 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:40.412875 24888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.412945 24887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.413661 24890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:40.414391 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:40.415355 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:40.415570 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:40.415723 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602640415710 us; error 0 us; skew 500 ppm
I20260709 13:10:40.416282 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:40.418753 14474 webserver.cc:533] Webserver started at http://127.14.34.190:44515/ using document root <none> and password file <none>
I20260709 13:10:40.419245 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:40.419426 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:40.419709 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:40.420902 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/master-0-root/instance:
uuid: "24cd97c3c9ab48bdbdcec20982eef42b"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.425732 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:40.429113 24895 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.429881 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:40.430238 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/master-0-root
uuid: "24cd97c3c9ab48bdbdcec20982eef42b"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.430483 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:40.446406 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:40.447640 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:40.485888 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.190:38091
I20260709 13:10:40.486050 24946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.190:38091 every 8 connection(s)
I20260709 13:10:40.489830 24947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:40.500337 24947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: Bootstrap starting.
I20260709 13:10:40.505116 24947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:40.509362 24947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: No bootstrap required, opened a new log
I20260709 13:10:40.511468 24947 raft_consensus.cc:359] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER }
I20260709 13:10:40.511835 24947 raft_consensus.cc:385] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:40.512003 24947 raft_consensus.cc:740] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cd97c3c9ab48bdbdcec20982eef42b, State: Initialized, Role: FOLLOWER
I20260709 13:10:40.512503 24947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER }
I20260709 13:10:40.512887 24947 raft_consensus.cc:399] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:40.513072 24947 raft_consensus.cc:493] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:40.513273 24947 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:40.517854 24947 raft_consensus.cc:515] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER }
I20260709 13:10:40.518343 24947 leader_election.cc:304] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24cd97c3c9ab48bdbdcec20982eef42b; no voters: 
I20260709 13:10:40.519533 24947 leader_election.cc:290] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:40.519961 24950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:40.521508 24950 raft_consensus.cc:697] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 1 LEADER]: Becoming Leader. State: Replica: 24cd97c3c9ab48bdbdcec20982eef42b, State: Running, Role: LEADER
I20260709 13:10:40.522248 24950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER }
I20260709 13:10:40.522495 24947 sys_catalog.cc:565] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:40.526628 24951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER } }
I20260709 13:10:40.526791 24952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24cd97c3c9ab48bdbdcec20982eef42b. Latest consensus state: current_term: 1 leader_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24cd97c3c9ab48bdbdcec20982eef42b" member_type: VOTER } }
I20260709 13:10:40.527377 24951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:40.527611 24952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:40.530722 24957 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:40.535876 24957 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:40.539366 14474 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:40.544754 24957 catalog_manager.cc:1383] Generated new cluster ID: bcfda2ee31da496caaa2785fc8eeae94
I20260709 13:10:40.545032 24957 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:40.577303 24957 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:40.578676 24957 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:40.591847 24957 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: Generated new TSK 0
I20260709 13:10:40.592439 24957 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:40.606004 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:40.612185 24968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.613037 24969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.614907 24971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:40.615585 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:40.616475 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:40.616652 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:40.616843 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602640616828 us; error 0 us; skew 500 ppm
I20260709 13:10:40.617414 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:40.619802 14474 webserver.cc:533] Webserver started at http://127.14.34.129:41891/ using document root <none> and password file <none>
I20260709 13:10:40.620298 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:40.620458 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:40.620769 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:40.621986 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-0-root/instance:
uuid: "8f47172118f542bf83a5575fa1547171"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.626778 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:40.630019 24976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.630967 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:40.631274 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-0-root
uuid: "8f47172118f542bf83a5575fa1547171"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.631562 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:40.641184 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:40.642505 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:40.643951 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:40.646253 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:40.646471 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.646715 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:40.646894 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.686781 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.129:33263
I20260709 13:10:40.686905 25038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.129:33263 every 8 connection(s)
I20260709 13:10:40.691814 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:40.698948 25043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.700918 25044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.702838 25046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:40.703768 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:40.705353 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:40.705595 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:40.705773 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602640705752 us; error 0 us; skew 500 ppm
I20260709 13:10:40.706305 25039 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38091
I20260709 13:10:40.706418 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:40.706842 25039 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:40.707839 25039 heartbeater.cc:507] Master 127.14.34.190:38091 requested a full tablet report, sending...
I20260709 13:10:40.709535 14474 webserver.cc:533] Webserver started at http://127.14.34.130:46843/ using document root <none> and password file <none>
I20260709 13:10:40.710166 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:40.710378 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:40.710644 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:40.710685 24912 ts_manager.cc:194] Registered new tserver with Master: 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263)
I20260709 13:10:40.711948 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-1-root/instance:
uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.712852 24912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54102
I20260709 13:10:40.717285 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:40.720854 25051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.721868 14474 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:40.722220 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-1-root
uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.722554 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:40.745198 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:40.746716 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:40.748324 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:40.750773 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:40.751052 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.751339 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:40.751545 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.794299 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.130:45973
I20260709 13:10:40.794360 25113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.130:45973 every 8 connection(s)
I20260709 13:10:40.800365 14474 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:40.808380 25117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.810197 25118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:40.814888 25120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:40.815501 14474 server_base.cc:1061] running on GCE node
I20260709 13:10:40.815588 25114 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38091
I20260709 13:10:40.816084 25114 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:40.816533 14474 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:40.816838 14474 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:40.816845 25114 heartbeater.cc:507] Master 127.14.34.190:38091 requested a full tablet report, sending...
I20260709 13:10:40.817045 14474 hybrid_clock.cc:648] HybridClock initialized: now 1783602640817030 us; error 0 us; skew 500 ppm
I20260709 13:10:40.817809 14474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:40.819406 24912 ts_manager.cc:194] Registered new tserver with Master: 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:40.820595 14474 webserver.cc:533] Webserver started at http://127.14.34.131:35399/ using document root <none> and password file <none>
I20260709 13:10:40.821323 14474 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:40.821312 24912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54104
I20260709 13:10:40.821866 14474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:40.822243 14474 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:40.823689 14474 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-2-root/instance:
uuid: "a08b80f5b49d4083b4529b043fa8985e"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.828379 14474 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:40.832631 25125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.833756 14474 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:40.834184 14474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-2-root
uuid: "a08b80f5b49d4083b4529b043fa8985e"
format_stamp: "Formatted at 2026-07-09 13:10:40 on dist-test-slave-nr1f"
I20260709 13:10:40.834538 14474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskS_B_Ka/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326151634-14474-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:40.850929 14474 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:40.852247 14474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:40.853809 14474 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:40.856248 14474 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:40.856498 14474 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.856784 14474 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:40.856984 14474 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:40.898777 14474 rpc_server.cc:307] RPC server started. Bound to: 127.14.34.131:39779
I20260709 13:10:40.898866 25187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.34.131:39779 every 8 connection(s)
I20260709 13:10:40.912735 25188 heartbeater.cc:344] Connected to a master server at 127.14.34.190:38091
I20260709 13:10:40.913188 25188 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:40.913913 25188 heartbeater.cc:507] Master 127.14.34.190:38091 requested a full tablet report, sending...
I20260709 13:10:40.916117 24912 ts_manager.cc:194] Registered new tserver with Master: a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:40.917233 14474 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015068946s
I20260709 13:10:40.918151 24912 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54110
I20260709 13:10:40.945468 24912 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:40.948145 24912 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:41.028405 25004 tablet_service.cc:1511] Processing CreateTablet for tablet 7b747e1e81b54ad4838e20dc02df6a5b (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.029898 25004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b747e1e81b54ad4838e20dc02df6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.037379 25079 tablet_service.cc:1511] Processing CreateTablet for tablet 7b747e1e81b54ad4838e20dc02df6a5b (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.037969 25001 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c3ab62834572af2d935593315ac6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.038897 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b747e1e81b54ad4838e20dc02df6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.039417 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c3ab62834572af2d935593315ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.032524 25002 tablet_service.cc:1511] Processing CreateTablet for tablet 9decb21034a04f3e94e2153fd82c2fa6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.034559 25003 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb59340244844dabecbf6fb19299767 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.042502 25002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9decb21034a04f3e94e2153fd82c2fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.043012 25151 tablet_service.cc:1511] Processing CreateTablet for tablet 9decb21034a04f3e94e2153fd82c2fa6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.043229 25077 tablet_service.cc:1511] Processing CreateTablet for tablet 9decb21034a04f3e94e2153fd82c2fa6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.044432 25151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9decb21034a04f3e94e2153fd82c2fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.045430 25078 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb59340244844dabecbf6fb19299767 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.039666 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 7b747e1e81b54ad4838e20dc02df6a5b (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.047415 25152 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb59340244844dabecbf6fb19299767 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.044432 25077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9decb21034a04f3e94e2153fd82c2fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.047859 25003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb59340244844dabecbf6fb19299767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.048300 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b747e1e81b54ad4838e20dc02df6a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.048949 25152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb59340244844dabecbf6fb19299767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.049044 25078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb59340244844dabecbf6fb19299767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.071837 25076 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c3ab62834572af2d935593315ac6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.073304 25076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c3ab62834572af2d935593315ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.089612 25075 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4d20ab96214b1a8afd61d913954b70 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.090523 25000 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4d20ab96214b1a8afd61d913954b70 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.092367 25000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4d20ab96214b1a8afd61d913954b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.091187 25075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4d20ab96214b1a8afd61d913954b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.096308 25150 tablet_service.cc:1511] Processing CreateTablet for tablet 96f8c3ab62834572af2d935593315ac6 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.103084 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f8c3ab62834572af2d935593315ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.114939 25149 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4d20ab96214b1a8afd61d913954b70 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.116933 25149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4d20ab96214b1a8afd61d913954b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.140919 25002 tablet_service.cc:1511] Processing CreateTablet for tablet 794ae7c2cdc5463282c97fa88b22f5cb (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.133770 25203 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:41.148257 25204 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:41.147410 25002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794ae7c2cdc5463282c97fa88b22f5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.150259 25079 tablet_service.cc:1511] Processing CreateTablet for tablet 794ae7c2cdc5463282c97fa88b22f5cb (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.151649 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794ae7c2cdc5463282c97fa88b22f5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.158368 25205 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:41.161619 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 794ae7c2cdc5463282c97fa88b22f5cb (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.163442 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794ae7c2cdc5463282c97fa88b22f5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.164340 25204 tablet_bootstrap.cc:654] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.162377 25203 tablet_bootstrap.cc:654] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.180179 25205 tablet_bootstrap.cc:654] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.185688 25002 tablet_service.cc:1511] Processing CreateTablet for tablet 43707942b72e4d55a0ae863162f902c4 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.187702 25002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43707942b72e4d55a0ae863162f902c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.189002 25203 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:41.189604 25203 ts_tablet_manager.cc:1403] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 13:10:41.190610 25205 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:41.191133 25205 ts_tablet_manager.cc:1403] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.004s
I20260709 13:10:41.192884 25203 raft_consensus.cc:359] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.193840 25203 raft_consensus.cc:385] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.194249 25203 raft_consensus.cc:740] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.193948 25075 tablet_service.cc:1511] Processing CreateTablet for tablet 43707942b72e4d55a0ae863162f902c4 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.195320 25075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43707942b72e4d55a0ae863162f902c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.196560 25150 tablet_service.cc:1511] Processing CreateTablet for tablet 43707942b72e4d55a0ae863162f902c4 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.197834 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43707942b72e4d55a0ae863162f902c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.204239 25205 raft_consensus.cc:359] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.205068 25205 raft_consensus.cc:385] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.205307 25203 consensus_queue.cc:260] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.205413 25205 raft_consensus.cc:740] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.211323 25205 consensus_queue.cc:260] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.213964 25003 tablet_service.cc:1511] Processing CreateTablet for tablet b9e29d50d81f4fac80042e87009c1116 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.215550 25003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e29d50d81f4fac80042e87009c1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.215622 25204 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:41.216209 25204 ts_tablet_manager.cc:1403] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.036s
I20260709 13:10:41.216930 25076 tablet_service.cc:1511] Processing CreateTablet for tablet b9e29d50d81f4fac80042e87009c1116 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.218286 25076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e29d50d81f4fac80042e87009c1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.219336 25204 raft_consensus.cc:359] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.220091 25204 raft_consensus.cc:385] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.220414 25204 raft_consensus.cc:740] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.221369 25204 consensus_queue.cc:260] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.223637 25188 heartbeater.cc:499] Master 127.14.34.190:38091 was elected leader, sending a full tablet report...
I20260709 13:10:41.223616 25210 raft_consensus.cc:493] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.242834 25039 heartbeater.cc:499] Master 127.14.34.190:38091 was elected leader, sending a full tablet report...
I20260709 13:10:41.247264 25213 raft_consensus.cc:493] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.247926 25213 raft_consensus.cc:515] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.256541 25213 leader_election.cc:290] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:41.258960 25114 heartbeater.cc:499] Master 127.14.34.190:38091 was elected leader, sending a full tablet report...
I20260709 13:10:41.259419 25205 ts_tablet_manager.cc:1434] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.011s
I20260709 13:10:41.266254 25205 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:41.271029 25150 tablet_service.cc:1511] Processing CreateTablet for tablet b9e29d50d81f4fac80042e87009c1116 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.272419 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e29d50d81f4fac80042e87009c1116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.233249 25210 raft_consensus.cc:515] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
W20260709 13:10:41.299507 25115 tablet.cc:2406] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:41.302357 25001 tablet_service.cc:1511] Processing CreateTablet for tablet af5e9e607a84402c9520ad801bef3647 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.303789 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e9e607a84402c9520ad801bef3647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.304056 25075 tablet_service.cc:1511] Processing CreateTablet for tablet af5e9e607a84402c9520ad801bef3647 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.305382 25075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e9e607a84402c9520ad801bef3647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.307142 25204 ts_tablet_manager.cc:1434] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.091s	user 0.016s	sys 0.002s
I20260709 13:10:41.308300 25204 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:41.310074 25205 tablet_bootstrap.cc:654] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.311412 25153 tablet_service.cc:1511] Processing CreateTablet for tablet af5e9e607a84402c9520ad801bef3647 (DEFAULT_TABLE table=test-workload [id=4ed8584aa0314824bbe857831bf55af3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.320627 25211 raft_consensus.cc:493] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.321298 25211 raft_consensus.cc:515] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.323611 25203 ts_tablet_manager.cc:1434] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.133s	user 0.046s	sys 0.043s
I20260709 13:10:41.326920 25211 leader_election.cc:290] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:41.338244 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5e9e607a84402c9520ad801bef3647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.344631 25203 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:41.352243 25210 leader_election.cc:290] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:41.354745 25203 tablet_bootstrap.cc:654] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.362273 25204 tablet_bootstrap.cc:654] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.397895 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:41.402361 25205 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:41.404086 25205 ts_tablet_manager.cc:1403] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.026s
I20260709 13:10:41.409117 25205 raft_consensus.cc:359] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.411547 25205 raft_consensus.cc:385] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.411975 25205 raft_consensus.cc:740] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.412997 25205 consensus_queue.cc:260] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.416311 25205 ts_tablet_manager.cc:1434] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:41.417655 25205 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:41.426271 25211 raft_consensus.cc:493] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.426924 25211 raft_consensus.cc:515] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.429651 25211 leader_election.cc:290] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:41.520074 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
W20260709 13:10:41.599258 24977 leader_election.cc:343] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.602464 25204 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:41.603089 25204 ts_tablet_manager.cc:1403] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.295s	user 0.014s	sys 0.016s
I20260709 13:10:41.606343 25204 raft_consensus.cc:359] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.607090 25204 raft_consensus.cc:385] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.607304 25204 raft_consensus.cc:740] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.608008 25204 consensus_queue.cc:260] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.610199 25204 ts_tablet_manager.cc:1434] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:41.611128 25204 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:41.618330 25204 tablet_bootstrap.cc:654] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.624671 25204 tablet_bootstrap.cc:492] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:41.625198 25204 ts_tablet_manager.cc:1403] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:10:41.628947 25204 raft_consensus.cc:359] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.629634 25204 raft_consensus.cc:385] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.629874 25204 raft_consensus.cc:740] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.630678 25204 consensus_queue.cc:260] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:41.631714 25203 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:41.632272 25203 ts_tablet_manager.cc:1403] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.288s	user 0.021s	sys 0.005s
I20260709 13:10:41.632473 25204 ts_tablet_manager.cc:1434] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:41.633538 25204 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:41.635030 25203 raft_consensus.cc:359] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.635625 25203 raft_consensus.cc:385] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.635916 25203 raft_consensus.cc:740] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.636533 25203 consensus_queue.cc:260] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.638263 25204 tablet_bootstrap.cc:654] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.638731 25203 ts_tablet_manager.cc:1434] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:41.639731 25203 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:41.696334 25212 raft_consensus.cc:493] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.723839 25212 raft_consensus.cc:515] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.727735 25212 leader_election.cc:290] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:41.643225 25204 tablet_bootstrap.cc:492] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:41.730268 25204 ts_tablet_manager.cc:1403] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.097s	user 0.006s	sys 0.004s
I20260709 13:10:41.865631 25204 raft_consensus.cc:359] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.866690 25204 raft_consensus.cc:385] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:41.867050 25204 raft_consensus.cc:740] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:41.868032 25204 consensus_queue.cc:260] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:41.897477 25204 ts_tablet_manager.cc:1434] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.001s
I20260709 13:10:41.935158 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:41.937528 25212 raft_consensus.cc:493] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.938333 25212 raft_consensus.cc:515] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
W20260709 13:10:41.939273 24977 leader_election.cc:343] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.940534 25212 leader_election.cc:290] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
W20260709 13:10:41.951490 25054 leader_election.cc:343] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:41.958539 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:41.959493 25089 raft_consensus.cc:2468] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:41.966640 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:41.967492 25161 raft_consensus.cc:2468] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:41.969280 24980 leader_election.cc:304] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:41.970525 25212 raft_consensus.cc:2804] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.970983 25212 raft_consensus.cc:493] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.971383 25212 raft_consensus.cc:3060] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.989784 25204 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:41.990041 25126 leader_election.cc:304] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:41.991237 25210 raft_consensus.cc:2804] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:41.992235 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:41.992995 25089 raft_consensus.cc:2468] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:41.991642 25210 raft_consensus.cc:493] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.994086 25210 raft_consensus.cc:3060] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:41.997438 25204 tablet_bootstrap.cc:654] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:41.998963 25203 tablet_bootstrap.cc:654] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.007061 25210 raft_consensus.cc:515] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:42.014056 25212 raft_consensus.cc:515] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:42.015583 25205 tablet_bootstrap.cc:654] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.018436 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.023700 25212 leader_election.cc:290] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:42.030908 25161 raft_consensus.cc:2393] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f47172118f542bf83a5575fa1547171 in current term 1: Already voted for candidate a08b80f5b49d4083b4529b043fa8985e in this term.
I20260709 13:10:42.028002 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.030928 25163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.031834 25013 raft_consensus.cc:2393] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in current term 1: Already voted for candidate 8f47172118f542bf83a5575fa1547171 in this term.
I20260709 13:10:42.028384 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.033078 25089 raft_consensus.cc:3060] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:42.034793 24980 leader_election.cc:343] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.035300 24980 leader_election.cc:304] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
W20260709 13:10:42.035552 24960 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:42.036463 25212 raft_consensus.cc:2749] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.039160 25203 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.039913 25203 ts_tablet_manager.cc:1403] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.400s	user 0.020s	sys 0.014s
I20260709 13:10:42.041678 25205 tablet_bootstrap.cc:492] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.039155 25204 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:42.041868 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.042106 25089 raft_consensus.cc:2468] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:42.046147 25204 ts_tablet_manager.cc:1403] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.015s
W20260709 13:10:42.047920 24980 leader_election.cc:343] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.048483 24980 leader_election.cc:304] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.049325 25204 raft_consensus.cc:359] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.050180 25204 raft_consensus.cc:385] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.050501 25204 raft_consensus.cc:740] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.050338 24977 leader_election.cc:304] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.050989 25212 raft_consensus.cc:2749] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.053802 25212 raft_consensus.cc:2804] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.054344 25212 raft_consensus.cc:697] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:42.054679 25203 raft_consensus.cc:359] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.055480 25203 raft_consensus.cc:385] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.055190 25212 consensus_queue.cc:237] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } }
I20260709 13:10:42.055802 25203 raft_consensus.cc:740] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.056741 25203 consensus_queue.cc:260] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.051638 25205 ts_tablet_manager.cc:1403] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.634s	user 0.025s	sys 0.013s
I20260709 13:10:42.064013 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.065416 25089 raft_consensus.cc:2393] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a08b80f5b49d4083b4529b043fa8985e in current term 1: Already voted for candidate 8f47172118f542bf83a5575fa1547171 in this term.
I20260709 13:10:42.065742 25210 leader_election.cc:290] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:42.066829 25205 raft_consensus.cc:359] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.067589 25205 raft_consensus.cc:385] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.067917 25205 raft_consensus.cc:740] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.083717 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.070375 25204 consensus_queue.cc:260] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.078562 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.102231 25161 raft_consensus.cc:2468] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.103698 25055 leader_election.cc:304] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 8f47172118f542bf83a5575fa1547171
I20260709 13:10:42.109167 25162 raft_consensus.cc:2393] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in current term 1: Already voted for candidate a08b80f5b49d4083b4529b043fa8985e in this term.
I20260709 13:10:42.111451 25055 leader_election.cc:304] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.109707 25234 raft_consensus.cc:2804] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:42.113092 24977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.130:45973, user_credentials={real_user=slave}} blocked reactor thread for 62844.2us
I20260709 13:10:42.117236 25203 ts_tablet_manager.cc:1434] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.077s	user 0.017s	sys 0.044s
I20260709 13:10:42.117487 25205 consensus_queue.cc:260] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.119252 25203 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.117256 25204 ts_tablet_manager.cc:1434] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.071s	user 0.021s	sys 0.026s
I20260709 13:10:42.114769 25234 raft_consensus.cc:493] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.121811 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.122051 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b747e1e81b54ad4838e20dc02df6a5b" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.122076 25234 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.123708 24911 catalog_manager.cc:5697] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.124579 25128 leader_election.cc:304] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08b80f5b49d4083b4529b043fa8985e; no voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:42.125941 25231 raft_consensus.cc:2749] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.126861 25204 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:42.129768 25203 tablet_bootstrap.cc:654] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.131358 25234 raft_consensus.cc:515] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.133752 25235 raft_consensus.cc:2749] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.134490 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.135109 25014 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.137426 25204 tablet_bootstrap.cc:654] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.145577 25014 raft_consensus.cc:2468] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.147684 25054 leader_election.cc:304] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.149154 25235 raft_consensus.cc:2804] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.150049 25235 raft_consensus.cc:697] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.152117 25235 consensus_queue.cc:237] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
W20260709 13:10:42.158013 25055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.131:39779, user_credentials={real_user=slave}} blocked reactor thread for 46799.6us
I20260709 13:10:42.165814 25234 leader_election.cc:290] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.166996 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.167707 25162 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.168486 25205 ts_tablet_manager.cc:1434] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.109s	user 0.021s	sys 0.012s
I20260709 13:10:42.169486 25205 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.173179 25203 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.173748 25203 ts_tablet_manager.cc:1403] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.007s
I20260709 13:10:42.175693 25205 tablet_bootstrap.cc:654] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.176744 25162 raft_consensus.cc:2468] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.181629 25204 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:42.181738 25203 raft_consensus.cc:359] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.182500 25204 ts_tablet_manager.cc:1403] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.061s	user 0.030s	sys 0.007s
I20260709 13:10:42.182700 25203 raft_consensus.cc:385] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.183032 25203 raft_consensus.cc:740] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.183845 25203 consensus_queue.cc:260] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.185843 25204 raft_consensus.cc:359] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.186494 25203 ts_tablet_manager.cc:1434] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:42.186753 25204 raft_consensus.cc:385] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.187165 25204 raft_consensus.cc:740] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.187638 25203 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.188207 25204 consensus_queue.cc:260] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.190790 25204 ts_tablet_manager.cc:1434] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:42.191929 25204 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:42.195194 25203 tablet_bootstrap.cc:654] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.198625 25204 tablet_bootstrap.cc:654] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.202979 25205 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.203418 25205 ts_tablet_manager.cc:1403] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.014s
I20260709 13:10:42.204226 25204 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:42.204772 25204 ts_tablet_manager.cc:1403] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:10:42.208323 25204 raft_consensus.cc:359] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.209301 25204 raft_consensus.cc:385] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.209666 25204 raft_consensus.cc:740] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.210744 25204 consensus_queue.cc:260] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.214176 25204 ts_tablet_manager.cc:1434] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
I20260709 13:10:42.215534 25204 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:42.215324 25205 raft_consensus.cc:359] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.216131 25205 raft_consensus.cc:385] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.216423 25205 raft_consensus.cc:740] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.217154 25205 consensus_queue.cc:260] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.219339 25205 ts_tablet_manager.cc:1434] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:42.220325 25205 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.222437 25204 tablet_bootstrap.cc:654] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.225548 24910 catalog_manager.cc:5697] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.229743 25205 tablet_bootstrap.cc:654] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.230616 25203 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.231220 25203 ts_tablet_manager.cc:1403] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.010s
I20260709 13:10:42.235705 25203 raft_consensus.cc:359] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.236421 25203 raft_consensus.cc:385] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.236704 25203 raft_consensus.cc:740] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.237397 25203 consensus_queue.cc:260] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.240775 25203 ts_tablet_manager.cc:1434] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:42.241608 25205 tablet_bootstrap.cc:492] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.241842 25203 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.242204 25205 ts_tablet_manager.cc:1403] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:10:42.245280 25204 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:42.245760 25204 ts_tablet_manager.cc:1403] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:10:42.248329 25204 raft_consensus.cc:359] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.248987 25204 raft_consensus.cc:385] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.249257 25204 raft_consensus.cc:740] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.249306 25203 tablet_bootstrap.cc:654] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.249506 25205 raft_consensus.cc:359] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.250363 25205 raft_consensus.cc:385] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.249987 25204 consensus_queue.cc:260] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.250692 25205 raft_consensus.cc:740] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.251696 25205 consensus_queue.cc:260] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.254329 25205 ts_tablet_manager.cc:1434] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:42.255503 25205 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.259717 25236 raft_consensus.cc:493] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.252152 25204 ts_tablet_manager.cc:1434] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:42.260244 25236 raft_consensus.cc:515] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.261714 25204 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:42.263319 25205 tablet_bootstrap.cc:654] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.264163 25236 leader_election.cc:290] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.265803 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.267810 25204 tablet_bootstrap.cc:654] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.268117 25014 raft_consensus.cc:2468] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.267385 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
W20260709 13:10:42.269997 25055 leader_election.cc:343] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.272382 25203 tablet_bootstrap.cc:492] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.272902 25203 ts_tablet_manager.cc:1403] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:10:42.273497 25054 leader_election.cc:304] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.275134 25205 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.275080 25236 raft_consensus.cc:2804] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.275782 25205 ts_tablet_manager.cc:1403] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:10:42.275894 25203 raft_consensus.cc:359] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.276794 25203 raft_consensus.cc:385] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.277087 25203 raft_consensus.cc:740] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.277976 25203 consensus_queue.cc:260] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.279145 25205 raft_consensus.cc:359] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.279883 25205 raft_consensus.cc:385] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.280189 25205 raft_consensus.cc:740] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.280321 25203 ts_tablet_manager.cc:1434] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:42.281066 25205 consensus_queue.cc:260] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.275727 25236 raft_consensus.cc:493] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.283131 25236 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.283406 25205 ts_tablet_manager.cc:1434] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:42.284186 25231 raft_consensus.cc:493] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.284540 25205 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.284897 25231 raft_consensus.cc:515] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.286350 25203 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.293501 25203 tablet_bootstrap.cc:654] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.294401 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.295121 25014 raft_consensus.cc:2468] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:42.296254 25128 leader_election.cc:304] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.297109 25210 raft_consensus.cc:2804] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.297492 25210 raft_consensus.cc:493] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.297828 25210 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.298655 25231 leader_election.cc:290] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:42.298688 25204 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:42.299993 25204 ts_tablet_manager.cc:1403] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.014s
I20260709 13:10:42.302852 25204 raft_consensus.cc:359] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.303551 25204 raft_consensus.cc:385] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.303879 25204 raft_consensus.cc:740] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.304582 25204 consensus_queue.cc:260] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.306728 25236 raft_consensus.cc:515] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.308894 25204 ts_tablet_manager.cc:1434] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:42.309041 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
W20260709 13:10:42.310271 25126 leader_election.cc:343] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.313191 25210 raft_consensus.cc:515] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.315449 25210 leader_election.cc:290] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:42.316596 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.317636 25205 tablet_bootstrap.cc:654] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.317744 25236 leader_election.cc:290] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.317768 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.317250 25014 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.320017 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.320657 25013 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.321400 25203 tablet_bootstrap.cc:492] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
W20260709 13:10:42.321552 25126 leader_election.cc:343] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.322208 25203 ts_tablet_manager.cc:1403] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.009s
I20260709 13:10:42.324685 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.325313 25162 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.326679 25203 raft_consensus.cc:359] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.327913 25203 raft_consensus.cc:385] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.328284 25203 raft_consensus.cc:740] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.329057 25014 raft_consensus.cc:2468] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 1.
I20260709 13:10:42.329370 25203 consensus_queue.cc:260] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.330344 25128 leader_election.cc:304] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:42.333164 25210 raft_consensus.cc:2804] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.333585 25203 ts_tablet_manager.cc:1434] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:42.333654 25210 raft_consensus.cc:697] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:42.334715 25203 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.334872 25210 consensus_queue.cc:237] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.336159 25236 raft_consensus.cc:493] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.336660 25236 raft_consensus.cc:515] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.337314 25162 raft_consensus.cc:2468] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.337970 25205 tablet_bootstrap.cc:492] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.338538 25205 ts_tablet_manager.cc:1403] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.009s
I20260709 13:10:42.338776 25236 leader_election.cc:290] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.339663 25055 leader_election.cc:304] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.341089 25236 raft_consensus.cc:2804] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.343532 25205 raft_consensus.cc:359] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.344226 25205 raft_consensus.cc:385] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.344522 25205 raft_consensus.cc:740] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.344556 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.345655 25236 raft_consensus.cc:697] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.345595 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.346678 25014 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.346776 25162 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.347015 25236 consensus_queue.cc:237] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.345450 25205 consensus_queue.cc:260] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.348006 25054 leader_election.cc:304] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.349017 25234 raft_consensus.cc:2804] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.349371 25234 raft_consensus.cc:493] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.345871 25013 raft_consensus.cc:2468] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.349570 25205 ts_tablet_manager.cc:1434] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:10:42.350448 25234 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.350839 25205 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.351454 24911 catalog_manager.cc:5697] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 0 to 1, leader changed from <none> to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 1 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.357999 25234 raft_consensus.cc:515] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.360920 25205 tablet_bootstrap.cc:654] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.361905 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.362593 25013 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.366645 25234 leader_election.cc:290] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.367432 25203 tablet_bootstrap.cc:654] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.367650 25212 raft_consensus.cc:493] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.368345 25212 raft_consensus.cc:515] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.369728 25013 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.371022 25212 leader_election.cc:290] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.371073 25054 leader_election.cc:304] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.372349 25212 raft_consensus.cc:493] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.372869 25212 raft_consensus.cc:515] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.373518 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.374162 25161 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:42.374213 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:42.375121 25089 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:42.375443 24980 leader_election.cc:304] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.377213 25233 raft_consensus.cc:2804] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.377707 25233 raft_consensus.cc:493] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.378505 25230 raft_consensus.cc:493] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.379223 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.379070 25230 raft_consensus.cc:515] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.378597 25233 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.379382 24911 catalog_manager.cc:5697] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.381280 25230 leader_election.cc:290] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.383795 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:42.385813 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
W20260709 13:10:42.386946 24980 leader_election.cc:343] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:42.387691 24977 leader_election.cc:343] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.388329 24977 leader_election.cc:304] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.388761 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.389649 25230 raft_consensus.cc:2749] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:42.390812 24980 leader_election.cc:343] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:42.391592 24977 leader_election.cc:343] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.392288 24977 leader_election.cc:304] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.393226 25234 raft_consensus.cc:2804] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.393783 25230 raft_consensus.cc:2749] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.394210 25234 raft_consensus.cc:697] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.375475 25212 leader_election.cc:290] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.395516 25234 consensus_queue.cc:237] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.400718 25233 raft_consensus.cc:515] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.403754 25233 leader_election.cc:290] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.403800 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.404747 25162 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.405753 25205 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.406278 25205 ts_tablet_manager.cc:1403] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.011s
I20260709 13:10:42.406764 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.407208 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.407636 25088 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.407915 25161 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.409134 25205 raft_consensus.cc:359] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.409819 25205 raft_consensus.cc:385] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.410082 25205 raft_consensus.cc:740] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.410778 25205 consensus_queue.cc:260] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.412684 25205 ts_tablet_manager.cc:1434] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:42.413513 25205 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:42.416534 25203 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.416443 25161 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:42.417150 25203 ts_tablet_manager.cc:1403] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.022s
I20260709 13:10:42.418057 24980 leader_election.cc:304] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.419013 25233 raft_consensus.cc:2804] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.420229 25233 raft_consensus.cc:697] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:42.421141 25233 consensus_queue.cc:237] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.422155 25162 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.419986 25203 raft_consensus.cc:359] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.422832 25203 raft_consensus.cc:385] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.423475 25203 raft_consensus.cc:740] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.425210 25203 consensus_queue.cc:260] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.426708 25205 tablet_bootstrap.cc:654] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.424088 25088 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:42.437316 25203 ts_tablet_manager.cc:1434] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:10:42.441731 24911 catalog_manager.cc:5697] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.442564 25212 consensus_queue.cc:1048] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.444288 25203 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:42.451217 25203 tablet_bootstrap.cc:654] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.462400 25205 tablet_bootstrap.cc:492] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:42.462895 25205 ts_tablet_manager.cc:1403] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.026s
I20260709 13:10:42.466131 25205 raft_consensus.cc:359] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.466792 25205 raft_consensus.cc:385] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.467005 25203 tablet_bootstrap.cc:492] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:42.467056 25205 raft_consensus.cc:740] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.467600 25203 ts_tablet_manager.cc:1403] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 13:10:42.468050 25205 consensus_queue.cc:260] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.470206 25203 raft_consensus.cc:359] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.470932 25203 raft_consensus.cc:385] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.471197 25203 raft_consensus.cc:740] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.471962 25203 consensus_queue.cc:260] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.474078 25203 ts_tablet_manager.cc:1434] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:42.475867 25205 ts_tablet_manager.cc:1434] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:42.477017 25212 consensus_queue.cc:1048] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.486223 24911 catalog_manager.cc:5697] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:42.494850 25035 debug-util.cc:398] Leaking SignalData structure 0x7b080027bf20 after lost signal to thread 14477
W20260709 13:10:42.496152 25035 debug-util.cc:398] Leaking SignalData structure 0x7b080030c040 after lost signal to thread 24946
W20260709 13:10:42.497556 25035 debug-util.cc:398] Leaking SignalData structure 0x7b080014a800 after lost signal to thread 25038
W20260709 13:10:42.498880 25035 debug-util.cc:398] Leaking SignalData structure 0x7b0800032ee0 after lost signal to thread 25113
W20260709 13:10:42.500177 25035 debug-util.cc:398] Leaking SignalData structure 0x7b0800140940 after lost signal to thread 25187
I20260709 13:10:42.518575 25230 raft_consensus.cc:493] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.519167 25230 raft_consensus.cc:515] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.521104 25230 leader_election.cc:290] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.521965 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:42.522591 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.522981 25088 raft_consensus.cc:2468] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:42.523363 25162 raft_consensus.cc:2468] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:42.524537 24980 leader_election.cc:304] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.525315 25230 raft_consensus.cc:2804] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.525708 25230 raft_consensus.cc:493] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.526032 25230 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.532332 25230 raft_consensus.cc:515] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.534751 25230 leader_election.cc:290] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.535454 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.536082 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.536836 25162 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.536166 25088 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.540261 25234 consensus_queue.cc:1048] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.547950 25162 raft_consensus.cc:2468] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:42.548990 25088 raft_consensus.cc:2468] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:42.549822 24980 leader_election.cc:304] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.551002 25230 raft_consensus.cc:2804] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.551759 25230 raft_consensus.cc:697] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:42.552690 25230 consensus_queue.cc:237] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.565623 25235 consensus_queue.cc:1048] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.574478 25234 raft_consensus.cc:493] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.574954 25234 raft_consensus.cc:515] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.576941 25234 leader_election.cc:290] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.578667 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.579398 25013 raft_consensus.cc:2468] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.581189 25054 leader_election.cc:304] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.579540 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.582086 25234 raft_consensus.cc:2804] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.582784 25234 raft_consensus.cc:493] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.582273 25161 raft_consensus.cc:2468] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.583320 25234 raft_consensus.cc:3060] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.585811 24910 catalog_manager.cc:5697] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.588943 25234 raft_consensus.cc:515] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.591846 25234 leader_election.cc:290] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.591970 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.592171 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e29d50d81f4fac80042e87009c1116" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.592727 25013 raft_consensus.cc:3060] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.592820 25161 raft_consensus.cc:3060] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.600874 25013 raft_consensus.cc:2468] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.602469 25161 raft_consensus.cc:2468] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.603724 25054 leader_election.cc:304] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.604673 25234 raft_consensus.cc:2804] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.605162 25234 raft_consensus.cc:697] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.605980 25234 consensus_queue.cc:237] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.614323 24911 catalog_manager.cc:5697] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.716293 25234 raft_consensus.cc:493] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.716933 25234 raft_consensus.cc:515] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.718724 25234 leader_election.cc:290] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.719723 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.720005 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.720696 25013 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.720773 25161 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:42.721794 25054 leader_election.cc:304] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.722688 25234 raft_consensus.cc:2804] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.723054 25234 raft_consensus.cc:493] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.723377 25234 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.729001 25234 raft_consensus.cc:515] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.731114 25234 leader_election.cc:290] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.732053 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:42.732268 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.732957 25013 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.733042 25161 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.738916 25161 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.740517 25055 leader_election.cc:304] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:42.741258 25234 raft_consensus.cc:2804] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.741331 25013 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:42.741807 25234 raft_consensus.cc:697] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.742677 25234 consensus_queue.cc:237] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.751955 24911 catalog_manager.cc:5697] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.761727 25210 consensus_queue.cc:1048] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.766319 25234 raft_consensus.cc:493] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.766938 25234 raft_consensus.cc:515] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.769104 25234 leader_election.cc:290] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.770686 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:42.774598 25088 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.774832 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:42.776441 25054 leader_election.cc:304] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:42.785866 25234 raft_consensus.cc:2749] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.787161 25273 consensus_queue.cc:1048] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:42.822904 25234 consensus_queue.cc:1048] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.835427 25235 consensus_queue.cc:1048] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.855593 25230 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.868606 25212 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.895228 25235 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.914662 25234 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:42.925412 25088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bb59340244844dabecbf6fb19299767"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:42.926101 25088 raft_consensus.cc:606] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:42.933822 25088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:42.934522 25088 raft_consensus.cc:606] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:42.941498 25088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:42.942189 25088 raft_consensus.cc:606] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:42.958922 25013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:10:42.959553 25013 raft_consensus.cc:606] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:42.960148 25236 raft_consensus.cc:993] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:42.960673 25236 raft_consensus.cc:1081] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:42.962431 25013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bb59340244844dabecbf6fb19299767"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:42.963016 25013 raft_consensus.cc:493] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.963402 25013 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.971733 25013 raft_consensus.cc:515] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.974612 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:42.975293 25088 raft_consensus.cc:3055] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:42.975821 25088 raft_consensus.cc:740] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:42.976724 25088 consensus_queue.cc:260] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.977965 25088 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.979302 25161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:58230
I20260709 13:10:42.979899 25161 raft_consensus.cc:606] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:42.984251 25013 leader_election.cc:290] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:42.985167 25014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:10:42.985355 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb59340244844dabecbf6fb19299767" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:42.985896 25161 raft_consensus.cc:3060] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.988781 25088 raft_consensus.cc:2468] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:42.985834 25014 raft_consensus.cc:606] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:42.990100 24977 leader_election.cc:304] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:42.991154 25212 raft_consensus.cc:2804] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:42.991664 25212 raft_consensus.cc:697] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:42.991750 25161 raft_consensus.cc:2468] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:42.992588 25212 consensus_queue.cc:237] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:42.998111 25088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:42.998694 25088 raft_consensus.cc:606] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:43.001220 24911 catalog_manager.cc:5697] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.052350 25236 consensus_queue.cc:1048] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.065909 25235 consensus_queue.cc:1048] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.131203 25212 consensus_queue.cc:1048] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.138276 25230 raft_consensus.cc:993] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.138829 25230 raft_consensus.cc:1081] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.140437 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44080
I20260709 13:10:43.141435 25089 raft_consensus.cc:493] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.141829 25089 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.146008 25212 consensus_queue.cc:1048] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.148772 25089 raft_consensus.cc:515] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.152979 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:43.153103 25089 leader_election.cc:290] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:43.153318 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4d20ab96214b1a8afd61d913954b70" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:43.153614 25014 raft_consensus.cc:3055] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.153996 25014 raft_consensus.cc:740] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:43.154986 25014 consensus_queue.cc:260] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.156312 25014 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.163517 25014 raft_consensus.cc:2468] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:43.165609 25054 leader_election.cc:304] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:43.167032 25235 raft_consensus.cc:2804] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.167593 25235 raft_consensus.cc:697] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.168286 25235 consensus_queue.cc:237] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.177270 24911 catalog_manager.cc:5697] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.182108 25235 consensus_queue.cc:1048] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.195209 25236 consensus_queue.cc:1048] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.207679 25234 raft_consensus.cc:993] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:43.208526 25235 raft_consensus.cc:1081] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:43.210489 25161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:10:43.211181 25161 raft_consensus.cc:493] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.211655 25161 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.219143 25231 raft_consensus.cc:993] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.219748 25273 raft_consensus.cc:1081] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.219846 25161 raft_consensus.cc:515] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.221449 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44096
I20260709 13:10:43.221982 25089 raft_consensus.cc:493] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.222429 25089 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.224674 25161 leader_election.cc:290] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:43.225637 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:43.226336 25014 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.234731 25014 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 2.
I20260709 13:10:43.235998 25128 leader_election.cc:304] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:43.236964 25273 raft_consensus.cc:2804] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.237548 25273 raft_consensus.cc:697] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 2 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:43.238494 25273 consensus_queue.cc:237] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.241247 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5e9e607a84402c9520ad801bef3647" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:43.241930 25088 raft_consensus.cc:3055] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.242311 25088 raft_consensus.cc:740] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.243264 25088 consensus_queue.cc:260] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.244624 25088 raft_consensus.cc:3060] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.243752 25235 raft_consensus.cc:993] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:43.249339 25089 raft_consensus.cc:515] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.250382 25235 raft_consensus.cc:1081] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:43.252382 25089 leader_election.cc:290] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:43.253362 25014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:43.253749 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:43.254083 25014 raft_consensus.cc:493] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.254528 25014 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.254532 25013 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.256469 24912 catalog_manager.cc:5697] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 2 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.259032 25088 raft_consensus.cc:2468] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 2.
I20260709 13:10:43.258204 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794ae7c2cdc5463282c97fa88b22f5cb" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:43.259816 25161 raft_consensus.cc:3055] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.260201 25161 raft_consensus.cc:740] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:43.261106 25161 consensus_queue.cc:260] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.263880 25161 raft_consensus.cc:3060] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.271876 25161 raft_consensus.cc:2468] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:43.274394 25055 leader_election.cc:304] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:43.275404 25235 raft_consensus.cc:2804] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.277199 25235 raft_consensus.cc:697] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.265309 25014 raft_consensus.cc:515] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.278167 25235 consensus_queue.cc:237] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.279822 25014 leader_election.cc:290] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:43.280738 25013 raft_consensus.cc:2468] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:43.281633 25233 raft_consensus.cc:993] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.282231 25233 raft_consensus.cc:1081] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:43.283792 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:43.284878 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44080
I20260709 13:10:43.285545 25089 raft_consensus.cc:493] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.285938 25089 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.286015 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f8c3ab62834572af2d935593315ac6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:43.286813 25161 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.289958 24910 catalog_manager.cc:5697] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from a08b80f5b49d4083b4529b043fa8985e (127.14.34.131) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.294466 25089 raft_consensus.cc:515] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.294880 25161 raft_consensus.cc:2468] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:43.296702 24980 leader_election.cc:304] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:43.284583 25088 raft_consensus.cc:3055] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.297392 25088 raft_consensus.cc:740] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.298177 25212 raft_consensus.cc:2804] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.298846 25212 raft_consensus.cc:697] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:43.299649 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:43.299806 25212 consensus_queue.cc:237] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.301190 25089 leader_election.cc:290] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:43.300329 25013 raft_consensus.cc:3055] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.302062 25013 raft_consensus.cc:740] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:43.303063 25013 consensus_queue.cc:260] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.304150 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:43.304401 25013 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.304888 25161 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.313010 25013 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:43.314484 25054 leader_election.cc:304] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:43.298380 25088 consensus_queue.cc:260] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.316255 25234 raft_consensus.cc:2804] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.316835 25234 raft_consensus.cc:697] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.317667 25161 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:43.317925 25088 raft_consensus.cc:3060] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.318807 24912 catalog_manager.cc:5697] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.317767 25234 consensus_queue.cc:237] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.328874 25088 raft_consensus.cc:2468] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:43.335098 24912 catalog_manager.cc:5697] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.470201 25235 raft_consensus.cc:993] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:43.470779 25234 raft_consensus.cc:1081] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:43.472615 25013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:43.473255 25013 raft_consensus.cc:493] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.473680 25013 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.482402 25013 raft_consensus.cc:515] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.484784 25013 leader_election.cc:290] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:43.485630 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:43.485971 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:43.486413 25088 raft_consensus.cc:3055] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.486680 25161 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.486814 25088 raft_consensus.cc:740] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:43.487782 25088 consensus_queue.cc:260] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.488749 25088 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.493039 25161 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:43.494225 24980 leader_election.cc:304] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:43.494982 25212 raft_consensus.cc:2804] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.495425 25212 raft_consensus.cc:697] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:43.496294 25088 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:43.496280 25212 consensus_queue.cc:237] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:43.503104 24912 catalog_manager.cc:5697] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.522014 25088 raft_consensus.cc:1275] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.523741 25212 consensus_queue.cc:1048] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.535809 25161 raft_consensus.cc:1275] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.537451 25212 consensus_queue.cc:1048] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.714690 25013 raft_consensus.cc:1275] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.716126 25234 consensus_queue.cc:1048] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.725739 25162 raft_consensus.cc:3060] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.732694 25162 raft_consensus.cc:1275] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.734360 25236 consensus_queue.cc:1048] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.744182 25088 raft_consensus.cc:1275] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.745666 25273 consensus_queue.cc:1048] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.754717 25162 raft_consensus.cc:1275] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.758769 25236 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.760412 25161 raft_consensus.cc:1275] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.764814 25013 raft_consensus.cc:1275] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.765132 25236 consensus_queue.cc:1048] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:43.767124 25291 consensus_queue.cc:1048] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.772105 25089 raft_consensus.cc:1275] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.777029 25014 raft_consensus.cc:1275] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.778995 25236 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.789794 25212 consensus_queue.cc:1048] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.830281 25161 raft_consensus.cc:1275] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.833436 25212 consensus_queue.cc:1048] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.845942 25014 raft_consensus.cc:1275] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.848121 25235 consensus_queue.cc:1048] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:43.899521 25161 raft_consensus.cc:1275] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.901157 25212 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.910109 25089 raft_consensus.cc:1275] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:43.911679 25233 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:46.048362 24912 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54138:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:46.051677 24912 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:10:46.093626 24960 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:46.123279 25001 tablet_service.cc:1511] Processing CreateTablet for tablet 0588700e0dbf47ba8c3ce9a970b911ef (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:46.125468 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0588700e0dbf47ba8c3ce9a970b911ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.127054 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 0588700e0dbf47ba8c3ce9a970b911ef (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:46.127055 25076 tablet_service.cc:1511] Processing CreateTablet for tablet 0588700e0dbf47ba8c3ce9a970b911ef (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:46.129905 25003 tablet_service.cc:1511] Processing CreateTablet for tablet 0b07d145570b4797b7dcd0c4259d4fbf (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:46.130602 25076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0588700e0dbf47ba8c3ce9a970b911ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.131558 25003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b07d145570b4797b7dcd0c4259d4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.133550 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0588700e0dbf47ba8c3ce9a970b911ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.136968 25075 tablet_service.cc:1511] Processing CreateTablet for tablet 0b07d145570b4797b7dcd0c4259d4fbf (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:46.138800 25075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b07d145570b4797b7dcd0c4259d4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.155462 25150 tablet_service.cc:1511] Processing CreateTablet for tablet 0b07d145570b4797b7dcd0c4259d4fbf (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:46.161016 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b07d145570b4797b7dcd0c4259d4fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.161230 25000 tablet_service.cc:1511] Processing CreateTablet for tablet e2e9452f6064450ea0cf62ef970760b8 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:46.162989 25000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e9452f6064450ea0cf62ef970760b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.163579 25079 tablet_service.cc:1511] Processing CreateTablet for tablet e2e9452f6064450ea0cf62ef970760b8 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:46.165182 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e9452f6064450ea0cf62ef970760b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.187753 25151 tablet_service.cc:1511] Processing CreateTablet for tablet e2e9452f6064450ea0cf62ef970760b8 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:46.189296 25151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e9452f6064450ea0cf62ef970760b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.206614 25078 tablet_service.cc:1511] Processing CreateTablet for tablet e356e913bb214d4e93223371660e01f0 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:46.208212 25078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356e913bb214d4e93223371660e01f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.219127 25001 tablet_service.cc:1511] Processing CreateTablet for tablet e356e913bb214d4e93223371660e01f0 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:46.221073 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356e913bb214d4e93223371660e01f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.264089 25151 tablet_service.cc:1511] Processing CreateTablet for tablet e356e913bb214d4e93223371660e01f0 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:46.266072 25151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356e913bb214d4e93223371660e01f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.281427 25000 tablet_service.cc:1511] Processing CreateTablet for tablet ffc72d7cc06447a69577281699ef95f7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:46.283489 25000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc72d7cc06447a69577281699ef95f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.286643 25150 tablet_service.cc:1511] Processing CreateTablet for tablet ffc72d7cc06447a69577281699ef95f7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:46.288084 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc72d7cc06447a69577281699ef95f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.287601 25079 tablet_service.cc:1511] Processing CreateTablet for tablet ffc72d7cc06447a69577281699ef95f7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:46.289465 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc72d7cc06447a69577281699ef95f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.296617 25313 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.303296 25314 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:46.306561 25315 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.317229 25001 tablet_service.cc:1511] Processing CreateTablet for tablet 40e8ee9b43824f4ca519d29d8a5efa55 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:46.318751 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e8ee9b43824f4ca519d29d8a5efa55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.319981 25077 tablet_service.cc:1511] Processing CreateTablet for tablet 40e8ee9b43824f4ca519d29d8a5efa55 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:46.321425 25077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e8ee9b43824f4ca519d29d8a5efa55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.343750 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 40e8ee9b43824f4ca519d29d8a5efa55 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:46.346963 25313 tablet_bootstrap.cc:654] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.350091 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e8ee9b43824f4ca519d29d8a5efa55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.351202 25001 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7a94b3d5074de5b9053505a1e714a7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:46.352677 25001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7a94b3d5074de5b9053505a1e714a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.362212 25151 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7a94b3d5074de5b9053505a1e714a7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:46.363677 25151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7a94b3d5074de5b9053505a1e714a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.363538 25000 tablet_service.cc:1511] Processing CreateTablet for tablet 27de8116092849e693bfe85db1121090 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:46.365001 25000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de8116092849e693bfe85db1121090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.374549 25314 tablet_bootstrap.cc:654] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.378000 25315 tablet_bootstrap.cc:654] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.381583 25076 tablet_service.cc:1511] Processing CreateTablet for tablet 27de8116092849e693bfe85db1121090 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:46.383001 25076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de8116092849e693bfe85db1121090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.382777 25150 tablet_service.cc:1511] Processing CreateTablet for tablet 27de8116092849e693bfe85db1121090 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:46.384205 25150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de8116092849e693bfe85db1121090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.397552 25003 tablet_service.cc:1511] Processing CreateTablet for tablet ce31a0c58bcd43cdbaaeb61736cbde96 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:46.398994 25003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31a0c58bcd43cdbaaeb61736cbde96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.379472 25078 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7a94b3d5074de5b9053505a1e714a7 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:46.403297 25314 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:46.403502 25078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7a94b3d5074de5b9053505a1e714a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.403923 25314 ts_tablet_manager.cc:1403] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.101s	user 0.005s	sys 0.010s
I20260709 13:10:46.419425 25077 tablet_service.cc:1511] Processing CreateTablet for tablet ce31a0c58bcd43cdbaaeb61736cbde96 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:46.420805 25077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31a0c58bcd43cdbaaeb61736cbde96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.421067 25153 tablet_service.cc:1511] Processing CreateTablet for tablet ce31a0c58bcd43cdbaaeb61736cbde96 (DEFAULT_TABLE table=soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:46.422438 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce31a0c58bcd43cdbaaeb61736cbde96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.423727 25314 raft_consensus.cc:359] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.424784 25314 raft_consensus.cc:385] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.428170 25314 raft_consensus.cc:740] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.429116 25314 consensus_queue.cc:260] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.429931 25315 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.433509 25313 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.450062 25315 ts_tablet_manager.cc:1403] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.005s
I20260709 13:10:46.450124 25313 ts_tablet_manager.cc:1403] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.000s
I20260709 13:10:46.453760 25315 raft_consensus.cc:359] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.454697 25313 raft_consensus.cc:359] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.455552 25313 raft_consensus.cc:385] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.455914 25313 raft_consensus.cc:740] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.456923 25313 consensus_queue.cc:260] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.460681 25313 ts_tablet_manager.cc:1434] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:46.438371 25314 ts_tablet_manager.cc:1434] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 13:10:46.462680 25314 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:46.464322 25315 raft_consensus.cc:385] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.464747 25315 raft_consensus.cc:740] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.465620 25315 consensus_queue.cc:260] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.468493 25315 ts_tablet_manager.cc:1434] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:46.470453 25314 tablet_bootstrap.cc:654] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.463295 25313 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.470865 25315 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.477566 25313 tablet_bootstrap.cc:654] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.481411 25315 tablet_bootstrap.cc:654] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.499279 25313 tablet_bootstrap.cc:492] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.500551 25313 ts_tablet_manager.cc:1403] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:10:46.501363 25212 raft_consensus.cc:493] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.501935 25212 raft_consensus.cc:515] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.504436 25212 leader_election.cc:290] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.505339 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:46.507251 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:46.508802 25313 raft_consensus.cc:359] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.509625 25313 raft_consensus.cc:385] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.509907 25313 raft_consensus.cc:740] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
W20260709 13:10:46.510100 24977 leader_election.cc:343] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:46.511067 24980 leader_election.cc:343] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.511507 24980 leader_election.cc:304] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:46.512799 25314 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:46.512733 25212 raft_consensus.cc:2749] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.513945 25314 ts_tablet_manager.cc:1403] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.003s
I20260709 13:10:46.517210 25314 raft_consensus.cc:359] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.517982 25314 raft_consensus.cc:385] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.518340 25314 raft_consensus.cc:740] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.520321 25314 consensus_queue.cc:260] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.518950 25313 consensus_queue.cc:260] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.525923 25313 ts_tablet_manager.cc:1434] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:10:46.527498 25313 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.526479 25314 ts_tablet_manager.cc:1434] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:46.529256 25314 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:46.544428 25313 tablet_bootstrap.cc:654] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.544872 25314 tablet_bootstrap.cc:654] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.547574 25315 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.548177 25315 ts_tablet_manager.cc:1403] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.078s	user 0.034s	sys 0.029s
I20260709 13:10:46.551523 25315 raft_consensus.cc:359] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.552407 25315 raft_consensus.cc:385] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.552759 25315 raft_consensus.cc:740] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.553697 25315 consensus_queue.cc:260] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.556399 25315 ts_tablet_manager.cc:1434] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:10:46.557358 25315 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.559742 25313 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.560429 25313 ts_tablet_manager.cc:1403] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:10:46.564265 25315 tablet_bootstrap.cc:654] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.563995 25313 raft_consensus.cc:359] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.564816 25313 raft_consensus.cc:385] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.565305 25313 raft_consensus.cc:740] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.568624 25313 consensus_queue.cc:260] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.574715 25313 ts_tablet_manager.cc:1434] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:10:46.576216 25313 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.578984 25315 tablet_bootstrap.cc:492] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.579604 25315 ts_tablet_manager.cc:1403] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 13:10:46.583094 25315 raft_consensus.cc:359] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.583837 25315 raft_consensus.cc:385] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.584137 25315 raft_consensus.cc:740] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.584877 25315 consensus_queue.cc:260] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.586246 25314 tablet_bootstrap.cc:492] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:46.586879 25314 ts_tablet_manager.cc:1403] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 13:10:46.587224 25315 ts_tablet_manager.cc:1434] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:10:46.588485 25315 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.588661 25313 tablet_bootstrap.cc:654] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.592163 25314 raft_consensus.cc:359] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.593098 25314 raft_consensus.cc:385] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.593438 25314 raft_consensus.cc:740] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.594514 25314 consensus_queue.cc:260] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.596138 25315 tablet_bootstrap.cc:654] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.608783 25315 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.609308 25315 ts_tablet_manager.cc:1403] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:10:46.612157 25313 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.612308 25315 raft_consensus.cc:359] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.612879 25313 ts_tablet_manager.cc:1403] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.004s
I20260709 13:10:46.613121 25315 raft_consensus.cc:385] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.613456 25315 raft_consensus.cc:740] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.614287 25315 consensus_queue.cc:260] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.617266 25314 ts_tablet_manager.cc:1434] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.006s
I20260709 13:10:46.617851 25315 ts_tablet_manager.cc:1434] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:10:46.618981 25315 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.621500 25314 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:46.626428 25315 tablet_bootstrap.cc:654] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.628886 25313 raft_consensus.cc:359] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.629894 25313 raft_consensus.cc:385] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.630695 25313 raft_consensus.cc:740] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.631894 25313 consensus_queue.cc:260] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.638754 25315 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.639449 25315 ts_tablet_manager.cc:1403] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:10:46.642270 25313 ts_tablet_manager.cc:1434] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.005s
I20260709 13:10:46.643643 25313 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.642951 25315 raft_consensus.cc:359] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.644177 25315 raft_consensus.cc:385] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.644543 25315 raft_consensus.cc:740] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.645370 25315 consensus_queue.cc:260] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.648233 25315 ts_tablet_manager.cc:1434] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:46.649333 25315 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.650051 25314 tablet_bootstrap.cc:654] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.656838 25315 tablet_bootstrap.cc:654] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.667061 25314 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:46.667652 25314 ts_tablet_manager.cc:1403] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.011s
I20260709 13:10:46.669047 25315 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.669804 25315 ts_tablet_manager.cc:1403] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:10:46.670910 25314 raft_consensus.cc:359] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.671782 25314 raft_consensus.cc:385] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.672093 25314 raft_consensus.cc:740] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.672959 25313 tablet_bootstrap.cc:654] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.673187 25315 raft_consensus.cc:359] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.673056 25314 consensus_queue.cc:260] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.674266 25315 raft_consensus.cc:385] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.674679 25315 raft_consensus.cc:740] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.675592 25315 consensus_queue.cc:260] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.678277 25315 ts_tablet_manager.cc:1434] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:10:46.679420 25315 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.687475 25315 tablet_bootstrap.cc:654] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.693759 25314 ts_tablet_manager.cc:1434] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:10:46.697544 25314 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:46.706676 25314 tablet_bootstrap.cc:654] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.706943 25313 tablet_bootstrap.cc:492] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.707006 25315 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.707789 25313 ts_tablet_manager.cc:1403] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.009s
I20260709 13:10:46.707810 25315 ts_tablet_manager.cc:1403] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.005s
I20260709 13:10:46.708962 25301 raft_consensus.cc:493] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.709743 25301 raft_consensus.cc:515] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.713661 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:46.713316 25315 raft_consensus.cc:359] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.714525 25315 raft_consensus.cc:385] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.714574 25013 raft_consensus.cc:2468] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:46.715070 25315 raft_consensus.cc:740] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.716310 25315 consensus_queue.cc:260] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.716836 25128 leader_election.cc:304] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:46.720144 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:46.720670 25313 raft_consensus.cc:359] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.721719 25313 raft_consensus.cc:385] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.722131 25313 raft_consensus.cc:740] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
W20260709 13:10:46.722206 25126 leader_election.cc:343] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.723266 25313 consensus_queue.cc:260] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.725737 25313 ts_tablet_manager.cc:1434] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:10:46.727113 25313 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.723631 25301 leader_election.cc:290] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:46.733968 25301 raft_consensus.cc:2804] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.734525 25301 raft_consensus.cc:493] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.735180 25313 tablet_bootstrap.cc:654] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.749185 25301 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.768265 25313 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.769148 25313 ts_tablet_manager.cc:1403] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.010s
I20260709 13:10:46.773357 25235 raft_consensus.cc:493] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.774147 25235 raft_consensus.cc:515] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.772953 25313 raft_consensus.cc:359] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.777707 25313 raft_consensus.cc:385] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.777736 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:46.778198 25313 raft_consensus.cc:740] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.778707 25013 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:46.780453 25054 leader_election.cc:304] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:46.780890 25313 consensus_queue.cc:260] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.782949 25235 leader_election.cc:290] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.784421 25313 ts_tablet_manager.cc:1434] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:10:46.785960 25313 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.786461 25235 raft_consensus.cc:2804] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.787510 25235 raft_consensus.cc:493] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.788492 25235 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.805042 25313 tablet_bootstrap.cc:654] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.823580 25313 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.824127 25313 ts_tablet_manager.cc:1403] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.008s
I20260709 13:10:46.827059 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:46.827900 25161 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:46.831605 25313 raft_consensus.cc:359] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.832774 25313 raft_consensus.cc:385] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.833148 25313 raft_consensus.cc:740] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.838335 25313 consensus_queue.cc:260] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.839586 25212 raft_consensus.cc:493] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.840199 25212 raft_consensus.cc:515] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.843102 25212 leader_election.cc:290] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.844610 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
W20260709 13:10:46.846645 24980 leader_election.cc:343] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.848408 25313 ts_tablet_manager.cc:1434] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.002s
I20260709 13:10:46.852936 25313 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.857359 25340 raft_consensus.cc:493] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.858464 25340 raft_consensus.cc:515] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.862259 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc72d7cc06447a69577281699ef95f7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:46.863114 25013 raft_consensus.cc:2468] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:46.864845 25054 leader_election.cc:304] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:46.865787 25334 raft_consensus.cc:493] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.866488 25334 raft_consensus.cc:515] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.867455 25313 tablet_bootstrap.cc:654] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.867933 25336 raft_consensus.cc:493] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.868614 25336 raft_consensus.cc:515] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.874382 25341 raft_consensus.cc:493] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.875144 25341 raft_consensus.cc:515] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.880195 25342 raft_consensus.cc:2804] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.880681 25342 raft_consensus.cc:493] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.880996 25342 raft_consensus.cc:3060] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.881639 25313 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.882180 25313 ts_tablet_manager.cc:1403] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.003s
I20260709 13:10:46.882965 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
W20260709 13:10:46.894130 25128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33263, user_credentials={real_user=slave}} blocked reactor thread for 177542us
I20260709 13:10:46.894941 25340 leader_election.cc:290] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.898876 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:46.899823 25313 raft_consensus.cc:359] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.900637 25313 raft_consensus.cc:385] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:46.900933 25313 raft_consensus.cc:740] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
W20260709 13:10:46.902675 25126 leader_election.cc:343] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.902004 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc72d7cc06447a69577281699ef95f7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:46.903950 25161 raft_consensus.cc:2468] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:46.905437 25313 consensus_queue.cc:260] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.908751 25342 raft_consensus.cc:515] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.909149 25313 ts_tablet_manager.cc:1434] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 13:10:46.911825 25313 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: Bootstrap starting.
I20260709 13:10:46.912019 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc72d7cc06447a69577281699ef95f7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:46.912592 25013 raft_consensus.cc:3060] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.915002 25301 raft_consensus.cc:515] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.945305 25301 leader_election.cc:290] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:46.917845 25315 ts_tablet_manager.cc:1434] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.209s	user 0.055s	sys 0.041s
I20260709 13:10:46.920414 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:46.946173 25014 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:46.946645 25315 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:46.921159 25013 raft_consensus.cc:2468] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:46.916648 25335 raft_consensus.cc:493] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.923902 25313 tablet_bootstrap.cc:654] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.950090 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:46.951403 25054 leader_election.cc:304] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
W20260709 13:10:46.924451 24977 leader_election.cc:343] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.952455 24977 leader_election.cc:304] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f47172118f542bf83a5575fa1547171; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:46.952834 25340 raft_consensus.cc:2804] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.953327 25340 raft_consensus.cc:493] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.953353 25315 tablet_bootstrap.cc:654] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:46.953742 25340 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.925942 25212 raft_consensus.cc:493] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.958060 25212 raft_consensus.cc:515] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.961087 25212 leader_election.cc:290] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.962474 25335 raft_consensus.cc:515] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.927563 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:46.930076 25336 leader_election.cc:290] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:46.964975 25163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:46.965798 25163 raft_consensus.cc:2468] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:46.966434 25054 leader_election.cc:304] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:46.967095 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
W20260709 13:10:46.967540 25126 leader_election.cc:343] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:46.967701 24980 leader_election.cc:304] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:46.968374 25338 raft_consensus.cc:2804] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:46.968844 25347 raft_consensus.cc:2804] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:46.968863 25338 raft_consensus.cc:697] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:46.968978 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:46.969483 25347 raft_consensus.cc:493] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.969933 25347 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.969949 25013 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:46.970605 25340 raft_consensus.cc:515] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.970217 25338 consensus_queue.cc:237] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.971791 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:46.972549 25013 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.972738 25340 leader_election.cc:290] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.973387 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:46.975737 25313 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: No bootstrap required, opened a new log
I20260709 13:10:46.976138 25014 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.976454 25313 ts_tablet_manager.cc:1403] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 13:10:46.979967 25347 raft_consensus.cc:515] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.983868 25163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:46.984571 25163 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.988776 25014 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:46.935321 25342 leader_election.cc:290] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:46.938580 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:46.945103 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc72d7cc06447a69577281699ef95f7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.007970 25162 raft_consensus.cc:3060] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.945580 25314 tablet_bootstrap.cc:492] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:46.964735 25161 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:47.012072 25314 ts_tablet_manager.cc:1403] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.315s	user 0.055s	sys 0.082s
I20260709 13:10:46.961755 25212 raft_consensus.cc:2749] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.965348 25315 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:46.991667 25160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.013034 25315 ts_tablet_manager.cc:1403] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.003s
I20260709 13:10:47.013098 25160 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.992017 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.016148 25315 raft_consensus.cc:359] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.016889 25315 raft_consensus.cc:385] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.017161 25315 raft_consensus.cc:740] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.017786 25314 raft_consensus.cc:359] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.931912 25334 leader_election.cc:290] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:46.942193 25235 raft_consensus.cc:515] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.024932 25160 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:47.026808 25089 raft_consensus.cc:2393] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08b80f5b49d4083b4529b043fa8985e in current term 1: Already voted for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in this term.
I20260709 13:10:47.028633 25055 leader_election.cc:304] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.029570 25342 raft_consensus.cc:2804] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.025774 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.029822 25235 leader_election.cc:290] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.030521 25011 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.995645 25335 leader_election.cc:290] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:46.995556 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.033069 25314 raft_consensus.cc:385] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.033643 25314 raft_consensus.cc:740] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:46.996279 25347 leader_election.cc:290] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.034754 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.035483 25161 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:46.995483 25163 raft_consensus.cc:2468] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:47.043426 24980 leader_election.cc:304] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.044747 25347 raft_consensus.cc:2804] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.045244 25347 raft_consensus.cc:697] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:46.996448 25340 raft_consensus.cc:493] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.036019 24977 leader_election.cc:343] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.051067 25011 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:47.054212 25054 leader_election.cc:304] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:47.055347 25235 raft_consensus.cc:2804] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.056154 25235 raft_consensus.cc:697] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
W20260709 13:10:47.002682 25128 leader_election.cc:343] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.005416 25086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:47.005877 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.017907 25315 consensus_queue.cc:260] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:46.921422 25341 leader_election.cc:290] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.030130 25342 raft_consensus.cc:697] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:47.046411 25340 raft_consensus.cc:515] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.060739 25315 ts_tablet_manager.cc:1434] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:10:46.997135 25313 raft_consensus.cc:359] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.061353 25313 raft_consensus.cc:385] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.061621 25313 raft_consensus.cc:740] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.061906 25315 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: Bootstrap starting.
I20260709 13:10:47.062336 25313 consensus_queue.cc:260] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.057983 25128 leader_election.cc:304] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08b80f5b49d4083b4529b043fa8985e; no voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74
W20260709 13:10:47.063774 25128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.34.129:33263, user_credentials={real_user=slave}} blocked reactor thread for 61140.1us
I20260709 13:10:47.064463 25313 ts_tablet_manager.cc:1434] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 13:10:47.047541 25347 consensus_queue.cc:237] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.064929 25128 leader_election.cc:304] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.065868 25301 raft_consensus.cc:2749] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:46.935246 25345 raft_consensus.cc:493] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.054948 25161 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:47.076087 25315 tablet_bootstrap.cc:654] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.002560 25013 raft_consensus.cc:2468] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 1.
I20260709 13:10:47.060760 25342 consensus_queue.cc:237] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.071300 25345 raft_consensus.cc:515] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.070087 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.084812 25012 raft_consensus.cc:2468] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:47.078061 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.087225 25235 consensus_queue.cc:237] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.089054 25315 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: No bootstrap required, opened a new log
I20260709 13:10:47.035669 25314 consensus_queue.cc:260] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.089605 25315 ts_tablet_manager.cc:1403] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 13:10:47.094206 25054 leader_election.cc:304] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:47.095156 25315 raft_consensus.cc:359] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.096005 25315 raft_consensus.cc:385] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.096262 25315 raft_consensus.cc:740] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Initialized, Role: FOLLOWER
W20260709 13:10:47.096710 24960 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:47.096999 25315 consensus_queue.cc:260] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.097426 25341 raft_consensus.cc:2804] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.098127 25341 raft_consensus.cc:493] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.098538 25341 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.099876 25315 ts_tablet_manager.cc:1434] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:47.105036 25161 raft_consensus.cc:2468] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 0.
I20260709 13:10:47.106367 25128 leader_election.cc:304] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.107709 25335 raft_consensus.cc:2804] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.108213 25335 raft_consensus.cc:697] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:47.109107 25335 consensus_queue.cc:237] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.074955 25336 raft_consensus.cc:2764] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:47.116709 25212 raft_consensus.cc:493] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.068706 25340 leader_election.cc:290] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.126693 25212 raft_consensus.cc:515] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.130198 25341 raft_consensus.cc:515] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.132699 25345 leader_election.cc:290] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:47.134083 25341 leader_election.cc:290] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.134480 25086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.134980 25212 leader_election.cc:290] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.135470 25086 raft_consensus.cc:2393] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a08b80f5b49d4083b4529b043fa8985e in current term 1: Already voted for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in this term.
I20260709 13:10:47.074623 25162 raft_consensus.cc:2468] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:47.139335 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.140069 25161 raft_consensus.cc:2468] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
W20260709 13:10:47.142472 24977 leader_election.cc:343] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.147408 24980 leader_election.cc:304] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.115487 25314 ts_tablet_manager.cc:1434] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.003s
I20260709 13:10:47.149380 25212 raft_consensus.cc:2804] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.149750 25212 raft_consensus.cc:493] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.150094 25212 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.150317 25314 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:47.154861 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.155599 25161 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.164242 25212 raft_consensus.cc:515] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.167337 25212 leader_election.cc:290] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.147435 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.169870 25161 raft_consensus.cc:2468] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 1.
I20260709 13:10:47.160933 25335 raft_consensus.cc:493] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.170250 25086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.191180 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
W20260709 13:10:47.191615 24977 leader_election.cc:343] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:47.194392 24977 leader_election.cc:343] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.188597 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.196661 24912 catalog_manager.cc:5697] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.170374 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.199586 25162 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.170281 25126 leader_election.cc:304] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a08b80f5b49d4083b4529b043fa8985e; no voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.198380 25335 raft_consensus.cc:515] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.203962 25345 raft_consensus.cc:2749] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.204404 25055 leader_election.cc:304] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 8f47172118f542bf83a5575fa1547171
I20260709 13:10:47.189167 25012 raft_consensus.cc:2468] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:47.208465 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.208344 24909 catalog_manager.cc:5697] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 0 to 1, leader changed from <none> to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 1 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.208468 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.210223 25011 raft_consensus.cc:2468] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 0.
I20260709 13:10:47.211562 25128 leader_election.cc:304] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.204454 24911 catalog_manager.cc:5697] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.212949 25314 tablet_bootstrap.cc:654] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.207370 25235 raft_consensus.cc:2804] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.205544 25335 leader_election.cc:290] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:47.214198 25235 raft_consensus.cc:697] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:47.214390 25335 raft_consensus.cc:2804] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.214839 25335 raft_consensus.cc:493] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.215046 25162 raft_consensus.cc:2468] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:47.222368 25128 leader_election.cc:304] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.222498 24980 leader_election.cc:304] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.215202 25335 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.223872 25345 raft_consensus.cc:2764] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:47.224180 25212 raft_consensus.cc:2804] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:47.215631 25126 leader_election.cc:343] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.215194 25235 consensus_queue.cc:237] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.225651 25212 raft_consensus.cc:697] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.231961 25212 consensus_queue.cc:237] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.233767 25335 raft_consensus.cc:515] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.235764 25335 leader_election.cc:290] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:47.238423 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
W20260709 13:10:47.241103 25126 leader_election.cc:343] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:47.241333 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.245606 25314 tablet_bootstrap.cc:492] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:47.246459 25314 ts_tablet_manager.cc:1403] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.096s	user 0.025s	sys 0.008s
I20260709 13:10:47.250541 25012 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.255003 25314 raft_consensus.cc:359] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.256031 25314 raft_consensus.cc:385] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.256349 25314 raft_consensus.cc:740] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.257175 25314 consensus_queue.cc:260] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.260099 25314 ts_tablet_manager.cc:1434] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:10:47.261246 25012 raft_consensus.cc:2468] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 1.
I20260709 13:10:47.261451 25314 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:47.262763 25128 leader_election.cc:304] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.263710 25335 raft_consensus.cc:2804] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.264254 25335 raft_consensus.cc:697] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:47.265177 25335 consensus_queue.cc:237] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.270475 25314 tablet_bootstrap.cc:654] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.276401 25314 tablet_bootstrap.cc:492] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:47.276908 25314 ts_tablet_manager.cc:1403] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 13:10:47.279894 25314 raft_consensus.cc:359] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.280611 25314 raft_consensus.cc:385] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.280903 25314 raft_consensus.cc:740] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.281791 25314 consensus_queue.cc:260] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.284518 25314 ts_tablet_manager.cc:1434] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:47.285514 25314 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:47.290678 24911 catalog_manager.cc:5697] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.292364 25314 tablet_bootstrap.cc:654] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.295429 24909 catalog_manager.cc:5697] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 0 to 1, leader changed from <none> to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 1 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.297348 24912 catalog_manager.cc:5697] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.299415 24912 catalog_manager.cc:5697] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.301486 24912 catalog_manager.cc:5697] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 1 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.314826 25314 tablet_bootstrap.cc:492] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:47.315447 25314 ts_tablet_manager.cc:1403] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.015s
I20260709 13:10:47.316955 25212 raft_consensus.cc:493] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.317528 25212 raft_consensus.cc:515] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.319707 25212 leader_election.cc:290] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.321010 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.321332 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" is_pre_election: true
I20260709 13:10:47.321746 25162 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:47.322141 25087 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 0.
I20260709 13:10:47.323225 24980 leader_election.cc:304] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.322757 25314 raft_consensus.cc:359] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.324147 25212 raft_consensus.cc:2804] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:47.324517 25212 raft_consensus.cc:493] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.324810 25212 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.323940 25314 raft_consensus.cc:385] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.326414 25314 raft_consensus.cc:740] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.327239 25314 consensus_queue.cc:260] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.329473 25314 ts_tablet_manager.cc:1434] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:10:47.330399 25314 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Bootstrap starting.
I20260709 13:10:47.335659 25314 tablet_bootstrap.cc:654] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:47.332729 25212 raft_consensus.cc:515] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.345623 25212 leader_election.cc:290] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.346287 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:47.346783 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.347026 25087 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.347437 25162 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.348948 25314 tablet_bootstrap.cc:492] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: No bootstrap required, opened a new log
I20260709 13:10:47.349560 25314 ts_tablet_manager.cc:1403] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:10:47.352682 25314 raft_consensus.cc:359] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.353490 25314 raft_consensus.cc:385] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:47.353837 25314 raft_consensus.cc:740] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Initialized, Role: FOLLOWER
I20260709 13:10:47.354943 25162 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:47.354738 25314 consensus_queue.cc:260] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.355360 25087 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 1.
I20260709 13:10:47.356650 24977 leader_election.cc:304] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:47.357409 25314 ts_tablet_manager.cc:1434] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:47.357478 25212 raft_consensus.cc:2804] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:47.358227 25212 raft_consensus.cc:697] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.358990 25212 consensus_queue.cc:237] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.368381 24912 catalog_manager.cc:5697] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 1 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.376507 25338 consensus_queue.cc:1048] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.390918 25235 consensus_queue.cc:1048] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.475188 25212 consensus_queue.cc:1048] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.484313 25087 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.495090 25350 consensus_queue.cc:1048] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.504462 25342 raft_consensus.cc:493] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.504951 25342 raft_consensus.cc:515] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.507115 25342 leader_election.cc:290] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.508652 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.509593 25012 raft_consensus.cc:2393] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in current term 1: Already voted for candidate a08b80f5b49d4083b4529b043fa8985e in this term.
I20260709 13:10:47.511075 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.512542 25055 leader_election.cc:304] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:47.513561 25342 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.514565 25235 consensus_queue.cc:1048] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.526166 25235 consensus_queue.cc:1048] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.531908 25342 raft_consensus.cc:2749] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.532792 25342 consensus_queue.cc:1048] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.557904 25235 consensus_queue.cc:1048] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.567548 25335 consensus_queue.cc:1048] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.591029 25338 raft_consensus.cc:493] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.591429 25336 consensus_queue.cc:1048] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.591602 25338 raft_consensus.cc:515] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.596614 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.597527 25161 raft_consensus.cc:2393] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in current term 1: Already voted for candidate 8f47172118f542bf83a5575fa1547171 in this term.
I20260709 13:10:47.600994 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.604475 25054 leader_election.cc:304] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:47.605871 25344 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.610345 25087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:47.611194 25087 raft_consensus.cc:606] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:47.593935 25338 leader_election.cc:290] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.622731 25087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:47.623487 25087 raft_consensus.cc:606] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:47.626434 25344 raft_consensus.cc:2749] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.628866 25344 raft_consensus.cc:493] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.629403 25344 raft_consensus.cc:515] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.633126 25086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:44106
I20260709 13:10:47.633553 25344 leader_election.cc:290] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.633772 25086 raft_consensus.cc:606] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:47.634959 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b80f5b49d4083b4529b043fa8985e" is_pre_election: true
I20260709 13:10:47.635990 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f47172118f542bf83a5575fa1547171" is_pre_election: true
I20260709 13:10:47.636868 25012 raft_consensus.cc:2393] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in current term 1: Already voted for candidate a08b80f5b49d4083b4529b043fa8985e in this term.
I20260709 13:10:47.637880 25054 leader_election.cc:304] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:47.639091 25344 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.642174 25161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e356e913bb214d4e93223371660e01f0"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
mode: GRACEFUL
new_leader_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:58230
I20260709 13:10:47.642714 25161 raft_consensus.cc:606] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Received request to transfer leadership to TS 8f47172118f542bf83a5575fa1547171
I20260709 13:10:47.648204 25344 raft_consensus.cc:2749] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:47.650861 25012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:10:47.651449 25012 raft_consensus.cc:606] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.656920 25012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:10:47.657447 25012 raft_consensus.cc:606] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.663162 25161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27de8116092849e693bfe85db1121090"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
mode: GRACEFUL
new_leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:58230
I20260709 13:10:47.663735 25161 raft_consensus.cc:606] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Received request to transfer leadership to TS 9f7e6d1dc65b4f2aa339092d69ba0b74
I20260709 13:10:47.669898 25012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:35378
I20260709 13:10:47.670596 25012 raft_consensus.cc:606] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Received request to transfer leadership to TS a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:47.709537 25347 consensus_queue.cc:1048] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.710237 25350 consensus_queue.cc:1048] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.721326 25012 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:47.740159 25350 raft_consensus.cc:993] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: : Instructing follower a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:47.740820 25212 raft_consensus.cc:1081] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Signalling peer a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:47.745208 25160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:58202
I20260709 13:10:47.745790 25160 raft_consensus.cc:493] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.746142 25160 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.752022 25160 raft_consensus.cc:515] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.752468 25344 consensus_queue.cc:1048] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.757493 25086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:47.757737 25160 leader_election.cc:290] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:47.758285 25086 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.770483 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce31a0c58bcd43cdbaaeb61736cbde96" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.771426 25012 raft_consensus.cc:3055] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.773916 25012 raft_consensus.cc:740] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.774231 25086 raft_consensus.cc:2468] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 2.
I20260709 13:10:47.775390 25012 consensus_queue.cc:260] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.775985 25126 leader_election.cc:304] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:47.777192 25336 raft_consensus.cc:2804] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.777241 25012 raft_consensus.cc:3060] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.777855 25336 raft_consensus.cc:697] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 2 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:47.778918 25336 consensus_queue.cc:237] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.786993 25012 raft_consensus.cc:2468] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 2.
I20260709 13:10:47.789338 25338 raft_consensus.cc:993] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:47.789865 25338 raft_consensus.cc:1081] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:47.792019 25013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:47.795183 25013 raft_consensus.cc:493] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.795671 25013 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.798607 25336 consensus_queue.cc:1048] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.800617 24911 catalog_manager.cc:5697] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 1 to 2, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 2 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.807564 25340 consensus_queue.cc:1048] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.811440 25013 raft_consensus.cc:515] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.820653 25086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:47.821404 25086 raft_consensus.cc:3055] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.821748 25086 raft_consensus.cc:740] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:47.822717 25086 consensus_queue.cc:260] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.824234 25086 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.829577 25384 consensus_queue.cc:1048] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:47.835318 25013 leader_election.cc:290] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.837389 25162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b07d145570b4797b7dcd0c4259d4fbf" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.838497 25336 consensus_queue.cc:1048] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.849622 25086 raft_consensus.cc:2468] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:47.858021 24977 leader_election.cc:304] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:47.859701 25212 raft_consensus.cc:2804] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.860220 25212 raft_consensus.cc:697] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.861059 25212 consensus_queue.cc:237] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.872773 25212 consensus_queue.cc:1048] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:47.876364 25336 raft_consensus.cc:993] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.880750 25336 raft_consensus.cc:1081] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.883512 25088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27de8116092849e693bfe85db1121090"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44096
I20260709 13:10:47.885605 25088 raft_consensus.cc:493] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.886060 25088 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.897794 25088 raft_consensus.cc:515] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.897125 24912 catalog_manager.cc:5697] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.900974 25212 raft_consensus.cc:993] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.901564 25212 raft_consensus.cc:1081] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.903995 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44080
I20260709 13:10:47.904532 25089 raft_consensus.cc:493] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.904838 25089 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.906773 25088 leader_election.cc:290] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.908592 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.909114 25012 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.909488 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de8116092849e693bfe85db1121090" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.910115 25161 raft_consensus.cc:3055] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.910403 25161 raft_consensus.cc:740] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:47.911113 25161 consensus_queue.cc:260] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.912289 25161 raft_consensus.cc:3060] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.912537 25089 raft_consensus.cc:515] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.914481 25089 leader_election.cc:290] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.916152 25160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.916811 25160 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.918073 25013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7a94b3d5074de5b9053505a1e714a7" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.918653 25013 raft_consensus.cc:3055] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.918917 25013 raft_consensus.cc:740] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.939965 25013 consensus_queue.cc:260] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.941262 25013 raft_consensus.cc:3060] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.946645 25012 raft_consensus.cc:2468] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:47.948199 25013 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:47.948500 25054 leader_election.cc:304] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:47.949661 25344 raft_consensus.cc:2804] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.949936 25054 leader_election.cc:304] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:47.950191 25344 raft_consensus.cc:697] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:47.950987 25340 raft_consensus.cc:2804] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.951510 25340 raft_consensus.cc:697] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:47.951216 25344 consensus_queue.cc:237] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.952314 25340 consensus_queue.cc:237] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.957315 25160 raft_consensus.cc:2468] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:47.964596 25161 raft_consensus.cc:2468] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:47.966681 24911 catalog_manager.cc:5697] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.967955 24911 catalog_manager.cc:5697] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from a08b80f5b49d4083b4529b043fa8985e (127.14.34.131) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:47.982892 25350 raft_consensus.cc:993] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: : Instructing follower 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.983387 25347 raft_consensus.cc:1081] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Signalling peer 9f7e6d1dc65b4f2aa339092d69ba0b74 to start an election
I20260709 13:10:47.984982 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
 from {username='slave'} at 127.0.0.1:44080
I20260709 13:10:47.985481 25089 raft_consensus.cc:493] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.985800 25089 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.991642 25089 raft_consensus.cc:515] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.993494 25089 leader_election.cc:290] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:47.994485 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:47.995072 25161 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.994745 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e8ee9b43824f4ca519d29d8a5efa55" candidate_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:47.995596 25012 raft_consensus.cc:3055] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.996006 25012 raft_consensus.cc:740] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:47.996938 25012 consensus_queue.cc:260] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:47.998286 25012 raft_consensus.cc:3060] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.000738 25161 raft_consensus.cc:2468] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:48.001897 25055 leader_election.cc:304] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:48.002660 25344 raft_consensus.cc:2804] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.003108 25344 raft_consensus.cc:697] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Leader. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:48.003875 25344 consensus_queue.cc:237] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.010373 25012 raft_consensus.cc:2468] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7e6d1dc65b4f2aa339092d69ba0b74 in term 2.
I20260709 13:10:48.011763 24911 catalog_manager.cc:5697] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 reported cstate change: term changed from 1 to 2, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130). New cstate: current_term: 2 leader_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.019939 25334 raft_consensus.cc:993] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.020609 25334 raft_consensus.cc:1081] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.026964 25012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e356e913bb214d4e93223371660e01f0"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:10:48.027732 25012 raft_consensus.cc:493] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.028206 25012 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.037209 25012 raft_consensus.cc:515] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.040477 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:48.040825 25012 leader_election.cc:290] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:48.041110 25088 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.043126 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e356e913bb214d4e93223371660e01f0" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:48.043979 25161 raft_consensus.cc:3055] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.044430 25161 raft_consensus.cc:740] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:48.045853 25340 raft_consensus.cc:993] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.046475 25338 raft_consensus.cc:1081] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.045501 25161 consensus_queue.cc:260] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.048303 25161 raft_consensus.cc:3060] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.049037 25088 raft_consensus.cc:2468] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.050393 24977 leader_election.cc:304] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:48.051131 25012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:48.051306 25347 raft_consensus.cc:2804] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.051826 25012 raft_consensus.cc:493] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.051913 25347 raft_consensus.cc:697] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:48.052256 25012 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.052874 25347 consensus_queue.cc:237] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.056681 25161 raft_consensus.cc:2468] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.059912 25012 raft_consensus.cc:515] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.062148 25012 leader_election.cc:290] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:48.064035 24912 catalog_manager.cc:5697] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from a08b80f5b49d4083b4529b043fa8985e (127.14.34.131) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.065090 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:48.065510 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2e9452f6064450ea0cf62ef970760b8" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:48.065703 25161 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.066341 25088 raft_consensus.cc:3055] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.066812 25088 raft_consensus.cc:740] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:48.067793 25088 consensus_queue.cc:260] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.069119 25088 raft_consensus.cc:3060] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.077656 25088 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.078629 25161 raft_consensus.cc:2468] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.078944 24977 leader_election.cc:304] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:48.079969 25347 raft_consensus.cc:2804] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.080413 25347 raft_consensus.cc:697] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:48.081146 25347 consensus_queue.cc:237] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.087858 24912 catalog_manager.cc:5697] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.139058 25338 raft_consensus.cc:993] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.139561 25338 raft_consensus.cc:1081] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Signalling peer 8f47172118f542bf83a5575fa1547171 to start an election
I20260709 13:10:48.141559 25012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
 from {username='slave'} at 127.0.0.1:35370
I20260709 13:10:48.142206 25012 raft_consensus.cc:493] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.142585 25012 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.150913 25012 raft_consensus.cc:515] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.153448 25012 leader_election.cc:290] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Requested vote from peers 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973), a08b80f5b49d4083b4529b043fa8985e (127.14.34.131:39779)
I20260709 13:10:48.154148 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:48.154517 25161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0588700e0dbf47ba8c3ce9a970b911ef" candidate_uuid: "8f47172118f542bf83a5575fa1547171" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
I20260709 13:10:48.155128 25088 raft_consensus.cc:3055] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.155128 25161 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.155684 25088 raft_consensus.cc:740] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:48.156629 25088 consensus_queue.cc:260] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.157608 25088 raft_consensus.cc:3060] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.162935 25088 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.162971 25161 raft_consensus.cc:2468] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f47172118f542bf83a5575fa1547171 in term 2.
I20260709 13:10:48.164114 24977 leader_election.cc:304] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, 9f7e6d1dc65b4f2aa339092d69ba0b74; no voters: 
I20260709 13:10:48.164933 25347 raft_consensus.cc:2804] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.165450 25347 raft_consensus.cc:697] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Leader. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:48.166330 25347 consensus_queue.cc:237] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:48.172319 25088 raft_consensus.cc:1275] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.173952 25345 consensus_queue.cc:1048] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.174646 24912 catalog_manager.cc:5697] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 reported cstate change: term changed from 1 to 2, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to 8f47172118f542bf83a5575fa1547171 (127.14.34.129). New cstate: current_term: 2 leader_uuid: "8f47172118f542bf83a5575fa1547171" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.196215 25012 raft_consensus.cc:1275] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.197681 25345 consensus_queue.cc:1048] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.252791 25160 raft_consensus.cc:3060] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.258687 25160 raft_consensus.cc:1275] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.260120 25347 consensus_queue.cc:1048] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.271093 25088 raft_consensus.cc:1275] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.273078 25347 consensus_queue.cc:1048] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.340364 25160 raft_consensus.cc:1275] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.341851 25340 consensus_queue.cc:1048] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.349516 25012 raft_consensus.cc:1275] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.351120 25338 consensus_queue.cc:1048] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.373345 25161 raft_consensus.cc:1275] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.374608 25338 consensus_queue.cc:1048] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.383824 25013 raft_consensus.cc:1275] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.385255 25338 consensus_queue.cc:1048] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.517392 25161 raft_consensus.cc:1275] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.518675 25347 consensus_queue.cc:1048] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.526850 25088 raft_consensus.cc:1275] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.529444 25347 consensus_queue.cc:1048] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.546636 25013 raft_consensus.cc:1275] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.549088 25338 consensus_queue.cc:1048] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.551016 25161 raft_consensus.cc:1275] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 9f7e6d1dc65b4f2aa339092d69ba0b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.553236 25338 consensus_queue.cc:1048] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.569485 25160 raft_consensus.cc:1275] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.571630 25347 consensus_queue.cc:1048] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.586887 25088 raft_consensus.cc:1275] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.589404 25347 consensus_queue.cc:1048] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.743489 25088 raft_consensus.cc:1275] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.744835 25347 consensus_queue.cc:1048] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.753595 25160 raft_consensus.cc:1275] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Refusing update from remote peer 8f47172118f542bf83a5575fa1547171: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.755077 25347 consensus_queue.cc:1048] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.674190 24911 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54138:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:50.694984 24911 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54138:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:50.741767 14474 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.780723 25425 tablet.cc:1724] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:50.857931 25431 tablet.cc:1724] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:50.860517 25433 tablet.cc:1724] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:50.958869 25425 tablet.cc:1724] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:50.967906 24980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.34.131:39779, user_credentials={real_user=slave}} blocked reactor thread for 54023.4us
I20260709 13:10:50.907305 25427 tablet.cc:1724] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:50.982853 25452 tablet.cc:1724] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.006953 25425 tablet.cc:1724] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.009968 25456 tablet.cc:1724] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.030004 25453 tablet.cc:1724] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.048398 25454 tablet.cc:1724] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.098289 25455 tablet.cc:1724] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.129900 25433 tablet.cc:1724] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.131050 25461 tablet.cc:1724] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.144243 25425 tablet.cc:1724] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.149315 25089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4"
dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
mode: GRACEFUL
new_leader_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:37902
I20260709 13:10:51.150051 25089 raft_consensus.cc:606] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Received request to transfer leadership to TS a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:51.161094 25460 tablet.cc:1724] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.182260 25427 tablet.cc:1724] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.187810 25456 tablet.cc:1724] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.193075 25455 tablet.cc:1724] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.222332 25465 tablet.cc:1724] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.233641 25431 tablet.cc:1724] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.238386 25454 tablet.cc:1724] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.258901 25425 tablet.cc:1724] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.259667 25452 tablet.cc:1724] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.268944 25453 tablet.cc:1724] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.259080 25461 tablet.cc:1724] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.272200 25011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6"
dest_uuid: "8f47172118f542bf83a5575fa1547171"
mode: GRACEFUL
new_leader_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:41324
I20260709 13:10:51.273340 25011 raft_consensus.cc:606] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Received request to transfer leadership to TS a08b80f5b49d4083b4529b043fa8985e
I20260709 13:10:51.278762 14474 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:51.279491 14474 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:51.294152 25455 tablet.cc:1724] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.278765 25431 tablet.cc:1724] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:51.322744 24910 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: soft_deleted_table [id=828cdb287f524f699eb2bf4d6b437fe8] alter complete (version 1)
I20260709 13:10:51.570161 25398 raft_consensus.cc:993] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: : Instructing follower a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:51.570669 25398 raft_consensus.cc:1081] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Signalling peer a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:51.572665 25161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:10:51.573136 25161 raft_consensus.cc:493] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.573432 25161 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.578375 25161 raft_consensus.cc:515] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.580389 25161 leader_election.cc:290] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 3 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:51.581117 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:51.581408 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43707942b72e4d55a0ae863162f902c4" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:51.581827 25011 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.582075 25087 raft_consensus.cc:3055] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.582463 25087 raft_consensus.cc:740] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f7e6d1dc65b4f2aa339092d69ba0b74, State: Running, Role: LEADER
I20260709 13:10:51.583143 25087 consensus_queue.cc:260] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.584137 25087 raft_consensus.cc:3060] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.587556 25011 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 3.
I20260709 13:10:51.588773 25128 leader_election.cc:304] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f47172118f542bf83a5575fa1547171, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:51.589550 25437 raft_consensus.cc:2804] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:51.589546 25087 raft_consensus.cc:2468] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 3.
I20260709 13:10:51.590404 25437 raft_consensus.cc:697] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 3 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:51.591291 25437 consensus_queue.cc:237] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.600209 24911 catalog_manager.cc:5697] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 2 to 3, leader changed from 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130) to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 3 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.696576 25438 raft_consensus.cc:993] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: : Instructing follower a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:51.697168 25450 raft_consensus.cc:1081] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Signalling peer a08b80f5b49d4083b4529b043fa8985e to start an election
I20260709 13:10:51.698573 25161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6"
dest_uuid: "a08b80f5b49d4083b4529b043fa8985e"
 from {username='slave'} at 127.0.0.1:58202
I20260709 13:10:51.699159 25161 raft_consensus.cc:493] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.699517 25161 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.704624 25161 raft_consensus.cc:515] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.706051 25161 leader_election.cc:290] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 3 election: Requested vote from peers 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263), 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973)
I20260709 13:10:51.707007 25011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f47172118f542bf83a5575fa1547171"
I20260709 13:10:51.707036 25087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9decb21034a04f3e94e2153fd82c2fa6" candidate_uuid: "a08b80f5b49d4083b4529b043fa8985e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74"
I20260709 13:10:51.707695 25011 raft_consensus.cc:3055] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.707789 25087 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.708015 25011 raft_consensus.cc:740] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f47172118f542bf83a5575fa1547171, State: Running, Role: LEADER
I20260709 13:10:51.708889 25011 consensus_queue.cc:260] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.709899 25011 raft_consensus.cc:3060] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.715636 25087 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 3.
I20260709 13:10:51.716168 25011 raft_consensus.cc:2468] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a08b80f5b49d4083b4529b043fa8985e in term 3.
I20260709 13:10:51.717135 25126 leader_election.cc:304] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f7e6d1dc65b4f2aa339092d69ba0b74, a08b80f5b49d4083b4529b043fa8985e; no voters: 
I20260709 13:10:51.718168 25437 raft_consensus.cc:2804] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:51.718643 25437 raft_consensus.cc:697] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 3 LEADER]: Becoming Leader. State: Replica: a08b80f5b49d4083b4529b043fa8985e, State: Running, Role: LEADER
I20260709 13:10:51.719498 25437 consensus_queue.cc:237] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } }
I20260709 13:10:51.727653 24911 catalog_manager.cc:5697] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e reported cstate change: term changed from 2 to 3, leader changed from 8f47172118f542bf83a5575fa1547171 (127.14.34.129) to a08b80f5b49d4083b4529b043fa8985e (127.14.34.131). New cstate: current_term: 3 leader_uuid: "a08b80f5b49d4083b4529b043fa8985e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b80f5b49d4083b4529b043fa8985e" member_type: VOTER last_known_addr { host: "127.14.34.131" port: 39779 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.057364 25087 raft_consensus.cc:1275] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.058597 25437 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.073154 25011 raft_consensus.cc:1275] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.075083 25475 consensus_queue.cc:1048] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:52.195976 25087 raft_consensus.cc:1275] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.197552 25475 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7e6d1dc65b4f2aa339092d69ba0b74" member_type: VOTER last_known_addr { host: "127.14.34.130" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.208745 25011 raft_consensus.cc:1275] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Refusing update from remote peer a08b80f5b49d4083b4529b043fa8985e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:52.215013 25437 consensus_queue.cc:1048] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f47172118f542bf83a5575fa1547171" member_type: VOTER last_known_addr { host: "127.14.34.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.335860 14474 tablet_server.cc:179] TabletServer@127.14.34.129:0 shutting down...
I20260709 13:10:52.363087 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:52.363868 14474 tablet_replica.cc:333] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.364580 14474 raft_consensus.cc:2243] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.365167 14474 raft_consensus.cc:2272] T ce31a0c58bcd43cdbaaeb61736cbde96 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.367266 14474 tablet_replica.cc:333] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.367906 14474 raft_consensus.cc:2243] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.368393 14474 raft_consensus.cc:2272] T 27de8116092849e693bfe85db1121090 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.370412 14474 tablet_replica.cc:333] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.371217 14474 raft_consensus.cc:2243] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.372217 14474 raft_consensus.cc:2272] T e356e913bb214d4e93223371660e01f0 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.374678 14474 tablet_replica.cc:333] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.375241 14474 raft_consensus.cc:2243] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.375978 14474 raft_consensus.cc:2272] T e2e9452f6064450ea0cf62ef970760b8 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.377873 14474 tablet_replica.cc:333] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.378501 14474 raft_consensus.cc:2243] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.379220 14474 raft_consensus.cc:2272] T 0588700e0dbf47ba8c3ce9a970b911ef P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.381064 14474 tablet_replica.cc:333] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.381594 14474 raft_consensus.cc:2243] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.381986 14474 raft_consensus.cc:2272] T 9d7a94b3d5074de5b9053505a1e714a7 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.383883 14474 tablet_replica.cc:333] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.384619 14474 raft_consensus.cc:2243] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.385190 14474 raft_consensus.cc:2272] T b9e29d50d81f4fac80042e87009c1116 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.387671 25054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:10:52.388569 14474 tablet_replica.cc:333] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.389504 14474 raft_consensus.cc:2243] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.390106 14474 raft_consensus.cc:2272] T 40e8ee9b43824f4ca519d29d8a5efa55 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.390823 25054 consensus_peers.cc:597] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.392643 14474 tablet_replica.cc:333] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.393357 14474 raft_consensus.cc:2243] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.393890 14474 raft_consensus.cc:2272] T 43707942b72e4d55a0ae863162f902c4 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.394731 25054 consensus_peers.cc:597] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.396685 14474 tablet_replica.cc:333] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.397573 14474 raft_consensus.cc:2243] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.398159 14474 raft_consensus.cc:2272] T ffc72d7cc06447a69577281699ef95f7 P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.400098 14474 tablet_replica.cc:333] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.400684 14474 raft_consensus.cc:2243] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.401137 14474 raft_consensus.cc:2272] T af5e9e607a84402c9520ad801bef3647 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.403641 14474 tablet_replica.cc:333] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.404484 14474 raft_consensus.cc:2243] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.405054 14474 raft_consensus.cc:2272] T 794ae7c2cdc5463282c97fa88b22f5cb P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.407650 14474 tablet_replica.cc:333] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.408277 14474 raft_consensus.cc:2243] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.409122 14474 raft_consensus.cc:2272] T 96f8c3ab62834572af2d935593315ac6 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.411415 14474 tablet_replica.cc:333] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.411979 14474 raft_consensus.cc:2243] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.413120 14474 raft_consensus.cc:2272] T 0b07d145570b4797b7dcd0c4259d4fbf P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.415355 14474 tablet_replica.cc:333] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.415980 14474 raft_consensus.cc:2243] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.416823 14474 raft_consensus.cc:2272] T 7b747e1e81b54ad4838e20dc02df6a5b P 8f47172118f542bf83a5575fa1547171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.419096 14474 tablet_replica.cc:333] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.419660 14474 raft_consensus.cc:2243] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.420485 14474 raft_consensus.cc:2272] T 8bb59340244844dabecbf6fb19299767 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.423233 14474 tablet_replica.cc:333] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.423928 14474 raft_consensus.cc:2243] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.424544 14474 raft_consensus.cc:2272] T 6d4d20ab96214b1a8afd61d913954b70 P 8f47172118f542bf83a5575fa1547171 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.425061 25054 consensus_peers.cc:597] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.427037 14474 tablet_replica.cc:333] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171: stopping tablet replica
I20260709 13:10:52.427642 14474 raft_consensus.cc:2243] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.428043 14474 raft_consensus.cc:2272] T 9decb21034a04f3e94e2153fd82c2fa6 P 8f47172118f542bf83a5575fa1547171 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.440412 25054 consensus_peers.cc:597] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.461076 25054 consensus_peers.cc:597] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.496222 14474 tablet_server.cc:196] TabletServer@127.14.34.129:0 shutdown complete.
I20260709 13:10:52.527881 14474 tablet_server.cc:179] TabletServer@127.14.34.130:0 shutting down...
I20260709 13:10:52.556726 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:52.557569 14474 tablet_replica.cc:333] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.558558 14474 raft_consensus.cc:2243] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.559156 14474 raft_consensus.cc:2272] T ce31a0c58bcd43cdbaaeb61736cbde96 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.560967 14474 tablet_replica.cc:333] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.561486 14474 raft_consensus.cc:2243] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.562305 14474 raft_consensus.cc:2272] T 27de8116092849e693bfe85db1121090 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.564149 14474 tablet_replica.cc:333] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.564741 14474 raft_consensus.cc:2243] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.565205 14474 raft_consensus.cc:2272] T e356e913bb214d4e93223371660e01f0 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.567037 14474 tablet_replica.cc:333] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.567549 14474 raft_consensus.cc:2243] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.567968 14474 raft_consensus.cc:2272] T 0588700e0dbf47ba8c3ce9a970b911ef P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.569742 14474 tablet_replica.cc:333] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.570426 14474 raft_consensus.cc:2243] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.571203 14474 raft_consensus.cc:2272] T 9d7a94b3d5074de5b9053505a1e714a7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.573027 14474 tablet_replica.cc:333] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.573588 14474 raft_consensus.cc:2243] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.574407 14474 raft_consensus.cc:2272] T b9e29d50d81f4fac80042e87009c1116 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.576431 14474 tablet_replica.cc:333] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.576942 14474 raft_consensus.cc:2243] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.577658 14474 raft_consensus.cc:2272] T ffc72d7cc06447a69577281699ef95f7 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.579509 14474 tablet_replica.cc:333] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.580062 14474 raft_consensus.cc:2243] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.580503 14474 raft_consensus.cc:2272] T af5e9e607a84402c9520ad801bef3647 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.582388 14474 tablet_replica.cc:333] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.582950 14474 raft_consensus.cc:2243] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.583700 14474 raft_consensus.cc:2272] T 794ae7c2cdc5463282c97fa88b22f5cb P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.585554 14474 tablet_replica.cc:333] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.586170 14474 raft_consensus.cc:2243] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.586668 14474 raft_consensus.cc:2272] T e2e9452f6064450ea0cf62ef970760b8 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.588528 14474 tablet_replica.cc:333] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.589103 14474 raft_consensus.cc:2243] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.589879 14474 raft_consensus.cc:2272] T 40e8ee9b43824f4ca519d29d8a5efa55 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.592136 14474 tablet_replica.cc:333] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.592671 14474 raft_consensus.cc:2243] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.593106 14474 raft_consensus.cc:2272] T 43707942b72e4d55a0ae863162f902c4 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.595564 14474 tablet_replica.cc:333] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.596127 14474 raft_consensus.cc:2243] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.596588 14474 raft_consensus.cc:2272] T 9decb21034a04f3e94e2153fd82c2fa6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.600003 14474 tablet_replica.cc:333] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.600944 14474 raft_consensus.cc:2243] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.601809 14474 raft_consensus.cc:2272] T 6d4d20ab96214b1a8afd61d913954b70 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.604157 14474 tablet_replica.cc:333] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.604746 14474 raft_consensus.cc:2243] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.605170 14474 raft_consensus.cc:2272] T 8bb59340244844dabecbf6fb19299767 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.607499 14474 tablet_replica.cc:333] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.607968 14474 raft_consensus.cc:2243] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.608385 14474 raft_consensus.cc:2272] T 0b07d145570b4797b7dcd0c4259d4fbf P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.610381 14474 tablet_replica.cc:333] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.610944 14474 raft_consensus.cc:2243] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.611419 14474 raft_consensus.cc:2272] T 96f8c3ab62834572af2d935593315ac6 P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.613488 14474 tablet_replica.cc:333] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74: stopping tablet replica
I20260709 13:10:52.613925 14474 raft_consensus.cc:2243] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.614430 14474 raft_consensus.cc:2272] T 7b747e1e81b54ad4838e20dc02df6a5b P 9f7e6d1dc65b4f2aa339092d69ba0b74 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:52.637962 25126 connection.cc:573] client connection to 127.14.34.130:45973 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:52.646003 25126 consensus_peers.cc:597] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e -> Peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Couldn't send request to peer 9f7e6d1dc65b4f2aa339092d69ba0b74. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:45973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.648176 14474 tablet_server.cc:196] TabletServer@127.14.34.130:0 shutdown complete.
W20260709 13:10:52.649241 25126 consensus_peers.cc:597] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e -> Peer 9f7e6d1dc65b4f2aa339092d69ba0b74 (127.14.34.130:45973): Couldn't send request to peer 9f7e6d1dc65b4f2aa339092d69ba0b74. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.130:45973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.655778 25128 consensus_peers.cc:597] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.679987 14474 tablet_server.cc:179] TabletServer@127.14.34.131:0 shutting down...
W20260709 13:10:52.688359 25128 consensus_peers.cc:597] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:52.708122 25128 consensus_peers.cc:597] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e -> Peer 8f47172118f542bf83a5575fa1547171 (127.14.34.129:33263): Couldn't send request to peer 8f47172118f542bf83a5575fa1547171. Status: Network error: Client connection negotiation failed: client connection to 127.14.34.129:33263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.714962 14474 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:52.715770 14474 tablet_replica.cc:333] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.716591 14474 raft_consensus.cc:2243] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.717455 14474 raft_consensus.cc:2272] T ce31a0c58bcd43cdbaaeb61736cbde96 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.719611 14474 tablet_replica.cc:333] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.720193 14474 raft_consensus.cc:2243] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.720629 14474 raft_consensus.cc:2272] T 27de8116092849e693bfe85db1121090 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.722397 14474 tablet_replica.cc:333] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.722935 14474 raft_consensus.cc:2243] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.723351 14474 raft_consensus.cc:2272] T e356e913bb214d4e93223371660e01f0 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.725101 14474 tablet_replica.cc:333] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.725621 14474 raft_consensus.cc:2243] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.726069 14474 raft_consensus.cc:2272] T e2e9452f6064450ea0cf62ef970760b8 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.727713 14474 tablet_replica.cc:333] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.728215 14474 raft_consensus.cc:2243] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.728637 14474 raft_consensus.cc:2272] T 0588700e0dbf47ba8c3ce9a970b911ef P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.730407 14474 tablet_replica.cc:333] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.730930 14474 raft_consensus.cc:2243] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.731410 14474 raft_consensus.cc:2272] T 9d7a94b3d5074de5b9053505a1e714a7 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.733110 14474 tablet_replica.cc:333] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.733700 14474 raft_consensus.cc:2243] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.734171 14474 raft_consensus.cc:2272] T b9e29d50d81f4fac80042e87009c1116 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.736176 14474 tablet_replica.cc:333] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.736706 14474 raft_consensus.cc:2243] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.737130 14474 raft_consensus.cc:2272] T 40e8ee9b43824f4ca519d29d8a5efa55 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.738897 14474 tablet_replica.cc:333] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.739463 14474 raft_consensus.cc:2243] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.740269 14474 raft_consensus.cc:2272] T 43707942b72e4d55a0ae863162f902c4 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.742659 14474 tablet_replica.cc:333] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.743242 14474 raft_consensus.cc:2243] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.743685 14474 raft_consensus.cc:2272] T ffc72d7cc06447a69577281699ef95f7 P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.745407 14474 tablet_replica.cc:333] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.745940 14474 raft_consensus.cc:2243] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.746781 14474 raft_consensus.cc:2272] T af5e9e607a84402c9520ad801bef3647 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.748724 14474 tablet_replica.cc:333] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.749264 14474 raft_consensus.cc:2243] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.749696 14474 raft_consensus.cc:2272] T 794ae7c2cdc5463282c97fa88b22f5cb P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.751750 14474 tablet_replica.cc:333] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.752265 14474 raft_consensus.cc:2243] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.752686 14474 raft_consensus.cc:2272] T 6d4d20ab96214b1a8afd61d913954b70 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.754707 14474 tablet_replica.cc:333] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.755219 14474 raft_consensus.cc:2243] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.755998 14474 raft_consensus.cc:2272] T 9decb21034a04f3e94e2153fd82c2fa6 P a08b80f5b49d4083b4529b043fa8985e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.758275 14474 tablet_replica.cc:333] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.758795 14474 raft_consensus.cc:2243] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.759256 14474 raft_consensus.cc:2272] T 0b07d145570b4797b7dcd0c4259d4fbf P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.761025 14474 tablet_replica.cc:333] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.761538 14474 raft_consensus.cc:2243] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.761983 14474 raft_consensus.cc:2272] T 96f8c3ab62834572af2d935593315ac6 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.764050 14474 tablet_replica.cc:333] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.764515 14474 raft_consensus.cc:2243] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.764956 14474 raft_consensus.cc:2272] T 8bb59340244844dabecbf6fb19299767 P a08b80f5b49d4083b4529b043fa8985e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.766963 14474 tablet_replica.cc:333] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e: stopping tablet replica
I20260709 13:10:52.767406 14474 raft_consensus.cc:2243] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:52.767798 14474 raft_consensus.cc:2272] T 7b747e1e81b54ad4838e20dc02df6a5b P a08b80f5b49d4083b4529b043fa8985e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.805179 14474 tablet_server.cc:196] TabletServer@127.14.34.131:0 shutdown complete.
I20260709 13:10:52.836665 14474 master.cc:562] Master@127.14.34.190:38091 shutting down...
I20260709 13:10:52.863658 14474 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:52.864279 14474 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:52.864641 14474 tablet_replica.cc:333] T 00000000000000000000000000000000 P 24cd97c3c9ab48bdbdcec20982eef42b: stopping tablet replica
I20260709 13:10:52.886722 14474 master.cc:584] Master@127.14.34.190:38091 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12534 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25027 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (326625 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:52.943135 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 396 messages since previous log ~15 seconds ago
I20260709 13:10:52.943383 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 396 messages since previous log ~15 seconds ago
I20260709 13:10:52.943593 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 395 messages since previous log ~15 seconds ago
I20260709 13:10:52.943848 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:10:52.944134 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:10:52.944365 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~81 seconds ago
I20260709 13:10:52.944592 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~158 seconds ago
I20260709 13:10:52.944864 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:10:52.945175 14474 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
